-- Logs begin at Mon 2022-10-17 09:43:58 UTC, end at Mon 2022-10-17 10:43:44 UTC. -- Oct 17 10:10:47.172940 dv-cinder-860209-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 17 10:10:47.181486 dv-cinder-860209-5-smb devstack@keystone.service[81373]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 17 10:10:47.183479 dv-cinder-860209-5-smb devstack@keystone.service[81373]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 10:10:47 2022] *** Oct 17 10:10:47.183479 dv-cinder-860209-5-smb devstack@keystone.service[81373]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 10:10:47.183479 dv-cinder-860209-5-smb devstack@keystone.service[81373]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 10:10:47.183479 dv-cinder-860209-5-smb devstack@keystone.service[81373]: nodename: dv-cinder-860209-5-smb Oct 17 10:10:47.183479 dv-cinder-860209-5-smb devstack@keystone.service[81373]: machine: x86_64 Oct 17 10:10:47.183479 dv-cinder-860209-5-smb devstack@keystone.service[81373]: clock source: unix Oct 17 10:10:47.183479 dv-cinder-860209-5-smb devstack@keystone.service[81373]: pcre jit disabled Oct 17 10:10:47.183479 dv-cinder-860209-5-smb devstack@keystone.service[81373]: detected number of CPU cores: 4 Oct 17 10:10:47.183479 dv-cinder-860209-5-smb devstack@keystone.service[81373]: current working directory: / Oct 17 10:10:47.183479 dv-cinder-860209-5-smb devstack@keystone.service[81373]: detected binary path: /usr/bin/uwsgi-core Oct 17 10:10:47.184043 dv-cinder-860209-5-smb devstack@keystone.service[81373]: your processes number limit is 47680 Oct 17 10:10:47.184043 dv-cinder-860209-5-smb devstack@keystone.service[81373]: your memory page size is 4096 bytes Oct 17 10:10:47.184043 dv-cinder-860209-5-smb devstack@keystone.service[81373]: detected max file descriptor number: 2048 Oct 17 10:10:47.184043 dv-cinder-860209-5-smb devstack@keystone.service[81373]: lock engine: pthread robust mutexes Oct 17 10:10:47.184043 dv-cinder-860209-5-smb devstack@keystone.service[81373]: thunder lock: enabled Oct 17 10:10:47.184043 dv-cinder-860209-5-smb devstack@keystone.service[81373]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 17 10:10:47.184043 dv-cinder-860209-5-smb devstack@keystone.service[81373]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 10:10:47.223224 dv-cinder-860209-5-smb devstack@keystone.service[81373]: Python main interpreter initialized at 0x55d7027ec9c0 Oct 17 10:10:47.223224 dv-cinder-860209-5-smb devstack@keystone.service[81373]: python threads support enabled Oct 17 10:10:47.223224 dv-cinder-860209-5-smb devstack@keystone.service[81373]: your server socket listen backlog is limited to 100 connections Oct 17 10:10:47.223224 dv-cinder-860209-5-smb devstack@keystone.service[81373]: your mercy for graceful operations on workers is 90 seconds Oct 17 10:10:47.223599 dv-cinder-860209-5-smb devstack@keystone.service[81373]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 10:10:47.223682 dv-cinder-860209-5-smb devstack@keystone.service[81373]: *** Operational MODE: preforking *** Oct 17 10:10:47.223912 dv-cinder-860209-5-smb devstack@keystone.service[81373]: *** uWSGI is running in multiple interpreter mode *** Oct 17 10:10:47.223912 dv-cinder-860209-5-smb devstack@keystone.service[81373]: spawned uWSGI master process (pid: 81373) Oct 17 10:10:47.224133 dv-cinder-860209-5-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 17 10:10:47.226356 dv-cinder-860209-5-smb devstack@keystone.service[81373]: spawned uWSGI worker 1 (pid: 81385, cores: 1) Oct 17 10:10:47.226356 dv-cinder-860209-5-smb devstack@keystone.service[81373]: spawned uWSGI worker 2 (pid: 81386, cores: 1) Oct 17 10:10:47.226356 dv-cinder-860209-5-smb devstack@keystone.service[81373]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 10:10:51.469271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 10:10:51.469271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: from cryptography.utils import int_from_bytes Oct 17 10:10:51.470052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 10:10:51.470052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: from cryptography.utils import int_from_bytes Oct 17 10:10:51.470170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 10:10:51.470170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: from cryptography.utils import int_from_bytes Oct 17 10:10:51.470170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 10:10:51.470170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: from cryptography.utils import int_from_bytes Oct 17 10:10:51.519359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 10:10:51.519500 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 10:10:51.519586 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 10:10:51.519661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 10:10:51.519719 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] command line args: [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 10:10:51.519778 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] command line args: [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 10:10:51.519994 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 10:10:51.520096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 10:10:51.520173 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ================================================================================ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 10:10:51.520247 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ================================================================================ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 10:10:51.520408 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] admin_token = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.520488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] admin_token = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.520653 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] config_dir = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.520730 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] config_dir = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.520839 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.520921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.521018 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] config_source = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.521094 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] config_source = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.521195 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] debug = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.521271 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] debug = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.521391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.521653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.521747 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.521807 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.521935 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.522038 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.522164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.522278 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.522410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.522516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.522636 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.522740 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.522837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_config_append = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.522940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_config_append = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.523041 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.523133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.523133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_dir = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.523312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_dir = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.523403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_file = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.523498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_file = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.523596 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.523700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.523776 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.523886 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.524024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.524104 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.524228 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.524304 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.524417 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.524532 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.524620 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.524700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.524821 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.524894 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.525004 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.525076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.525226 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.525313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.525456 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.525538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.525686 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.525803 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.525911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.526045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.526185 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.526262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.526379 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.526456 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.526678 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.526813 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.527123 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.527197 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.527292 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] publish_errors = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.527362 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] publish_errors = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.527516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.527653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.527732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.527813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.527913 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.528019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.528176 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.528286 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.528446 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.528549 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.528665 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] standard_threads = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.528739 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] standard_threads = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.528854 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.528938 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.529091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.529167 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.529288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.529410 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.529410 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_journal = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.529724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_journal = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.529856 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_json = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.529981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_json = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.530102 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_stderr = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.530187 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_stderr = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.530256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_syslog = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.530332 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_syslog = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.530401 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.530474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:10:51.530548 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.530616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.530683 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.530761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.530831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.530904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.531045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.531896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.531990 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.532071 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.532142 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.532215 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.532314 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.532390 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.532549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.532631 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.532795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.532876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.533038 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.533119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.533285 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.533371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.533515 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.533590 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.533761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.533835 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.533992 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.534075 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.534233 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.534307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.534477 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.534555 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.534692 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.534785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.534947 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.535033 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.535196 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.535277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.535438 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.535587 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.535658 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.535731 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.535905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.536036 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.536183 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.536260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.536431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.536505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.536678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.536751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.536904 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.536984 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.537131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.537212 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.537363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.537436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.537591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.537667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.537835 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.537909 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.538078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.538152 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.538304 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.538380 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.538530 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.538610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.538773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.538849 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.539015 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.539091 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.539248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.539328 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.539490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.539575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.539718 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.539800 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.539966 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.540045 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.540200 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.540275 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.540427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.540503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.540654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.540735 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.540881 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.540955 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.541097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.541166 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.541328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.541407 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.541571 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.541652 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.541798 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.541874 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.542032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.542105 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.542260 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.542333 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.542491 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.542567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.542720 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.542794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.542965 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.543037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.543188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.543262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.543421 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.543502 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.543655 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.543728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.543885 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.543974 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.544140 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.544254 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.544366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.544471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.544572 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.544666 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.544818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.544919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.545048 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.545160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.545283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.545384 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.545511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.545619 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.545765 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.545879 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.545995 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.546082 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.546211 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.546285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.546444 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.546519 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.546676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.546798 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.547508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.547587 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.547745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.547867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.548007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.548097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.548245 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.548321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.548479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.548557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.548712 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.548839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.548973 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.549065 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.549183 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.549260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.549416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.549505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.549648 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.549723 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.549890 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.549970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.550121 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.550203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.550364 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.550439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.550597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.550676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.550828 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.550911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.551059 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.551134 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.551291 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.551369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.551522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.551604 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.551776 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.551850 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.552036 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.552119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.552282 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.552374 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.552520 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.552597 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.552754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.552831 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.552993 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.553141 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.553214 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.553281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.553446 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.553523 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.553676 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.553764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.553901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.553979 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.554129 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.554204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.554357 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.554433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.554587 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.554664 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.554814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.554888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.555050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.555128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.555283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.555359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.555526 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.555600 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.555759 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.555836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.556030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.556110 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.556289 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.556364 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.556528 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.556633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.556756 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.external = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.556840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.external = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.556983 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.557066 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.557281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.557394 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.557510 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.557591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.557739 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.password = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.557839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.password = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.557963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.token = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.558039 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.token = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.558198 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.558274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.558428 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.558506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.558670 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.558753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.558896 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.558972 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.559138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.559216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.559381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.559457 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.559609 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.559686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.559841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.559918 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.560106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.560183 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.560352 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.560428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.560595 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.560674 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.560834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.560909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.561071 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.561146 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.561301 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.561378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.561541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.561623 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.561790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.561867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.562022 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.562100 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.562272 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.562362 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.562595 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.562672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.562838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.562916 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.563098 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.563172 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.563339 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.563413 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.563591 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.563667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.563822 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.563898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.564078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.564156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.564323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.564400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.564565 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.564640 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.564792 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.564868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.565034 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.565111 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.565266 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.565342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.565516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.565598 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.565747 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.565822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.566000 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.566075 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.566230 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.566312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.566474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.566551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.566706 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.566782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.566949 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.567103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.567176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.567244 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.567415 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.567491 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.567644 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.567727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.567887 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.567981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.568137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.568213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.568372 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.568459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.568616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.568693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.568863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.568938 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.569093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.569176 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.569319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.569393 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.569546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.569621 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.569785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.569868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.570028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.570102 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.570271 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.570356 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.570517 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.570600 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.570760 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.570844 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.571024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.571101 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.571258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.571342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.571493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.571572 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.571717 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.571791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.571967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.572059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.572198 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.572275 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.572431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.572508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.572668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.572751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.572903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.572977 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.573147 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.573227 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.573372 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.573454 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.573614 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.573689 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.573853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.573928 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.574083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.574166 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.574325 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.574407 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.574567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.574641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.574790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.574866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.575023 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.575098 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.575248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.575323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.575481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.575557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.575712 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.575792 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.575976 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.576055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.576203 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.576280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.576549 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.576630 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.576801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.576876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.577049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.577125 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.577278 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.577353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.577511 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.577586 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.577756 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.577832 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.578026 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.578108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.578261 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.578335 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.578496 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.578572 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.578728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.578804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.578958 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.579034 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.579214 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.579298 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.579450 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.579527 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.579678 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.579754 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.579923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.580021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.580188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.580264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.580434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.580510 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.580666 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.580745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.580896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.580970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.581128 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.581203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.581362 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.581438 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.581592 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.581666 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.581819 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.581894 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.582062 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.582140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.582306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.582380 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.582546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.582621 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.582788 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.582865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.583031 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.583106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.583256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.583331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.583498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.583576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.583733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.583808 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.583986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.584066 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.584222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.584300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.584454 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.584529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.584693 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.584769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.584938 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.585022 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.585173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.585257 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.585424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.585499 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.585653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.585729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.585891 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.585966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.586124 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.586198 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.586354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.586430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.586588 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.586662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.586829 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.586904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.587067 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.587144 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.587296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.587371 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.587534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.587609 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.587772 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.587848 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.588042 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.588121 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.588289 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.588365 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.588523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.588601 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.588771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.588846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.589016 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.589090 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.589249 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.589324 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.589490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.589564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.589723 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.589796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.589940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.590012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.590173 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] role.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.590249 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] role.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.590416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] role.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.590499 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] role.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.590641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.590717 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.590886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.590962 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.591131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.591215 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.591373 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.591450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.591614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.591690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.591858 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.591986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.592123 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.592201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.592371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.592445 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.592612 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.592698 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.592840 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.592916 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.593082 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.593158 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.593326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.593413 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.593569 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.594141 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.594335 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.594410 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.594723 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.594807 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.594959 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.595033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.595205 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.595283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.595452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.595534 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.595696 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.595771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.595956 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.596036 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.596194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.596272 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.596445 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.596520 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.596693 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.596768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.596929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.597007 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.597159 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.597234 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.597386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.597460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.597614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.597692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.597862 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.597937 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.598111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.598186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.598355 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.598432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.598587 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.598663 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.598818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.598894 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.599046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.599122 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.599275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.599349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.599509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.599585 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.599753 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.599831 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.600010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.600087 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.600265 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.600339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.600509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.600588 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.600741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.600817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.600982 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.601056 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.601217 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.601293 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.601461 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.601537 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.601695 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.601771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.601929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.602006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.602159 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.602235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.602400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.602475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.602673 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.602749 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.602898 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.602981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.603137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.603222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.603397 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.603473 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.603654 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.603737 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.603891 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.604019 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.604157 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.604234 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.604393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.604481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.604630 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.604714 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.604862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.604938 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.605095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.605178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.605579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.605656 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.605812 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.605889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.606052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.606136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.606284 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.606360 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.606524 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.606600 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.606757 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.606841 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.607000 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.607076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.607231 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.607306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.607469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.607554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.607698 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.607775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.607949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.608028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.608192 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.608279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:10:51.608351 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 10:10:51.608419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 10:10:51.638101 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.638334 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.638436 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.638560 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.638641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.638799 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.647413 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.647648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.675073 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.675300 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.675533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.675765 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.728100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.728368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.776986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.777216 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.778133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.778368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.932286 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.932472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.932542 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.932651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.932731 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.932875 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.932956 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.933094 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.933219 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.933298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.933370 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.933513 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.956534 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.956763 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.956846 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.956987 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.957083 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.957209 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.957289 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.957428 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.957506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.957645 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.957741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.957872 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.958004 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.958113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.968924 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.969195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.981731 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.981924 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.982148 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.982241 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.982383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.982462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.982601 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.982682 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.982815 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.982902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.983028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.983108 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.983241 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:51.983458 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 10:10:52.000269 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.000479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 17 10:10:52.000560 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.000689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 17 10:10:52.000820 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.001019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 17 10:10:52.001111 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.001216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 17 10:10:52.001294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.001487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.001566 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.001747 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.001827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.002007 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.002085 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.002265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.011574 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.011839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.011921 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.012138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.012217 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.012411 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.012502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.012695 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.019912 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.020693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.023177 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.023460 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.023591 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.023740 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.023880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.024042 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.024194 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.024326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.024478 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.024584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.024761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.024840 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.025022 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.025103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.025293 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.025371 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.025567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.025654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.025838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.025917 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.026111 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.026382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.049181 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.049579 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.050636 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.050918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.051037 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.051324 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.055580 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.055862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.056377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.056501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.056601 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.056601 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.062506 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.062795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.062906 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.063192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.068499 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.068794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.068960 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.069081 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.069264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.069358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.069557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.069637 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.069845 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.069924 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.070126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.070207 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.070388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.070466 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.070668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.070938 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.086827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.086956 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.087108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.087236 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.090997 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.091096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.094800 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.094891 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.095096 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.095177 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.099280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.099365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.102383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.102550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.105839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.106057 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.106140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.106354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.106435 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.106636 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.106726 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.106918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.106999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.107200 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.107281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.107485 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.122890 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.123183 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.123297 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.123455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.123583 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.123718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.123849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.124135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.131121 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.131477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.132700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.133047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.134235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.134511 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.134591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.134833 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.137206 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.137499 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.137610 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.137778 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.137873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.138063 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.138150 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.138348 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.138440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.138730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.150153 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.150411 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.150495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.150695 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.150777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.150969 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.151051 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.151245 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.151327 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.151609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.151700 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.151886 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.151997 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.152201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.167334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.167599 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.170284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.170509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.173275 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.173452 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.174727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.175009 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.176228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.176519 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.176646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.176908 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.177004 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.177316 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.183283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.183666 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.184797 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.185142 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.188222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.188586 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.188670 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.188887 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.188969 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.189163 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.189248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.189505 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.197024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.197317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.197412 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.197604 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.197686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.197885 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.205061 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.205303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 10:10:52.205388 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.205585 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.205669 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.205864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.205944 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.206134 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.206227 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.206405 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.206488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.206675 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.206765 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.206948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.207043 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.207226 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.207317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.207489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.207568 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.207764 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.207844 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.208057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.208155 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.208319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.208400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.208589 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.208671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.208870 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 10:10:52.242794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d7027ec9c0 pid: 81385 (default app) Oct 17 10:10:52.242912 dv-cinder-860209-5-smb devstack@keystone.service[81386]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d7027ec9c0 pid: 81386 (default app) Oct 17 10:10:52.246081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccfbfe-1039-4034-91d5-b32a900ec53f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:10:52.246371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccfbfe-1039-4034-91d5-b32a900ec53f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:10:52.246644 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccfbfe-1039-4034-91d5-b32a900ec53f None None] PATH_INFO: `/v3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:10:52.251345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Mon Oct 17 10:10:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:10:58.952074 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc6dae-fd05-4d55-a157-6c9cbf72f193 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:10:58.952584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc6dae-fd05-4d55-a157-6c9cbf72f193 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:10:58.953229 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc6dae-fd05-4d55-a157-6c9cbf72f193 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:10:58.957455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:10:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:10:58.962713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1328a-86a5-461f-ba6f-38c4b879699a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:10:58.963164 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1328a-86a5-461f-ba6f-38c4b879699a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:10:58.963301 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1328a-86a5-461f-ba6f-38c4b879699a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:10:59.035289 dv-cinder-860209-5-smb devstack@keystone.service[81385]: INFO dbcounter [None req-34c1328a-86a5-461f-ba6f-38c4b879699a None None] Registered counter for database keystone Oct 17 10:10:59.053970 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG oslo_db.sqlalchemy.engines [None req-34c1328a-86a5-461f-ba6f-38c4b879699a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:10:59.060261 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writer thread running {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:10:59.239624 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG passlib.handlers.bcrypt [None req-34c1328a-86a5-461f-ba6f-38c4b879699a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81385) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 17 10:10:59.239956 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG passlib.handlers.bcrypt [None req-34c1328a-86a5-461f-ba6f-38c4b879699a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81385) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 17 10:10:59.297416 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-34c1328a-86a5-461f-ba6f-38c4b879699a None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:10:59.299041 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-34c1328a-86a5-461f-ba6f-38c4b879699a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:10:59.427240 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:10:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 17 10:10:59.884767 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc6dae-fd05-4d55-a157-6c9cbf72f193 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:10:59.971465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: INFO dbcounter [None req-62dc6dae-fd05-4d55-a157-6c9cbf72f193 None None] Registered counter for database keystone Oct 17 10:10:59.993082 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG oslo_db.sqlalchemy.engines [None req-62dc6dae-fd05-4d55-a157-6c9cbf72f193 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:10:59.999140 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writer thread running {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:11:00.120076 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc6dae-fd05-4d55-a157-6c9cbf72f193 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:00.124362 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646a7b7-8b3c-4b37-ad4d-9b6669732876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:00.125495 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646a7b7-8b3c-4b37-ad4d-9b6669732876 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:00.125776 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646a7b7-8b3c-4b37-ad4d-9b6669732876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:00.126050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646a7b7-8b3c-4b37-ad4d-9b6669732876 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:00.134213 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646a7b7-8b3c-4b37-ad4d-9b6669732876 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:00.189213 dv-cinder-860209-5-smb devstack@keystone.service[81386]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2646a7b7-8b3c-4b37-ad4d-9b6669732876 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 17 10:11:00.189502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646a7b7-8b3c-4b37-ad4d-9b6669732876 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:00.198966 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Oct 17 10:10:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 17 10:11:00.205460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1328a-86a5-461f-ba6f-38c4b879699a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:00.222719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1328a-86a5-461f-ba6f-38c4b879699a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:00.227156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fa4e8-748c-449a-a284-9d604d7eaaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:00.228304 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fa4e8-748c-449a-a284-9d604d7eaaee admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:00.228588 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fa4e8-748c-449a-a284-9d604d7eaaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:00.228862 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fa4e8-748c-449a-a284-9d604d7eaaee admin admin] PATH_INFO: `/v3/projects/4fb717994bee40c5a122b7bec779dc47` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:00.230743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fa4e8-748c-449a-a284-9d604d7eaaee admin admin] RBAC: Authorizing `identity:get_project(project_id=4fb717994bee40c5a122b7bec779dc47)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:00.284072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ea1fa4e8-748c-449a-a284-9d604d7eaaee admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 17 10:11:00.284643 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fa4e8-748c-449a-a284-9d604d7eaaee admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:00.291214 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Oct 17 10:11:00 2022] GET /identity/v3/projects/4fb717994bee40c5a122b7bec779dc47 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:02.408852 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a08c2c-a17a-4aa9-9d84-5d0b73064df2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:02.409348 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a08c2c-a17a-4aa9-9d84-5d0b73064df2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:02.409429 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a08c2c-a17a-4aa9-9d84-5d0b73064df2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:02.413533 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:02.418967 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e987f-982e-4514-bdef-cc70fdfbb9ef None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:02.419382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e987f-982e-4514-bdef-cc70fdfbb9ef None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:02.419544 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e987f-982e-4514-bdef-cc70fdfbb9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:02.439771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3e7e987f-982e-4514-bdef-cc70fdfbb9ef None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:02.441337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3e7e987f-982e-4514-bdef-cc70fdfbb9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:02.449199 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 17 10:11:02.719491 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a08c2c-a17a-4aa9-9d84-5d0b73064df2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:02.731699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a08c2c-a17a-4aa9-9d84-5d0b73064df2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:02.735914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00737f-a8d4-4af0-907c-41a0352c55e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:02.736531 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00737f-a8d4-4af0-907c-41a0352c55e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:02.736811 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00737f-a8d4-4af0-907c-41a0352c55e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:02.737091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00737f-a8d4-4af0-907c-41a0352c55e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:02.744588 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00737f-a8d4-4af0-907c-41a0352c55e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:02.746346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00737f-a8d4-4af0-907c-41a0352c55e6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:02.755253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Oct 17 10:11:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 10:11:02.760353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e987f-982e-4514-bdef-cc70fdfbb9ef None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:02.769801 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e987f-982e-4514-bdef-cc70fdfbb9ef None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:02.774109 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc66db-a905-4a34-8556-13e1e9a8cb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:02.774728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc66db-a905-4a34-8556-13e1e9a8cb7d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:02.775008 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc66db-a905-4a34-8556-13e1e9a8cb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:02.775281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc66db-a905-4a34-8556-13e1e9a8cb7d admin admin] PATH_INFO: `/v3/users/b74fb7e0184d4dd9bc4b1b1fd5ed0d2e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:02.776648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc66db-a905-4a34-8556-13e1e9a8cb7d admin admin] RBAC: Authorizing `identity:get_user(user_id=b74fb7e0184d4dd9bc4b1b1fd5ed0d2e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:02.778473 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc66db-a905-4a34-8556-13e1e9a8cb7d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:02.780000 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Oct 17 10:11:02 2022] GET /identity/v3/users/b74fb7e0184d4dd9bc4b1b1fd5ed0d2e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:04.943510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb7da0-f8bb-46e2-bfe0-b0a7d148e1a5 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:04.944062 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb7da0-f8bb-46e2-bfe0-b0a7d148e1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:04.944062 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb7da0-f8bb-46e2-bfe0-b0a7d148e1a5 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:04.945403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:04.950448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b87457-55f5-4f19-91e4-78a9a6ed47c9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:04.950849 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b87457-55f5-4f19-91e4-78a9a6ed47c9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:04.951009 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b87457-55f5-4f19-91e4-78a9a6ed47c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:04.969859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f8b87457-55f5-4f19-91e4-78a9a6ed47c9 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:04.971040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f8b87457-55f5-4f19-91e4-78a9a6ed47c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:04.994991 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b58a3-68d7-42ba-8355-cd56c0fb0027 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:04.995274 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b58a3-68d7-42ba-8355-cd56c0fb0027 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:04.995546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b58a3-68d7-42ba-8355-cd56c0fb0027 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:04.996900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:11:05.001751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c5721-8d1f-4bae-b6b6-a93d7988589f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:05.002037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c5721-8d1f-4bae-b6b6-a93d7988589f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:05.002311 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c5721-8d1f-4bae-b6b6-a93d7988589f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:05.044346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG passlib.handlers.bcrypt [None req-fd6c5721-8d1f-4bae-b6b6-a93d7988589f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81386) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 17 10:11:05.044727 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG passlib.handlers.bcrypt [None req-fd6c5721-8d1f-4bae-b6b6-a93d7988589f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81386) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 17 10:11:05.052810 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:05.095984 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fd6c5721-8d1f-4bae-b6b6-a93d7988589f None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:05.097611 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fd6c5721-8d1f-4bae-b6b6-a93d7988589f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:05.198876 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:11:05.325752 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b87457-55f5-4f19-91e4-78a9a6ed47c9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:05.350903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:05.432312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b87457-55f5-4f19-91e4-78a9a6ed47c9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:05.465133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302a62d-f2a6-4b73-b3ba-178affcdaa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:05.465693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302a62d-f2a6-4b73-b3ba-178affcdaa9f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:05.465829 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c5721-8d1f-4bae-b6b6-a93d7988589f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:05.465973 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302a62d-f2a6-4b73-b3ba-178affcdaa9f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:05.466249 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302a62d-f2a6-4b73-b3ba-178affcdaa9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:05.479110 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302a62d-f2a6-4b73-b3ba-178affcdaa9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:05.488904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e302a62d-f2a6-4b73-b3ba-178affcdaa9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:11:05.488904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:05.488904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:05.488904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:05.488904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:05.488904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:05.488904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:05.488904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:05.488904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:05.488904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:05.488904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:05.488904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:05.488904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:05.488904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:05.488904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:05.488904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:05.489838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:05.489838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:05.489838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:05.489838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:05.489838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:05.489838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:05.489838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:05.489838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:05.489838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:05.489838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:05.489838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:05.489838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:05.489838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:05.489838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:05.489838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:05.489838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:05.490786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:05.490786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:05.490786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:05.490786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:05.490786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:05.490786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:05.490786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:05.490786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:05.490786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:05.490786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:05.490786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:11:05.490786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:05.490786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:11:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:05.496526 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302a62d-f2a6-4b73-b3ba-178affcdaa9f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:05.570167 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c5721-8d1f-4bae-b6b6-a93d7988589f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:05.573256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:05.579504 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:05.598219 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302a62d-f2a6-4b73-b3ba-178affcdaa9f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:05.611636 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba179d1-f273-4afa-bcbe-da6d9a68f7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:05.612746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba179d1-f273-4afa-bcbe-da6d9a68f7c2 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:05.613114 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba179d1-f273-4afa-bcbe-da6d9a68f7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:05.613483 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba179d1-f273-4afa-bcbe-da6d9a68f7c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:05.614577 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba179d1-f273-4afa-bcbe-da6d9a68f7c2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:05.616461 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba179d1-f273-4afa-bcbe-da6d9a68f7c2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:05.628248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.sql.core [None req-0ba179d1-f273-4afa-bcbe-da6d9a68f7c2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 10:11:05.628248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 10:11:05.628248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [parameters: {'id': 'c189a033c3b641c796c30d4e7a81043b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 17 10:11:05.628248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81386) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 17 10:11:05.633064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e968b-5ed5-48f0-ae79-4a137ef0a59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:05.633680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e968b-5ed5-48f0-ae79-4a137ef0a59d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:05.633959 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e968b-5ed5-48f0-ae79-4a137ef0a59d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:05.634233 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e968b-5ed5-48f0-ae79-4a137ef0a59d None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:05.634911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e968b-5ed5-48f0-ae79-4a137ef0a59d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:05.635212 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e968b-5ed5-48f0-ae79-4a137ef0a59d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:05.636648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e968b-5ed5-48f0-ae79-4a137ef0a59d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:05.647550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-0ba179d1-f273-4afa-bcbe-da6d9a68f7c2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 17 10:11:05.647550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:05.647550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 10:11:05.647550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 10:11:05.647550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 10:11:05.647550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 10:11:05.647550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 10:11:05.647550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 10:11:05.647550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 10:11:05.647550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application conn.query(q) Oct 17 10:11:05.647550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 10:11:05.647550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 10:11:05.647550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 10:11:05.647550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result.read() Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 17 10:11:05.648423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application next(self.gen) Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application yield resource Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application next(self.gen) Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.session.rollback() Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.force_reraise() Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise self.value Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application session.commit() Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 17 10:11:05.649573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._prepare_impl() Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.session.flush() Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._flush(objects) Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application compat.raise_( Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application flush_context.execute() Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rec.execute(self) Oct 17 10:11:05.650846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 10:11:05.651888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 17 10:11:05.651888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 10:11:05.651888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 17 10:11:05.651888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 17 10:11:05.651888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 17 10:11:05.651888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 10:11:05.651888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 10:11:05.651888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 10:11:05.651888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 17 10:11:05.651888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 10:11:05.651888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 17 10:11:05.651888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 10:11:05.651888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 17 10:11:05.651888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 10:11:05.651888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application conn.query(q) Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result.read() Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 10:11:05.652813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 10:11:05.653859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 10:11:05.653859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 10:11:05.653859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 10:11:05.653859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 10:11:05.653859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 10:11:05.653859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 10:11:05.653859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 10:11:05.653859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [parameters: {'id': 'c189a033c3b641c796c30d4e7a81043b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 17 10:11:05.653859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 10:11:05.653859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:05.653859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:11:05.653859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:05.653859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:05.653859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 17 10:11:05.653859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:05.654751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:05.655902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 17 10:11:05.655902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 17 10:11:05.655902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:05.655902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:05.655902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 17 10:11:05.655902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 17 10:11:05.655902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:05.655902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:05.655902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 17 10:11:05.655902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 17 10:11:05.655902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 17 10:11:05.655902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:05.655902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 8/15] 10.222.0.13 () {60 vars in 1137 bytes} [Mon Oct 17 10:11:05 2022] POST /identity/v3/domains => generated 190 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:11:05.656818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 8/16] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:05.656902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba179d1-f273-4afa-bcbe-da6d9a68f7c2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:05.656985 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e968b-5ed5-48f0-ae79-4a137ef0a59d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:05.755292 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba179d1-f273-4afa-bcbe-da6d9a68f7c2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:05.755471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e968b-5ed5-48f0-ae79-4a137ef0a59d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:05.788586 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81b246-0338-41af-815d-517055992ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:05.788780 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850b1f8-b2de-4231-9d12-fc7b36e45b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:05.789228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81b246-0338-41af-815d-517055992ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:05.789510 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81b246-0338-41af-815d-517055992ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:05.789594 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850b1f8-b2de-4231-9d12-fc7b36e45b72 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:05.789787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81b246-0338-41af-815d-517055992ce0 None admin] PATH_INFO: `/v3/users/b74fb7e0184d4dd9bc4b1b1fd5ed0d2e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:05.789883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850b1f8-b2de-4231-9d12-fc7b36e45b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:05.790066 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850b1f8-b2de-4231-9d12-fc7b36e45b72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:05.790942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81b246-0338-41af-815d-517055992ce0 None admin] RBAC: Authorizing `identity:get_user(user_id=b74fb7e0184d4dd9bc4b1b1fd5ed0d2e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:05.792439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81b246-0338-41af-815d-517055992ce0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:05.794033 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:05 2022] GET /identity/v3/users/b74fb7e0184d4dd9bc4b1b1fd5ed0d2e => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:05.800193 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81b246-0338-41af-815d-517055992ce0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:05.808918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850b1f8-b2de-4231-9d12-fc7b36e45b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:05.810385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850b1f8-b2de-4231-9d12-fc7b36e45b72 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:05.815434 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:05.828367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-b850b1f8-b2de-4231-9d12-fc7b36e45b72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:11:05.828367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:05.828367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:05.828367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:05.828367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:05.828367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:05.828367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:05.828367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:05.828367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:05.828367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:05.828367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:05.828367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:05.828367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:11:05.828367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:11:05.828367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:11:05.828367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:05.829474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:11:05.830465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:11:05.830465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:11:05.830465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:05.830465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 9/18] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:05.835665 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850b1f8-b2de-4231-9d12-fc7b36e45b72 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:05.861997 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:05.903576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81b246-0338-41af-815d-517055992ce0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:05.938638 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897311c-0cb7-4190-974c-f0b2184e7114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:05.939272 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897311c-0cb7-4190-974c-f0b2184e7114 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:05.939551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897311c-0cb7-4190-974c-f0b2184e7114 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:05.939827 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897311c-0cb7-4190-974c-f0b2184e7114 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:05.940983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897311c-0cb7-4190-974c-f0b2184e7114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:05.942434 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897311c-0cb7-4190-974c-f0b2184e7114 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:05.943394 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850b1f8-b2de-4231-9d12-fc7b36e45b72 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:05.944001 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 10/19] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:11:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:05.949607 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897311c-0cb7-4190-974c-f0b2184e7114 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:05.978163 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1ff44-4bc3-4bd8-ad01-632f634eddb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:05.978773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1ff44-4bc3-4bd8-ad01-632f634eddb4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:05.979051 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1ff44-4bc3-4bd8-ad01-632f634eddb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:05.979321 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1ff44-4bc3-4bd8-ad01-632f634eddb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:05.980254 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1ff44-4bc3-4bd8-ad01-632f634eddb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:05.980555 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1ff44-4bc3-4bd8-ad01-632f634eddb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:05.981956 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1ff44-4bc3-4bd8-ad01-632f634eddb4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:06.000058 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 10/20] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:06.036723 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:06.057570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897311c-0cb7-4190-974c-f0b2184e7114 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:06.095591 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f14a6-3077-4845-9313-ddbbbcdb1bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:06.096301 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f14a6-3077-4845-9313-ddbbbcdb1bc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:06.096582 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f14a6-3077-4845-9313-ddbbbcdb1bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:06.096859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f14a6-3077-4845-9313-ddbbbcdb1bc5 None admin] PATH_INFO: `/v3/domains/default/users/b74fb7e0184d4dd9bc4b1b1fd5ed0d2e/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:06.098827 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f14a6-3077-4845-9313-ddbbbcdb1bc5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b74fb7e0184d4dd9bc4b1b1fd5ed0d2e, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:06.100312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f14a6-3077-4845-9313-ddbbbcdb1bc5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:06.216600 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 11/21] 10.222.0.13 () {58 vars in 1361 bytes} [Mon Oct 17 10:11:05 2022] PUT /identity/v3/domains/default/users/b74fb7e0184d4dd9bc4b1b1fd5ed0d2e/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:11:08.624965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d18cf-e99a-473f-9063-57115cb414a9 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:08.625971 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d18cf-e99a-473f-9063-57115cb414a9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:08.626475 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d18cf-e99a-473f-9063-57115cb414a9 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:08.628098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 11/22] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:08.634633 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851fc93-c9de-4955-b88f-1dd22d1461b0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:08.635474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851fc93-c9de-4955-b88f-1dd22d1461b0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:08.635984 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851fc93-c9de-4955-b88f-1dd22d1461b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:08.656085 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3851fc93-c9de-4955-b88f-1dd22d1461b0 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:08.658002 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3851fc93-c9de-4955-b88f-1dd22d1461b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:08.725862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d459d2-992e-4b7c-9926-042d9e88fb22 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:08.726186 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d459d2-992e-4b7c-9926-042d9e88fb22 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:08.726410 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d459d2-992e-4b7c-9926-042d9e88fb22 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:08.727733 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 12/23] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:11:08.733053 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654c207-caa3-4da6-9065-17edff3c26ab None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:08.733339 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654c207-caa3-4da6-9065-17edff3c26ab None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:08.734145 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654c207-caa3-4da6-9065-17edff3c26ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:08.735806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 12/24] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:08.769159 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e654c207-caa3-4da6-9065-17edff3c26ab None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:08.770409 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e654c207-caa3-4da6-9065-17edff3c26ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:08.866540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 13/25] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:11:08.931787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4cece-f15a-4bd9-8c59-d558951ac24b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:08.932452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4cece-f15a-4bd9-8c59-d558951ac24b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:08.932938 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4cece-f15a-4bd9-8c59-d558951ac24b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:08.937522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 13/26] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:08.947625 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd460acb-6b45-4769-83aa-e830f471a8cf None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:08.947908 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd460acb-6b45-4769-83aa-e830f471a8cf None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:08.948232 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd460acb-6b45-4769-83aa-e830f471a8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:08.972947 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bd460acb-6b45-4769-83aa-e830f471a8cf None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:08.974151 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bd460acb-6b45-4769-83aa-e830f471a8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:08.976994 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:09.065130 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 14/27] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:09.069367 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4cece-f15a-4bd9-8c59-d558951ac24b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:09.166831 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:09.208721 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4cece-f15a-4bd9-8c59-d558951ac24b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:09.228683 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd460acb-6b45-4769-83aa-e830f471a8cf None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:09.263647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df7c5f-1e0a-4e0c-bbba-1c238e23d631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:09.264342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df7c5f-1e0a-4e0c-bbba-1c238e23d631 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:09.264628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df7c5f-1e0a-4e0c-bbba-1c238e23d631 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:09.264972 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df7c5f-1e0a-4e0c-bbba-1c238e23d631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:09.284525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df7c5f-1e0a-4e0c-bbba-1c238e23d631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:09.286154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df7c5f-1e0a-4e0c-bbba-1c238e23d631 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:09.317250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-81df7c5f-1e0a-4e0c-bbba-1c238e23d631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:11:09.317250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:09.317250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:09.317250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:09.317250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:09.317250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:09.317250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:09.317250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:09.317250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:09.317250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:09.317250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:09.317250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:09.317250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:11:09.317250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:11:09.317250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:11:09.317250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:09.318154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:11:09.318945 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:11:09.318945 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:11:09.318945 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:09.318945 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 14/28] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:09.326173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df7c5f-1e0a-4e0c-bbba-1c238e23d631 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:09.430150 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd460acb-6b45-4769-83aa-e830f471a8cf None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:09.483030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b327258-9b11-4ce7-9959-d3282dbc86e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:09.485239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b327258-9b11-4ce7-9959-d3282dbc86e7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:09.485758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b327258-9b11-4ce7-9959-d3282dbc86e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:09.486273 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b327258-9b11-4ce7-9959-d3282dbc86e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:09.501550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:09.509457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b327258-9b11-4ce7-9959-d3282dbc86e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:09.517729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-5b327258-9b11-4ce7-9959-d3282dbc86e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:11:09.517729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:09.517729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:09.517729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:09.517729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:09.517729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:09.517729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:09.517729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:09.517729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:09.517729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:09.517729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:09.517729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:09.517729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:09.517729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:09.517729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:09.517729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:09.518675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:09.518675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:09.518675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:09.518675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:09.518675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:09.518675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:09.518675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:09.518675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:09.518675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:09.518675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:09.518675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:09.518675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:09.518675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:09.518675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:09.518675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:09.518675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:09.519420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:09.519420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:09.519420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:09.519420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:09.519420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:09.519420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:09.519420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:09.519420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:09.519420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:09.519420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:09.519420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:11:09.519420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:09.521604 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 15/29] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:11:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:09.523263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92149b06-0117-4cd8-8782-be221ef5ebbb None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:09.523873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92149b06-0117-4cd8-8782-be221ef5ebbb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:09.524507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92149b06-0117-4cd8-8782-be221ef5ebbb None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:09.526248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:09.526884 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92149b06-0117-4cd8-8782-be221ef5ebbb None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:09.527999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df7c5f-1e0a-4e0c-bbba-1c238e23d631 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:09.554611 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:09.568304 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d52fbc-485c-473f-8875-586041b396d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:09.569262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d52fbc-485c-473f-8875-586041b396d7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:09.569791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d52fbc-485c-473f-8875-586041b396d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:09.570378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d52fbc-485c-473f-8875-586041b396d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:09.571257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d52fbc-485c-473f-8875-586041b396d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:09.571756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d52fbc-485c-473f-8875-586041b396d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:09.573721 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d52fbc-485c-473f-8875-586041b396d7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:09.592711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 15/31] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:09.593929 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d52fbc-485c-473f-8875-586041b396d7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:09.661835 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92149b06-0117-4cd8-8782-be221ef5ebbb None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:09.706902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e254f4-9b43-4fc5-bb7b-5e685c547ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:09.707792 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e254f4-9b43-4fc5-bb7b-5e685c547ad8 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:09.708123 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e254f4-9b43-4fc5-bb7b-5e685c547ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:09.708403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e254f4-9b43-4fc5-bb7b-5e685c547ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:09.709087 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e254f4-9b43-4fc5-bb7b-5e685c547ad8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:09.710350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d52fbc-485c-473f-8875-586041b396d7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:09.710803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e254f4-9b43-4fc5-bb7b-5e685c547ad8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:09.753772 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713564ea-25ca-438d-b288-003eaede0164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:09.754344 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713564ea-25ca-438d-b288-003eaede0164 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:09.754633 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713564ea-25ca-438d-b288-003eaede0164 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:09.754916 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713564ea-25ca-438d-b288-003eaede0164 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:09.755596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713564ea-25ca-438d-b288-003eaede0164 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:09.755910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713564ea-25ca-438d-b288-003eaede0164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:09.757382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713564ea-25ca-438d-b288-003eaede0164 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:09.766743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 16/32] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:09.767846 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa4801-1e23-4d1b-86e8-0cdae554c8e8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:09.768200 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa4801-1e23-4d1b-86e8-0cdae554c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:09.768489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa4801-1e23-4d1b-86e8-0cdae554c8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:09.788971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-01fa4801-1e23-4d1b-86e8-0cdae554c8e8 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:09.790295 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-01fa4801-1e23-4d1b-86e8-0cdae554c8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:09.834937 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:09.845929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 17/33] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Oct 17 10:11:09 2022] POST /identity/v3/roles => generated 225 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:11:09.853250 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e254f4-9b43-4fc5-bb7b-5e685c547ad8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:09.868099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 17/34] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:09.874595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa4801-1e23-4d1b-86e8-0cdae554c8e8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:09.928635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:09.971149 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e254f4-9b43-4fc5-bb7b-5e685c547ad8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:10.011685 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524de95-4ca2-4b92-b2ef-a98b55ac0d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:10.012682 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524de95-4ca2-4b92-b2ef-a98b55ac0d03 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:10.013162 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524de95-4ca2-4b92-b2ef-a98b55ac0d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:10.013633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524de95-4ca2-4b92-b2ef-a98b55ac0d03 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:10.014537 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524de95-4ca2-4b92-b2ef-a98b55ac0d03 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:10.016595 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524de95-4ca2-4b92-b2ef-a98b55ac0d03 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:10.091698 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa4801-1e23-4d1b-86e8-0cdae554c8e8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:10.096871 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 18/35] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 17 10:11:09 2022] POST /identity/v3/projects => generated 301 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:11:10.150299 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb4deb-813b-4f8d-abe8-31f6758b1be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:10.150979 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb4deb-813b-4f8d-abe8-31f6758b1be7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:10.151262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb4deb-813b-4f8d-abe8-31f6758b1be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:10.151539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb4deb-813b-4f8d-abe8-31f6758b1be7 None admin] PATH_INFO: `/v3/users/b74fb7e0184d4dd9bc4b1b1fd5ed0d2e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:10.153514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb4deb-813b-4f8d-abe8-31f6758b1be7 None admin] RBAC: Authorizing `identity:get_user(user_id=b74fb7e0184d4dd9bc4b1b1fd5ed0d2e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:10.155178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb4deb-813b-4f8d-abe8-31f6758b1be7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:10.157653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 18/36] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:09 2022] GET /identity/v3/users/b74fb7e0184d4dd9bc4b1b1fd5ed0d2e => generated 247 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:10.163625 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524de95-4ca2-4b92-b2ef-a98b55ac0d03 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:10.281195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce355d-c47e-4a1a-b372-b4b45302de15 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:10.281379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce355d-c47e-4a1a-b372-b4b45302de15 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:10.281662 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce355d-c47e-4a1a-b372-b4b45302de15 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:10.283401 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 19/37] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:10.289772 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5e542-97df-4bf6-b69c-bb2abc5db681 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:10.290058 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5e542-97df-4bf6-b69c-bb2abc5db681 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:10.290627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5e542-97df-4bf6-b69c-bb2abc5db681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:10.304115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524de95-4ca2-4b92-b2ef-a98b55ac0d03 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:10.320490 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7ec5e542-97df-4bf6-b69c-bb2abc5db681 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:10.322042 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7ec5e542-97df-4bf6-b69c-bb2abc5db681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:10.326656 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:10.363241 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d44264-4e15-4d71-99ee-44bcaa3091e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:10.363900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d44264-4e15-4d71-99ee-44bcaa3091e3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:10.364229 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d44264-4e15-4d71-99ee-44bcaa3091e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:10.364573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d44264-4e15-4d71-99ee-44bcaa3091e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:10.365629 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d44264-4e15-4d71-99ee-44bcaa3091e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:10.367110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d44264-4e15-4d71-99ee-44bcaa3091e3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:10.368870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:10.368987 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 19/38] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:11:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:10.369607 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d44264-4e15-4d71-99ee-44bcaa3091e3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:10.417230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 20/39] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:11:10.418396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5e542-97df-4bf6-b69c-bb2abc5db681 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:10.493362 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d44264-4e15-4d71-99ee-44bcaa3091e3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:10.534314 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614050e-b462-4e33-b908-ae6552fdfad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:10.534876 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614050e-b462-4e33-b908-ae6552fdfad0 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:10.535157 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614050e-b462-4e33-b908-ae6552fdfad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:10.535431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614050e-b462-4e33-b908-ae6552fdfad0 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:10.536156 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614050e-b462-4e33-b908-ae6552fdfad0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:10.538341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614050e-b462-4e33-b908-ae6552fdfad0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:10.551286 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5e542-97df-4bf6-b69c-bb2abc5db681 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:10.559965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Oct 17 10:11:10 2022] POST /identity/v3/roles => generated 219 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:11:10.559965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266de81d-c0dc-495e-9f1c-8ab49ea40f51 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:10.559965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266de81d-c0dc-495e-9f1c-8ab49ea40f51 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:10.559965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266de81d-c0dc-495e-9f1c-8ab49ea40f51 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:10.559965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 21/41] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:10.564796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef94109-fab9-46a9-9134-bee9a0c1fdcb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:10.565101 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef94109-fab9-46a9-9134-bee9a0c1fdcb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:10.565350 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef94109-fab9-46a9-9134-bee9a0c1fdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:10.589141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6ef94109-fab9-46a9-9134-bee9a0c1fdcb None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:10.590996 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6ef94109-fab9-46a9-9134-bee9a0c1fdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:10.599135 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11080eda-861d-4db5-8b3a-5dbe4731f1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:10.599775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11080eda-861d-4db5-8b3a-5dbe4731f1bc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:10.600088 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11080eda-861d-4db5-8b3a-5dbe4731f1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:10.600360 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11080eda-861d-4db5-8b3a-5dbe4731f1bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:10.601101 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11080eda-861d-4db5-8b3a-5dbe4731f1bc None admin] RBAC: Adding query filter params (role.id=5e3dfffec8aa470fab9232cc439aec74, scope.domain.id=default, user.id=b74fb7e0184d4dd9bc4b1b1fd5ed0d2e) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:10.601409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11080eda-861d-4db5-8b3a-5dbe4731f1bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:10.602963 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11080eda-861d-4db5-8b3a-5dbe4731f1bc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:10.611390 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 21/42] 10.222.0.13 () {56 vars in 1322 bytes} [Mon Oct 17 10:11:10 2022] GET /identity/v3/role_assignments?user.id=b74fb7e0184d4dd9bc4b1b1fd5ed0d2e&scope.domain.id=default&role.id=5e3dfffec8aa470fab9232cc439aec74 => generated 530 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:10.636612 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:10.677613 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 22/43] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:10.709984 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11080eda-861d-4db5-8b3a-5dbe4731f1bc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:10.856754 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:10.927444 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11080eda-861d-4db5-8b3a-5dbe4731f1bc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:10.951648 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef94109-fab9-46a9-9134-bee9a0c1fdcb None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:10.962381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd1a93-a3a6-40a1-93b5-9f98faf8c1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:10.963021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd1a93-a3a6-40a1-93b5-9f98faf8c1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:10.963304 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd1a93-a3a6-40a1-93b5-9f98faf8c1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:10.963583 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd1a93-a3a6-40a1-93b5-9f98faf8c1f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:10.964738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd1a93-a3a6-40a1-93b5-9f98faf8c1f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:10.966185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd1a93-a3a6-40a1-93b5-9f98faf8c1f2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:10.967773 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 22/44] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:11:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:10.973646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd1a93-a3a6-40a1-93b5-9f98faf8c1f2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:11.048851 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef94109-fab9-46a9-9134-bee9a0c1fdcb None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:11.069983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd1a93-a3a6-40a1-93b5-9f98faf8c1f2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:11.072329 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:11.083658 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6e45d-4f93-4d06-aa80-4af8c385ea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:11.084302 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6e45d-4f93-4d06-aa80-4af8c385ea9e None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:11.084587 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6e45d-4f93-4d06-aa80-4af8c385ea9e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:11.084866 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6e45d-4f93-4d06-aa80-4af8c385ea9e None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:11.085548 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6e45d-4f93-4d06-aa80-4af8c385ea9e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:11.086943 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6e45d-4f93-4d06-aa80-4af8c385ea9e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:11.102603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Oct 17 10:11:10 2022] POST /identity/v3/roles => generated 223 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:11:11.106041 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04dae1-254a-438c-87d3-575bafa909d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:11.106666 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04dae1-254a-438c-87d3-575bafa909d7 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:11.106998 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04dae1-254a-438c-87d3-575bafa909d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:11.107222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04dae1-254a-438c-87d3-575bafa909d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:11.107898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04dae1-254a-438c-87d3-575bafa909d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:11.109470 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04dae1-254a-438c-87d3-575bafa909d7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:11.140703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 17 10:11:10 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:11:13.302137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e29a6-06fa-4fc8-a03d-76289c0716db None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:13.302644 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e29a6-06fa-4fc8-a03d-76289c0716db None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:13.302727 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e29a6-06fa-4fc8-a03d-76289c0716db None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:13.304030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 24/47] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:13.309112 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb81ad-993b-4054-b347-e0edaeda28db None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:13.309518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb81ad-993b-4054-b347-e0edaeda28db None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:13.309665 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb81ad-993b-4054-b347-e0edaeda28db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:13.327977 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fecb81ad-993b-4054-b347-e0edaeda28db None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:13.329104 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fecb81ad-993b-4054-b347-e0edaeda28db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:13.392579 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 24/48] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:13.660865 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e29a6-06fa-4fc8-a03d-76289c0716db None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:13.691803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:13.761231 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e29a6-06fa-4fc8-a03d-76289c0716db None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:13.793620 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d0719-b5ba-4b79-a212-21a8fc0e2c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:13.794239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d0719-b5ba-4b79-a212-21a8fc0e2c10 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:13.794521 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d0719-b5ba-4b79-a212-21a8fc0e2c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:13.794802 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d0719-b5ba-4b79-a212-21a8fc0e2c10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:13.795981 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d0719-b5ba-4b79-a212-21a8fc0e2c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:13.797425 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d0719-b5ba-4b79-a212-21a8fc0e2c10 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:13.798959 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 25/49] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:11:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:13.804671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb81ad-993b-4054-b347-e0edaeda28db None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:13.884612 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:13.900534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb81ad-993b-4054-b347-e0edaeda28db None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:13.933240 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffc568-cccd-4036-989b-20a0cc596976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:13.933785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffc568-cccd-4036-989b-20a0cc596976 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:13.934068 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffc568-cccd-4036-989b-20a0cc596976 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:13.934350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffc568-cccd-4036-989b-20a0cc596976 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:13.934999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffc568-cccd-4036-989b-20a0cc596976 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:13.937061 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffc568-cccd-4036-989b-20a0cc596976 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:13.961255 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1140 bytes} [Mon Oct 17 10:11:13 2022] POST /identity/v3/projects => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:11:16.100648 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae71c5f-5d57-45ed-b5cb-bbc7d3a42a50 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:16.101088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae71c5f-5d57-45ed-b5cb-bbc7d3a42a50 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:16.101207 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae71c5f-5d57-45ed-b5cb-bbc7d3a42a50 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:16.102554 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 26/51] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:16.107877 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98fee2-c60e-4f7a-be6e-0fe124b0b3d8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:16.108330 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98fee2-c60e-4f7a-be6e-0fe124b0b3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:16.108457 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98fee2-c60e-4f7a-be6e-0fe124b0b3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:16.126646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8f98fee2-c60e-4f7a-be6e-0fe124b0b3d8 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:16.127831 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8f98fee2-c60e-4f7a-be6e-0fe124b0b3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:16.191461 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 26/52] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:16.455717 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae71c5f-5d57-45ed-b5cb-bbc7d3a42a50 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:16.549406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:16.553917 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae71c5f-5d57-45ed-b5cb-bbc7d3a42a50 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:16.586725 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69efe0-0086-4ba0-827a-50be016a5e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:16.587338 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69efe0-0086-4ba0-827a-50be016a5e7f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:16.587620 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69efe0-0086-4ba0-827a-50be016a5e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:16.587895 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69efe0-0086-4ba0-827a-50be016a5e7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:16.589027 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69efe0-0086-4ba0-827a-50be016a5e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:16.590469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69efe0-0086-4ba0-827a-50be016a5e7f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:16.592024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:11:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:16.597954 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98fee2-c60e-4f7a-be6e-0fe124b0b3d8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:16.661710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:16.695669 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98fee2-c60e-4f7a-be6e-0fe124b0b3d8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:16.728373 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac413f-964c-411a-aa39-c459ea755934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:16.728921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac413f-964c-411a-aa39-c459ea755934 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:16.729202 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac413f-964c-411a-aa39-c459ea755934 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:16.729476 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac413f-964c-411a-aa39-c459ea755934 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:16.730376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac413f-964c-411a-aa39-c459ea755934 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:16.731838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac413f-964c-411a-aa39-c459ea755934 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:16.757807 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 27/54] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:11:16 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:11:19.902188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd3f63-b79e-47d8-8713-ab9146d3cab1 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:19.903233 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd3f63-b79e-47d8-8713-ab9146d3cab1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:19.903717 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd3f63-b79e-47d8-8713-ab9146d3cab1 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:19.905338 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 28/55] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:19.910949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0996702-4b0c-4188-95f8-4d625ce88cdc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:19.911335 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0996702-4b0c-4188-95f8-4d625ce88cdc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:19.911568 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0996702-4b0c-4188-95f8-4d625ce88cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:19.937024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b0996702-4b0c-4188-95f8-4d625ce88cdc None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:19.938234 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b0996702-4b0c-4188-95f8-4d625ce88cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:20.011752 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 28/56] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:11:20.192370 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4eb0f-a932-4065-b667-847a609fd1d7 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:20.192993 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4eb0f-a932-4065-b667-847a609fd1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:20.193484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4eb0f-a932-4065-b667-847a609fd1d7 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:20.195097 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 29/57] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:20.200833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc821e2-ff5e-4594-897f-c0345b6749ad None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:20.201124 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc821e2-ff5e-4594-897f-c0345b6749ad None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:20.201405 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc821e2-ff5e-4594-897f-c0345b6749ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:20.224762 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7fc821e2-ff5e-4594-897f-c0345b6749ad None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:20.225955 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7fc821e2-ff5e-4594-897f-c0345b6749ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:20.287512 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:20.310603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 29/58] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:20.337180 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4eb0f-a932-4065-b667-847a609fd1d7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:20.337857 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5527c-3b2f-44eb-9d57-5e1407645886 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:20.338155 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5527c-3b2f-44eb-9d57-5e1407645886 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:20.338432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5527c-3b2f-44eb-9d57-5e1407645886 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:20.339910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 30/59] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:20.353355 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd830d-f353-471d-8b43-2bf61f50c4c8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:20.353645 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd830d-f353-471d-8b43-2bf61f50c4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:20.353923 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd830d-f353-471d-8b43-2bf61f50c4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:20.380908 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0cfd830d-f353-471d-8b43-2bf61f50c4c8 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:20.382107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0cfd830d-f353-471d-8b43-2bf61f50c4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:20.529239 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 31/60] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:20.595989 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01dcd8-2846-497b-bd3a-12005c6868f7 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:20.596625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01dcd8-2846-497b-bd3a-12005c6868f7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:20.597072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01dcd8-2846-497b-bd3a-12005c6868f7 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:20.598700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 32/61] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:11:20.602496 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4eb0f-a932-4065-b667-847a609fd1d7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:20.604052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281324e9-dd64-4f6b-8906-eb561bd88aca None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:20.604567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281324e9-dd64-4f6b-8906-eb561bd88aca None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:20.605292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281324e9-dd64-4f6b-8906-eb561bd88aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:20.634357 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-281324e9-dd64-4f6b-8906-eb561bd88aca None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:20.637912 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-281324e9-dd64-4f6b-8906-eb561bd88aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:20.664419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad8574-d72d-48b8-8a73-349922cbae72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:20.665057 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad8574-d72d-48b8-8a73-349922cbae72 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:20.665341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad8574-d72d-48b8-8a73-349922cbae72 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:20.665618 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad8574-d72d-48b8-8a73-349922cbae72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:20.678900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad8574-d72d-48b8-8a73-349922cbae72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:20.685116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-aaad8574-d72d-48b8-8a73-349922cbae72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:11:20.685116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:20.685116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:20.685116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:20.685116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:20.685116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:20.685116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:20.685116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:20.685116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:20.685116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:20.685116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:20.685116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:20.685116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:20.685116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:20.685116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:20.685116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:20.685933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:20.685933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:20.685933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:20.685933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:20.685933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:20.685933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:20.685933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:20.685933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:20.685933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:20.685933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:20.685933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:20.685933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:20.685933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:20.685933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:20.685933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:20.685933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:20.687251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:20.687251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:20.687251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:20.687251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:20.687251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:20.687251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:20.687251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:20.687251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:20.687251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:20.687251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:20.687251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:11:20.687251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:20.687251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 30/62] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 17 10:11:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:20.688830 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad8574-d72d-48b8-8a73-349922cbae72 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:20.727820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 33/63] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:11:20.727820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281324e9-dd64-4f6b-8906-eb561bd88aca None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:20.729265 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:20.775859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:20.817991 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad8574-d72d-48b8-8a73-349922cbae72 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:20.844807 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281324e9-dd64-4f6b-8906-eb561bd88aca None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:20.853470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb05ccf-bc2f-443c-a33e-ee7fc7b474e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:20.854101 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb05ccf-bc2f-443c-a33e-ee7fc7b474e5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:20.854379 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb05ccf-bc2f-443c-a33e-ee7fc7b474e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:20.854654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb05ccf-bc2f-443c-a33e-ee7fc7b474e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:20.865786 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb05ccf-bc2f-443c-a33e-ee7fc7b474e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:20.870616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-feb05ccf-bc2f-443c-a33e-ee7fc7b474e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:20.870616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:20.870616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:20.870616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:20.870616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:20.870616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:20.870616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:20.870616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:20.870616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:20.870616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:20.870616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:20.870616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:20.870616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:20.870616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:20.870616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:20.870616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:20.871419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:20.871419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:20.871419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:20.871419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:20.871419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:20.871419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:20.871419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:20.871419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:20.871419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:20.871419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:20.871419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:20.871419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:20.871419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:20.871419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:20.871419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:20.871419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:20.872204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:20.872204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:20.872204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:20.872204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:20.872204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:20.872204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:20.872204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:20.872204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:20.872204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:20.872204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:20.872204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:20.872204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:20.872204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 31/64] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:20.872890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567520e-b6ca-466b-9449-03764ca43d66 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:20.873559 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567520e-b6ca-466b-9449-03764ca43d66 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:20.873559 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567520e-b6ca-466b-9449-03764ca43d66 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:20.875804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 32/65] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:20.880459 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567520e-b6ca-466b-9449-03764ca43d66 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:20.890635 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724edfa8-edc8-45f0-8420-54b3a0d4c029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:20.891257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724edfa8-edc8-45f0-8420-54b3a0d4c029 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:20.891541 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724edfa8-edc8-45f0-8420-54b3a0d4c029 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:20.891811 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724edfa8-edc8-45f0-8420-54b3a0d4c029 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:20.892554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724edfa8-edc8-45f0-8420-54b3a0d4c029 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:20.892855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724edfa8-edc8-45f0-8420-54b3a0d4c029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:20.894244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724edfa8-edc8-45f0-8420-54b3a0d4c029 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:20.906690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 34/66] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:11:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:20.906690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724edfa8-edc8-45f0-8420-54b3a0d4c029 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:20.977504 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:20.994807 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567520e-b6ca-466b-9449-03764ca43d66 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:21.009481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724edfa8-edc8-45f0-8420-54b3a0d4c029 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:21.016599 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:21.029232 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc560e8-f9c8-47ab-a83d-57ab173b533d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:21.029859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc560e8-f9c8-47ab-a83d-57ab173b533d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:21.030647 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc560e8-f9c8-47ab-a83d-57ab173b533d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:21.030909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc560e8-f9c8-47ab-a83d-57ab173b533d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:21.040730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc560e8-f9c8-47ab-a83d-57ab173b533d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:21.043311 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f84df-1e78-4fa6-8429-04318559ea3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:21.043920 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f84df-1e78-4fa6-8429-04318559ea3f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:21.044234 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f84df-1e78-4fa6-8429-04318559ea3f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:21.044510 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f84df-1e78-4fa6-8429-04318559ea3f None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:21.045176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f84df-1e78-4fa6-8429-04318559ea3f None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:21.045481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f84df-1e78-4fa6-8429-04318559ea3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:21.045628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-bcc560e8-f9c8-47ab-a83d-57ab173b533d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:11:21.045628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:21.045628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:21.045628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:21.045628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:21.045628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:21.045628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:21.045628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:21.045628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:21.045628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:21.045628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:21.045628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:21.045628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:21.045628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:21.045628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:21.045628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:21.046911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:21.046911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:21.046911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:21.046911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:21.046911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:21.046911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:21.046911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:21.046911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:21.046911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:21.046911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:21.046911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:21.046911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:21.046911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:21.046911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:21.046911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:21.046911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:21.047649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:21.047649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:21.047649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:21.047649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:21.047649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:21.047649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:21.047649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:21.047649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:21.047649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:21.047649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:21.047649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:11:21.047649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:21.047649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 33/67] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:11:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:21.048305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f84df-1e78-4fa6-8429-04318559ea3f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:21.049277 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd12d9-f009-4b38-9d08-b9d6f8c0573f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:21.049582 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd12d9-f009-4b38-9d08-b9d6f8c0573f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:21.049873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd12d9-f009-4b38-9d08-b9d6f8c0573f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:21.060681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 35/68] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:21.060941 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f84df-1e78-4fa6-8429-04318559ea3f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:21.068558 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a6bd12d9-f009-4b38-9d08-b9d6f8c0573f None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:21.069687 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a6bd12d9-f009-4b38-9d08-b9d6f8c0573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:21.136312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 34/69] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:21.142106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd12d9-f009-4b38-9d08-b9d6f8c0573f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:21.165077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f84df-1e78-4fa6-8429-04318559ea3f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:21.198688 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87352034-ccaa-4317-8c31-894aeb71a879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:21.199324 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87352034-ccaa-4317-8c31-894aeb71a879 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:21.199610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87352034-ccaa-4317-8c31-894aeb71a879 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:21.199887 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87352034-ccaa-4317-8c31-894aeb71a879 None admin] PATH_INFO: `/v3/users/126c4d02c86f4cc09f24869db284cd76` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:21.213442 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87352034-ccaa-4317-8c31-894aeb71a879 None admin] RBAC: Authorizing `identity:get_user(user_id=126c4d02c86f4cc09f24869db284cd76)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:21.214907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87352034-ccaa-4317-8c31-894aeb71a879 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:21.216560 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 36/70] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:21 2022] GET /identity/v3/users/126c4d02c86f4cc09f24869db284cd76 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:21.219800 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:21.222603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87352034-ccaa-4317-8c31-894aeb71a879 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:21.244205 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd12d9-f009-4b38-9d08-b9d6f8c0573f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:21.251334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:21.278523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b2214-37b8-49c6-b0dd-03aaf26d721f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:21.279260 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b2214-37b8-49c6-b0dd-03aaf26d721f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:21.279536 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b2214-37b8-49c6-b0dd-03aaf26d721f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:21.279809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b2214-37b8-49c6-b0dd-03aaf26d721f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:21.291581 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b2214-37b8-49c6-b0dd-03aaf26d721f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:21.296826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-6b3b2214-37b8-49c6-b0dd-03aaf26d721f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:21.296826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:21.296826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:21.296826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:21.296826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:21.296826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:21.296826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:21.296826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:21.296826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:21.296826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:21.296826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:21.296826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:21.296826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:21.296826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:21.296826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:21.296826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:21.297661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:21.297661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:21.297661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:21.297661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:21.297661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:21.297661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:21.297661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:21.297661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:21.297661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:21.297661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:21.297661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:21.297661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:21.297661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:21.297661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:21.297661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:21.297661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:21.298803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:21.298803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:21.298803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:21.298803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:21.298803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:21.298803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:21.298803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:21.298803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:21.298803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:21.298803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:21.298803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:21.298803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:21.298803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:21.303315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b2214-37b8-49c6-b0dd-03aaf26d721f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:21.324889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87352034-ccaa-4317-8c31-894aeb71a879 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:21.360852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759dcec-7a83-471a-b69d-cee84323ae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:21.361463 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759dcec-7a83-471a-b69d-cee84323ae61 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:21.361742 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759dcec-7a83-471a-b69d-cee84323ae61 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:21.362019 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759dcec-7a83-471a-b69d-cee84323ae61 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:21.362682 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759dcec-7a83-471a-b69d-cee84323ae61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:21.362982 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759dcec-7a83-471a-b69d-cee84323ae61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:21.364388 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759dcec-7a83-471a-b69d-cee84323ae61 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:21.372276 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 37/72] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:21.372999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759dcec-7a83-471a-b69d-cee84323ae61 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:21.412559 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b2214-37b8-49c6-b0dd-03aaf26d721f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:21.446092 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c206ce3-0ff3-4d3c-8fbf-ba633756ac84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:21.446712 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c206ce3-0ff3-4d3c-8fbf-ba633756ac84 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:21.446993 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c206ce3-0ff3-4d3c-8fbf-ba633756ac84 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:21.447265 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c206ce3-0ff3-4d3c-8fbf-ba633756ac84 None admin] PATH_INFO: `/v3/users/126c4d02c86f4cc09f24869db284cd76` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:21.448655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c206ce3-0ff3-4d3c-8fbf-ba633756ac84 None admin] RBAC: Authorizing `identity:get_user(user_id=126c4d02c86f4cc09f24869db284cd76)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:21.450100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c206ce3-0ff3-4d3c-8fbf-ba633756ac84 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:21.451703 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:21 2022] GET /identity/v3/users/126c4d02c86f4cc09f24869db284cd76 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:21.452985 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c206ce3-0ff3-4d3c-8fbf-ba633756ac84 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:21.456192 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:21.462078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:21.474793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759dcec-7a83-471a-b69d-cee84323ae61 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:21.508366 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7780a-63ba-4f4d-adf5-f7e81b6b3004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:21.508998 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7780a-63ba-4f4d-adf5-f7e81b6b3004 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:21.509279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7780a-63ba-4f4d-adf5-f7e81b6b3004 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:21.509554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7780a-63ba-4f4d-adf5-f7e81b6b3004 None admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:21.510678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7780a-63ba-4f4d-adf5-f7e81b6b3004 None admin] RBAC: Authorizing `identity:get_project(project_id=423d65bc866249f28b368e7ba3b45250)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:21.512185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7780a-63ba-4f4d-adf5-f7e81b6b3004 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:21.513899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 38/74] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:21 2022] GET /identity/v3/projects/423d65bc866249f28b368e7ba3b45250 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:21.514680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7780a-63ba-4f4d-adf5-f7e81b6b3004 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:21.559103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c206ce3-0ff3-4d3c-8fbf-ba633756ac84 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:21.592057 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dceb165-2054-41eb-b073-76866cd80628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:21.593143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceb165-2054-41eb-b073-76866cd80628 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:21.593423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceb165-2054-41eb-b073-76866cd80628 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:21.593690 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceb165-2054-41eb-b073-76866cd80628 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:21.594348 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dceb165-2054-41eb-b073-76866cd80628 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:21.594650 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dceb165-2054-41eb-b073-76866cd80628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:21.596052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dceb165-2054-41eb-b073-76866cd80628 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:21.608146 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:21.609168 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dceb165-2054-41eb-b073-76866cd80628 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:21.614513 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7780a-63ba-4f4d-adf5-f7e81b6b3004 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:21.647670 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebea24-5002-4402-b727-585e9ee3f3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:21.648315 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebea24-5002-4402-b727-585e9ee3f3c0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:21.648598 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebea24-5002-4402-b727-585e9ee3f3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:21.648871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebea24-5002-4402-b727-585e9ee3f3c0 None admin] PATH_INFO: `/v3/users/b74fb7e0184d4dd9bc4b1b1fd5ed0d2e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:21.649988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebea24-5002-4402-b727-585e9ee3f3c0 None admin] RBAC: Authorizing `identity:get_user(user_id=b74fb7e0184d4dd9bc4b1b1fd5ed0d2e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:21.651440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebea24-5002-4402-b727-585e9ee3f3c0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:21.653038 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 39/76] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:21 2022] GET /identity/v3/users/b74fb7e0184d4dd9bc4b1b1fd5ed0d2e => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:21.653797 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebea24-5002-4402-b727-585e9ee3f3c0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:21.673187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:21.679077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:21.708460 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dceb165-2054-41eb-b073-76866cd80628 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:21.742625 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc9cd2-f9f0-44b4-b94a-86506931d279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:21.743258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc9cd2-f9f0-44b4-b94a-86506931d279 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:21.743543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc9cd2-f9f0-44b4-b94a-86506931d279 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:21.743816 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc9cd2-f9f0-44b4-b94a-86506931d279 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:21.744970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc9cd2-f9f0-44b4-b94a-86506931d279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:21.746416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc9cd2-f9f0-44b4-b94a-86506931d279 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:21.747992 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 38/77] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:11:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:21.752757 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebea24-5002-4402-b727-585e9ee3f3c0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:21.752869 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc9cd2-f9f0-44b4-b94a-86506931d279 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:21.786594 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e3162-6d7a-4f48-90e9-83406146c69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:21.787231 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e3162-6d7a-4f48-90e9-83406146c69d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:21.787512 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e3162-6d7a-4f48-90e9-83406146c69d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:21.787787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e3162-6d7a-4f48-90e9-83406146c69d None admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:21.788970 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e3162-6d7a-4f48-90e9-83406146c69d None admin] RBAC: Authorizing `identity:get_project(project_id=423d65bc866249f28b368e7ba3b45250)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:21.790426 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e3162-6d7a-4f48-90e9-83406146c69d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:21.792087 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 40/78] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:21 2022] GET /identity/v3/projects/423d65bc866249f28b368e7ba3b45250 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:21.792851 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e3162-6d7a-4f48-90e9-83406146c69d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:21.852645 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc9cd2-f9f0-44b4-b94a-86506931d279 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:21.880221 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:21.885721 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850ef70-b79a-41c1-8278-ac0672ca886e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:21.886381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850ef70-b79a-41c1-8278-ac0672ca886e None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:21.886666 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850ef70-b79a-41c1-8278-ac0672ca886e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:21.886943 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850ef70-b79a-41c1-8278-ac0672ca886e None admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250/users/126c4d02c86f4cc09f24869db284cd76/roles/b76852b6c05a46a9b493c465fd3441a3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:21.889088 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e3162-6d7a-4f48-90e9-83406146c69d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:21.889205 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850ef70-b79a-41c1-8278-ac0672ca886e None admin] RBAC: Authorizing `identity:create_grant(project_id=423d65bc866249f28b368e7ba3b45250, user_id=126c4d02c86f4cc09f24869db284cd76, role_id=b76852b6c05a46a9b493c465fd3441a3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:21.891134 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850ef70-b79a-41c1-8278-ac0672ca886e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:21.894597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:21.908116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 39/79] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:11:21 2022] PUT /identity/v3/projects/423d65bc866249f28b368e7ba3b45250/users/126c4d02c86f4cc09f24869db284cd76/roles/b76852b6c05a46a9b493c465fd3441a3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:11:21.908964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850ef70-b79a-41c1-8278-ac0672ca886e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:21.935706 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331caa6-490f-4f1c-bacb-52daf4e1869e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:21.936928 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331caa6-490f-4f1c-bacb-52daf4e1869e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:21.937219 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331caa6-490f-4f1c-bacb-52daf4e1869e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:21.937796 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331caa6-490f-4f1c-bacb-52daf4e1869e None admin] PATH_INFO: `/v3/users/126c4d02c86f4cc09f24869db284cd76` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:21.939102 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331caa6-490f-4f1c-bacb-52daf4e1869e None admin] RBAC: Authorizing `identity:get_user(user_id=126c4d02c86f4cc09f24869db284cd76)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:21.940930 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331caa6-490f-4f1c-bacb-52daf4e1869e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:21.942657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 41/80] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:21 2022] GET /identity/v3/users/126c4d02c86f4cc09f24869db284cd76 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:21.943435 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331caa6-490f-4f1c-bacb-52daf4e1869e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:22.025112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850ef70-b79a-41c1-8278-ac0672ca886e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:22.055687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331caa6-490f-4f1c-bacb-52daf4e1869e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:22.072379 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b11daa-29f7-4b64-be1f-58891661c577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:22.073040 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b11daa-29f7-4b64-be1f-58891661c577 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:22.073328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b11daa-29f7-4b64-be1f-58891661c577 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:22.073634 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b11daa-29f7-4b64-be1f-58891661c577 None admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:22.074843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b11daa-29f7-4b64-be1f-58891661c577 None admin] RBAC: Authorizing `identity:get_project(project_id=423d65bc866249f28b368e7ba3b45250)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:22.076353 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b11daa-29f7-4b64-be1f-58891661c577 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:22.078075 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 40/81] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:21 2022] GET /identity/v3/projects/423d65bc866249f28b368e7ba3b45250 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:22.078830 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b11daa-29f7-4b64-be1f-58891661c577 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:22.101084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a4d8d-2b42-4edd-9098-ca7742b73921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:22.101721 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a4d8d-2b42-4edd-9098-ca7742b73921 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:22.102006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a4d8d-2b42-4edd-9098-ca7742b73921 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:22.102285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a4d8d-2b42-4edd-9098-ca7742b73921 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:22.104034 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a4d8d-2b42-4edd-9098-ca7742b73921 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:22.104446 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a4d8d-2b42-4edd-9098-ca7742b73921 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:22.135962 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 42/82] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:11:21 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:11:22.135962 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a4d8d-2b42-4edd-9098-ca7742b73921 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:22.162133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:22.163513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:22.222877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b11daa-29f7-4b64-be1f-58891661c577 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:22.261972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd448b8-6216-4ccd-affd-d79395a38f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:22.262774 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd448b8-6216-4ccd-affd-d79395a38f65 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:22.263128 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd448b8-6216-4ccd-affd-d79395a38f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:22.263480 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd448b8-6216-4ccd-affd-d79395a38f65 None admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250/users/126c4d02c86f4cc09f24869db284cd76/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:22.266274 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd448b8-6216-4ccd-affd-d79395a38f65 None admin] RBAC: Authorizing `identity:create_grant(project_id=423d65bc866249f28b368e7ba3b45250, user_id=126c4d02c86f4cc09f24869db284cd76, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:22.268163 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd448b8-6216-4ccd-affd-d79395a38f65 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:22.286241 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 41/83] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:11:22 2022] PUT /identity/v3/projects/423d65bc866249f28b368e7ba3b45250/users/126c4d02c86f4cc09f24869db284cd76/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:11:22.288871 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd448b8-6216-4ccd-affd-d79395a38f65 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:22.316373 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a4d8d-2b42-4edd-9098-ca7742b73921 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:22.366023 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6569d0c-5b19-4fa6-8b87-a4e1da39f6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:22.366622 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6569d0c-5b19-4fa6-8b87-a4e1da39f6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:22.366903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6569d0c-5b19-4fa6-8b87-a4e1da39f6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:22.367239 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6569d0c-5b19-4fa6-8b87-a4e1da39f6e9 None admin] PATH_INFO: `/v3/projects/ca53f4119726409db9ca11fa234f4ace` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:22.368516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6569d0c-5b19-4fa6-8b87-a4e1da39f6e9 None admin] RBAC: Authorizing `identity:get_project(project_id=ca53f4119726409db9ca11fa234f4ace)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:22.372905 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6569d0c-5b19-4fa6-8b87-a4e1da39f6e9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:22.381009 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 43/84] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:22 2022] GET /identity/v3/projects/ca53f4119726409db9ca11fa234f4ace => generated 312 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:22.387400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6569d0c-5b19-4fa6-8b87-a4e1da39f6e9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:22.457651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd448b8-6216-4ccd-affd-d79395a38f65 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:22.487000 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:22.506488 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd55da-52c2-4dc4-afed-3cb9eb59653e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:22.508458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd55da-52c2-4dc4-afed-3cb9eb59653e None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:22.508969 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd55da-52c2-4dc4-afed-3cb9eb59653e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:22.509445 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd55da-52c2-4dc4-afed-3cb9eb59653e None admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250/users/b74fb7e0184d4dd9bc4b1b1fd5ed0d2e/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:22.513243 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd55da-52c2-4dc4-afed-3cb9eb59653e None admin] RBAC: Authorizing `identity:create_grant(project_id=423d65bc866249f28b368e7ba3b45250, user_id=b74fb7e0184d4dd9bc4b1b1fd5ed0d2e, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:22.515159 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd55da-52c2-4dc4-afed-3cb9eb59653e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:22.528827 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:22.541566 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 42/85] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:11:22 2022] PUT /identity/v3/projects/423d65bc866249f28b368e7ba3b45250/users/b74fb7e0184d4dd9bc4b1b1fd5ed0d2e/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:11:22.553334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6569d0c-5b19-4fa6-8b87-a4e1da39f6e9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:22.607494 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19408760-51cf-4e9a-b67f-91b116d38c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:22.608330 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19408760-51cf-4e9a-b67f-91b116d38c9b None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:22.608664 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19408760-51cf-4e9a-b67f-91b116d38c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:22.608945 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19408760-51cf-4e9a-b67f-91b116d38c9b None admin] PATH_INFO: `/v3/projects/ca53f4119726409db9ca11fa234f4ace/users/126c4d02c86f4cc09f24869db284cd76/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:22.611114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19408760-51cf-4e9a-b67f-91b116d38c9b None admin] RBAC: Authorizing `identity:create_grant(project_id=ca53f4119726409db9ca11fa234f4ace, user_id=126c4d02c86f4cc09f24869db284cd76, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:22.612759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19408760-51cf-4e9a-b67f-91b116d38c9b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:22.628877 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 44/86] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:11:22 2022] PUT /identity/v3/projects/ca53f4119726409db9ca11fa234f4ace/users/126c4d02c86f4cc09f24869db284cd76/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:11:24.733962 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de1ca0-458a-44fa-8f78-6935a64e7dbb None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:24.734475 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de1ca0-458a-44fa-8f78-6935a64e7dbb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:24.734547 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de1ca0-458a-44fa-8f78-6935a64e7dbb None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:24.736047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 43/87] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:24.741446 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32611138-a870-44cb-b4f4-4912a2648d41 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:24.741839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32611138-a870-44cb-b4f4-4912a2648d41 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:24.742018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32611138-a870-44cb-b4f4-4912a2648d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:24.763021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-32611138-a870-44cb-b4f4-4912a2648d41 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:24.764420 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-32611138-a870-44cb-b4f4-4912a2648d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:24.845052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 45/88] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:25.206595 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2973d5-8a9f-44f2-bf25-ea0913cb495a None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:25.206951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2973d5-8a9f-44f2-bf25-ea0913cb495a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:25.207164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2973d5-8a9f-44f2-bf25-ea0913cb495a None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:25.208803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 44/89] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:25.214217 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5856ca8-27ff-4460-9107-9909a365afb8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:25.214518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5856ca8-27ff-4460-9107-9909a365afb8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:25.214798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5856ca8-27ff-4460-9107-9909a365afb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:25.245056 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b5856ca8-27ff-4460-9107-9909a365afb8 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:25.246285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b5856ca8-27ff-4460-9107-9909a365afb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:25.326054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 46/90] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:25.397489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2973d5-8a9f-44f2-bf25-ea0913cb495a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:25.534232 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2973d5-8a9f-44f2-bf25-ea0913cb495a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:25.577180 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56350fc5-bf6b-4d39-93f1-2bfb578389b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:25.577804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56350fc5-bf6b-4d39-93f1-2bfb578389b5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:25.578096 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56350fc5-bf6b-4d39-93f1-2bfb578389b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:25.578376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56350fc5-bf6b-4d39-93f1-2bfb578389b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:25.594338 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56350fc5-bf6b-4d39-93f1-2bfb578389b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:25.599393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-56350fc5-bf6b-4d39-93f1-2bfb578389b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:11:25.599393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:25.599393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:25.599393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:25.599393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:25.599393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:25.599393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:25.599393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:25.599393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:25.599393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:25.599393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:25.599393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:25.599393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:25.599393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:25.599393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:25.599393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:25.600263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:25.600263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:25.600263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:25.600263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:25.600263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:25.600263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:25.600263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:25.600263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:25.600263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:25.600263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:25.600263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:25.600263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:25.600263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:25.600263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:25.600263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:25.600263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:25.601028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:25.601028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:25.601028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:25.601028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:25.601028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:25.601028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:25.601028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:25.601028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:25.601028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:25.601028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:25.601028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:11:25.601028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:25.601028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 45/91] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 17 10:11:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:25.606807 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5856ca8-27ff-4460-9107-9909a365afb8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:25.610688 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:25.673111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56350fc5-bf6b-4d39-93f1-2bfb578389b5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:25.754443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5856ca8-27ff-4460-9107-9909a365afb8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:25.772307 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:25.825274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e72194-a160-4ce2-b4f9-bee4b9126574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:25.825906 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e72194-a160-4ce2-b4f9-bee4b9126574 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:25.826191 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e72194-a160-4ce2-b4f9-bee4b9126574 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:25.826471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e72194-a160-4ce2-b4f9-bee4b9126574 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:25.827292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e72194-a160-4ce2-b4f9-bee4b9126574 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:25.827530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e72194-a160-4ce2-b4f9-bee4b9126574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:25.829613 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e72194-a160-4ce2-b4f9-bee4b9126574 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:25.846893 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 47/92] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:11:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:25.848190 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a8101-64db-40ec-85c8-7a38b96bf16b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:25.848481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a8101-64db-40ec-85c8-7a38b96bf16b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:25.848759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a8101-64db-40ec-85c8-7a38b96bf16b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:25.853876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 48/93] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:25.854646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a8101-64db-40ec-85c8-7a38b96bf16b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:25.906272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56350fc5-bf6b-4d39-93f1-2bfb578389b5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:25.945770 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e8044-b394-46d5-9c3d-baad97db2b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:25.946403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e8044-b394-46d5-9c3d-baad97db2b2e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:25.946684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e8044-b394-46d5-9c3d-baad97db2b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:25.946958 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e8044-b394-46d5-9c3d-baad97db2b2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:25.958693 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e8044-b394-46d5-9c3d-baad97db2b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:25.963794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a20e8044-b394-46d5-9c3d-baad97db2b2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:25.963794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:25.963794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:25.963794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:25.963794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:25.963794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:25.963794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:25.963794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:25.963794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:25.963794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:25.963794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:25.963794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:25.963794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:25.963794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:25.963794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:25.963794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:25.964646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:25.964646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:25.964646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:25.964646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:25.964646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:25.964646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:25.964646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:25.964646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:25.964646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:25.964646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:25.964646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:25.964646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:25.964646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:25.964646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:25.964646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:25.964646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:25.965424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:25.965424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:25.965424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:25.965424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:25.965424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:25.965424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:25.965424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:25.965424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:25.965424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:25.965424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:25.965424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:25.965424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:25.965424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 46/94] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:25.966166 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079f33-ada6-4e5d-a066-1b13c36328d0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:25.966391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079f33-ada6-4e5d-a066-1b13c36328d0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:25.967352 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079f33-ada6-4e5d-a066-1b13c36328d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:25.971370 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:25.989106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5c079f33-ada6-4e5d-a066-1b13c36328d0 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:25.990367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5c079f33-ada6-4e5d-a066-1b13c36328d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:26.014969 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a8101-64db-40ec-85c8-7a38b96bf16b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:26.051075 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c30c2-376e-4dca-b186-345c92fe353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:26.051828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c30c2-376e-4dca-b186-345c92fe353d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:26.052171 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c30c2-376e-4dca-b186-345c92fe353d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:26.052533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c30c2-376e-4dca-b186-345c92fe353d None admin] PATH_INFO: `/v3/users/126c4d02c86f4cc09f24869db284cd76` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:26.053685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c30c2-376e-4dca-b186-345c92fe353d None admin] RBAC: Authorizing `identity:get_user(user_id=126c4d02c86f4cc09f24869db284cd76)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:26.055384 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c30c2-376e-4dca-b186-345c92fe353d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:26.061469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 49/95] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:25 2022] GET /identity/v3/users/126c4d02c86f4cc09f24869db284cd76 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:26.061469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a16b99-1bd3-4f48-9a4a-3454cb3ae559 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:26.061469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a16b99-1bd3-4f48-9a4a-3454cb3ae559 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:26.061469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a16b99-1bd3-4f48-9a4a-3454cb3ae559 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:26.061469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 50/96] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:26.061469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a16b99-1bd3-4f48-9a4a-3454cb3ae559 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:26.070430 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 47/97] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:26.071915 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62434e5a-92ae-4bcb-a7dd-30860f845c30 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:26.072378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62434e5a-92ae-4bcb-a7dd-30860f845c30 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:26.072817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62434e5a-92ae-4bcb-a7dd-30860f845c30 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:26.074216 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 48/98] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:26.075081 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62434e5a-92ae-4bcb-a7dd-30860f845c30 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:26.115831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:26.197044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62434e5a-92ae-4bcb-a7dd-30860f845c30 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:26.213735 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a16b99-1bd3-4f48-9a4a-3454cb3ae559 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:26.244466 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca29840-551d-47f2-b5f1-6b29ce3090fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:26.245133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca29840-551d-47f2-b5f1-6b29ce3090fe None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:26.245422 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca29840-551d-47f2-b5f1-6b29ce3090fe None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:26.245705 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca29840-551d-47f2-b5f1-6b29ce3090fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:26.267449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b45d70-6058-42a7-94f7-dc99c4f6813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:26.268819 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b45d70-6058-42a7-94f7-dc99c4f6813c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:26.269287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b45d70-6058-42a7-94f7-dc99c4f6813c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:26.269742 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b45d70-6058-42a7-94f7-dc99c4f6813c None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:26.271208 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b45d70-6058-42a7-94f7-dc99c4f6813c None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:26.271728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b45d70-6058-42a7-94f7-dc99c4f6813c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:26.274040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b45d70-6058-42a7-94f7-dc99c4f6813c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:26.276316 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:26.289383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 51/99] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:26.294452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3baff6-2e34-47c2-8ed6-f25bdd227295 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:26.294452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3baff6-2e34-47c2-8ed6-f25bdd227295 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:26.294452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3baff6-2e34-47c2-8ed6-f25bdd227295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:26.312194 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cf3baff6-2e34-47c2-8ed6-f25bdd227295 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:26.313597 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cf3baff6-2e34-47c2-8ed6-f25bdd227295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:26.328179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca29840-551d-47f2-b5f1-6b29ce3090fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:26.330106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca29840-551d-47f2-b5f1-6b29ce3090fe None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:26.365621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:26.386177 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 52/100] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:26.387563 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259c190-b2e1-4466-9f6d-b93c3491c7be None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:26.387857 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259c190-b2e1-4466-9f6d-b93c3491c7be None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:26.388171 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259c190-b2e1-4466-9f6d-b93c3491c7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:26.405580 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d259c190-b2e1-4466-9f6d-b93c3491c7be None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:26.406774 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d259c190-b2e1-4466-9f6d-b93c3491c7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:26.449365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 49/101] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:11:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:11:26.455335 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca29840-551d-47f2-b5f1-6b29ce3090fe None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:26.474495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 53/102] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:26.475745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56a43c-e9db-45a0-854d-e0f55c076990 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:26.476064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56a43c-e9db-45a0-854d-e0f55c076990 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:26.476343 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56a43c-e9db-45a0-854d-e0f55c076990 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:26.477707 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 54/103] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:26.483083 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56a43c-e9db-45a0-854d-e0f55c076990 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:26.557121 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:26.579365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca29840-551d-47f2-b5f1-6b29ce3090fe None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:26.615634 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:26.616297 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56a43c-e9db-45a0-854d-e0f55c076990 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:26.621962 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b101dc-7555-4184-bcb9-05c6080e80a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:26.622835 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b101dc-7555-4184-bcb9-05c6080e80a8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:26.623319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b101dc-7555-4184-bcb9-05c6080e80a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:26.624390 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b101dc-7555-4184-bcb9-05c6080e80a8 None admin] PATH_INFO: `/v3/users/126c4d02c86f4cc09f24869db284cd76` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:26.625873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b101dc-7555-4184-bcb9-05c6080e80a8 None admin] RBAC: Authorizing `identity:get_user(user_id=126c4d02c86f4cc09f24869db284cd76)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:26.627492 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b101dc-7555-4184-bcb9-05c6080e80a8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:26.629493 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 50/104] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:26 2022] GET /identity/v3/users/126c4d02c86f4cc09f24869db284cd76 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:26.635456 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b101dc-7555-4184-bcb9-05c6080e80a8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:26.661837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0c1e5-5bfe-43ed-a352-3c6e93caa305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:26.662953 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0c1e5-5bfe-43ed-a352-3c6e93caa305 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:26.663411 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0c1e5-5bfe-43ed-a352-3c6e93caa305 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:26.664131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0c1e5-5bfe-43ed-a352-3c6e93caa305 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:26.678779 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0c1e5-5bfe-43ed-a352-3c6e93caa305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:26.684589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7aa0c1e5-5bfe-43ed-a352-3c6e93caa305 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 10:11:26.684589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:26.684589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:26.684589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:26.684589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:26.684589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:26.684589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:26.684589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:26.684589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:26.684589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:26.684589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:26.684589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:26.684589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:26.684589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:26.684589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:26.684589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:26.685593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:26.685593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:26.685593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:26.685593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:26.685593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:26.685593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:26.685593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:26.685593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:26.685593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:26.685593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:26.685593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:26.685593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:26.685593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:26.685593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:26.685593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:26.685593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:26.686705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:26.686705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:26.686705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:26.686705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:26.686705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:26.686705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:26.686705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:26.686705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:26.686705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:26.686705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:26.686705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 10:11:26.686705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:26.686705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 55/105] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:26.687477 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c9a81-8dc2-4b5d-9c2a-01c357c7cb6c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:26.687853 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c9a81-8dc2-4b5d-9c2a-01c357c7cb6c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:26.689683 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c9a81-8dc2-4b5d-9c2a-01c357c7cb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:26.708214 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9c0c9a81-8dc2-4b5d-9c2a-01c357c7cb6c None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:26.709396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9c0c9a81-8dc2-4b5d-9c2a-01c357c7cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:26.744890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b101dc-7555-4184-bcb9-05c6080e80a8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:26.775014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 56/106] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:26.775867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c9a81-8dc2-4b5d-9c2a-01c357c7cb6c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:26.791436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e65ed-5ad2-400d-bd4a-baea3b7dc320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:26.792389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e65ed-5ad2-400d-bd4a-baea3b7dc320 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:26.792730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e65ed-5ad2-400d-bd4a-baea3b7dc320 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:26.793007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e65ed-5ad2-400d-bd4a-baea3b7dc320 None admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:26.794157 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e65ed-5ad2-400d-bd4a-baea3b7dc320 None admin] RBAC: Authorizing `identity:get_project(project_id=423d65bc866249f28b368e7ba3b45250)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:26.795630 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e65ed-5ad2-400d-bd4a-baea3b7dc320 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:26.797317 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 51/107] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:26 2022] GET /identity/v3/projects/423d65bc866249f28b368e7ba3b45250 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:26.798074 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e65ed-5ad2-400d-bd4a-baea3b7dc320 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:26.828337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:26.868938 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:26.886035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c9a81-8dc2-4b5d-9c2a-01c357c7cb6c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:26.904654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e65ed-5ad2-400d-bd4a-baea3b7dc320 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:26.922455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc000ee-7cb8-4211-9ca3-0fa92c63eb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:26.923279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc000ee-7cb8-4211-9ca3-0fa92c63eb93 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:26.923580 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc000ee-7cb8-4211-9ca3-0fa92c63eb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:26.923862 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc000ee-7cb8-4211-9ca3-0fa92c63eb93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:26.941448 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996911a1-6661-455c-ad46-02b3dfb8d72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:26.942083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996911a1-6661-455c-ad46-02b3dfb8d72a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:26.942376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996911a1-6661-455c-ad46-02b3dfb8d72a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:26.942658 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996911a1-6661-455c-ad46-02b3dfb8d72a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:26.954501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996911a1-6661-455c-ad46-02b3dfb8d72a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:26.959742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-996911a1-6661-455c-ad46-02b3dfb8d72a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:26.959742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:26.959742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:26.959742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:26.959742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:26.959742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:26.959742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:26.959742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:26.959742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:26.959742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:26.959742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:26.959742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:26.959742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:26.959742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:26.959742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:26.959742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:26.960654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:26.960654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:26.960654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:26.960654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:26.960654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:26.960654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:26.960654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:26.960654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:26.960654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:26.960654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:26.960654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:26.960654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:26.960654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:26.960654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:26.960654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:26.960654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:26.961414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:26.961414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:26.961414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:26.961414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:26.961414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:26.961414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:26.961414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:26.961414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:26.961414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:26.961414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:26.961414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:26.961414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:26.961414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 52/108] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:26.966223 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996911a1-6661-455c-ad46-02b3dfb8d72a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:26.999380 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc000ee-7cb8-4211-9ca3-0fa92c63eb93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:27.001120 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc000ee-7cb8-4211-9ca3-0fa92c63eb93 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:27.047509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:27.066296 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996911a1-6661-455c-ad46-02b3dfb8d72a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:27.092153 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:27.100870 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a5241-159d-4927-9ea2-29ae9d025cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:27.101041 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 57/109] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:11:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:11:27.101484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a5241-159d-4927-9ea2-29ae9d025cff None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:27.101769 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a5241-159d-4927-9ea2-29ae9d025cff None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:27.102045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a5241-159d-4927-9ea2-29ae9d025cff None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:27.102710 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a5241-159d-4927-9ea2-29ae9d025cff None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:27.103020 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a5241-159d-4927-9ea2-29ae9d025cff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:27.104451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a5241-159d-4927-9ea2-29ae9d025cff None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:27.105118 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc000ee-7cb8-4211-9ca3-0fa92c63eb93 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:27.113322 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 53/110] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:27.114117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a5241-159d-4927-9ea2-29ae9d025cff None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:27.199726 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc000ee-7cb8-4211-9ca3-0fa92c63eb93 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:27.213096 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a5241-159d-4927-9ea2-29ae9d025cff None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:27.232307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a54c7-ef96-4260-be78-df186741c7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:27.232971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a54c7-ef96-4260-be78-df186741c7fa None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:27.233252 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a54c7-ef96-4260-be78-df186741c7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:27.233527 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a54c7-ef96-4260-be78-df186741c7fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:27.243086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a54c7-ef96-4260-be78-df186741c7fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:27.246416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5cce6-e8b5-41b5-88d6-e020c49c4f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:27.247017 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5cce6-e8b5-41b5-88d6-e020c49c4f11 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:27.247303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5cce6-e8b5-41b5-88d6-e020c49c4f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:27.247591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5cce6-e8b5-41b5-88d6-e020c49c4f11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:27.247876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-273a54c7-ef96-4260-be78-df186741c7fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:11:27.247876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:27.247876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:27.247876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:27.247876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:27.247876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:27.247876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:27.247876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:27.247876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:27.247876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:27.247876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:27.247876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:27.247876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:27.247876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:27.247876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:27.247876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:27.249350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:27.249350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:27.249350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:27.249350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:27.249350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:27.249350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:27.249350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:27.249350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:27.249350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:27.249350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:27.249350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:27.249350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:27.249350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:27.249350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:27.249350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:27.249350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:27.250245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:27.250245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:27.250245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:27.250245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:27.250245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:27.250245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:27.250245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:27.250245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:27.250245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:27.250245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:27.250245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:11:27.250245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:27.251023 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5cce6-e8b5-41b5-88d6-e020c49c4f11 None admin] RBAC: Adding query filter params (role.id=b76852b6c05a46a9b493c465fd3441a3, scope.project.id=423d65bc866249f28b368e7ba3b45250, user.id=126c4d02c86f4cc09f24869db284cd76) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:27.251023 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5cce6-e8b5-41b5-88d6-e020c49c4f11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:27.251163 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 58/111] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:11:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:27.251163 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a54c7-ef96-4260-be78-df186741c7fa None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:27.251295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5cce6-e8b5-41b5-88d6-e020c49c4f11 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:27.260336 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:27.270564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 54/112] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:11:27 2022] GET /identity/v3/role_assignments?user.id=126c4d02c86f4cc09f24869db284cd76&scope.project.id=423d65bc866249f28b368e7ba3b45250&role.id=b76852b6c05a46a9b493c465fd3441a3 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:27.270564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5cce6-e8b5-41b5-88d6-e020c49c4f11 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:27.325944 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:27.368162 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a54c7-ef96-4260-be78-df186741c7fa None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:27.377542 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5cce6-e8b5-41b5-88d6-e020c49c4f11 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:27.405981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9dff5-b21f-40c2-a9ce-e846d5940be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:27.406611 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9dff5-b21f-40c2-a9ce-e846d5940be8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:27.406894 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9dff5-b21f-40c2-a9ce-e846d5940be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:27.407167 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9dff5-b21f-40c2-a9ce-e846d5940be8 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:27.407858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9dff5-b21f-40c2-a9ce-e846d5940be8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:27.408196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9dff5-b21f-40c2-a9ce-e846d5940be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:27.409626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9dff5-b21f-40c2-a9ce-e846d5940be8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:27.415942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fc74d-f6f1-492a-b99f-c0825f9d7ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:27.416722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fc74d-f6f1-492a-b99f-c0825f9d7ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:27.417099 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fc74d-f6f1-492a-b99f-c0825f9d7ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:27.417457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fc74d-f6f1-492a-b99f-c0825f9d7ea1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:27.418921 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fc74d-f6f1-492a-b99f-c0825f9d7ea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:27.419026 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 59/113] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:27.419697 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9dff5-b21f-40c2-a9ce-e846d5940be8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:27.425488 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fc74d-f6f1-492a-b99f-c0825f9d7ea1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:27.427372 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 55/114] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:11:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:27.428049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fc74d-f6f1-492a-b99f-c0825f9d7ea1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:27.498596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:27.531735 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9dff5-b21f-40c2-a9ce-e846d5940be8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:27.544651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fc74d-f6f1-492a-b99f-c0825f9d7ea1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:27.563567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad3268-38ad-4ff1-a81e-f156c490b6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:27.564325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad3268-38ad-4ff1-a81e-f156c490b6fc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:27.564614 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad3268-38ad-4ff1-a81e-f156c490b6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:27.564888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad3268-38ad-4ff1-a81e-f156c490b6fc None admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:27.565996 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:27.566113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad3268-38ad-4ff1-a81e-f156c490b6fc None admin] RBAC: Authorizing `identity:get_project(project_id=423d65bc866249f28b368e7ba3b45250)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:27.567594 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad3268-38ad-4ff1-a81e-f156c490b6fc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:27.569317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 60/115] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:27 2022] GET /identity/v3/projects/423d65bc866249f28b368e7ba3b45250 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:27.569317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad3268-38ad-4ff1-a81e-f156c490b6fc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:27.579578 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf699430-db45-40ea-9e76-59feecc3eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:27.579843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf699430-db45-40ea-9e76-59feecc3eedf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:27.580156 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf699430-db45-40ea-9e76-59feecc3eedf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:27.580434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf699430-db45-40ea-9e76-59feecc3eedf None admin] PATH_INFO: `/v3/users/d237f062c69e4594a9c5887ebef7f532` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:27.595300 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf699430-db45-40ea-9e76-59feecc3eedf None admin] RBAC: Authorizing `identity:get_user(user_id=d237f062c69e4594a9c5887ebef7f532)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:27.596779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf699430-db45-40ea-9e76-59feecc3eedf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:27.602749 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 56/116] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:27 2022] GET /identity/v3/users/d237f062c69e4594a9c5887ebef7f532 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:27.602749 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf699430-db45-40ea-9e76-59feecc3eedf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:27.673535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad3268-38ad-4ff1-a81e-f156c490b6fc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:27.698202 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf699430-db45-40ea-9e76-59feecc3eedf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:27.706065 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d71f6d-738b-4987-b8da-085e3e1a756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:27.706734 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d71f6d-738b-4987-b8da-085e3e1a756e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:27.707025 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d71f6d-738b-4987-b8da-085e3e1a756e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:27.707310 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d71f6d-738b-4987-b8da-085e3e1a756e None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:27.708020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d71f6d-738b-4987-b8da-085e3e1a756e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:27.708329 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d71f6d-738b-4987-b8da-085e3e1a756e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:27.709730 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d71f6d-738b-4987-b8da-085e3e1a756e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:27.711812 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:27.718585 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 61/117] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:27.719432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d71f6d-738b-4987-b8da-085e3e1a756e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:27.733683 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f36424-0618-4449-a260-1bcd1f0c4c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:27.734314 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f36424-0618-4449-a260-1bcd1f0c4c20 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:27.734597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f36424-0618-4449-a260-1bcd1f0c4c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:27.734876 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f36424-0618-4449-a260-1bcd1f0c4c20 None admin] PATH_INFO: `/v3/users/126c4d02c86f4cc09f24869db284cd76` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:27.736044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f36424-0618-4449-a260-1bcd1f0c4c20 None admin] RBAC: Authorizing `identity:get_user(user_id=126c4d02c86f4cc09f24869db284cd76)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:27.737491 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f36424-0618-4449-a260-1bcd1f0c4c20 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:27.739108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 57/118] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:27 2022] GET /identity/v3/users/126c4d02c86f4cc09f24869db284cd76 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:27.739876 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f36424-0618-4449-a260-1bcd1f0c4c20 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:27.787576 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:27.819563 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d71f6d-738b-4987-b8da-085e3e1a756e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:27.837302 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f36424-0618-4449-a260-1bcd1f0c4c20 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:27.853756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe45251-c219-4376-bcfe-46e34c6d19b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:27.854369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe45251-c219-4376-bcfe-46e34c6d19b3 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:27.854650 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe45251-c219-4376-bcfe-46e34c6d19b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:27.855179 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe45251-c219-4376-bcfe-46e34c6d19b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:27.855833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe45251-c219-4376-bcfe-46e34c6d19b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:27.857324 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe45251-c219-4376-bcfe-46e34c6d19b3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:27.869854 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7d64f-160e-49b8-b4de-e1443ebee2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:27.870454 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7d64f-160e-49b8-b4de-e1443ebee2bd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:27.870732 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7d64f-160e-49b8-b4de-e1443ebee2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:27.871002 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7d64f-160e-49b8-b4de-e1443ebee2bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:27.871719 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7d64f-160e-49b8-b4de-e1443ebee2bd None admin] RBAC: Adding query filter params (role.id=5d2fc6de54204986a2c3aedc42288813, scope.project.id=423d65bc866249f28b368e7ba3b45250, user.id=126c4d02c86f4cc09f24869db284cd76) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:27.872060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7d64f-160e-49b8-b4de-e1443ebee2bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:27.874071 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7d64f-160e-49b8-b4de-e1443ebee2bd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:27.880258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 58/119] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:11:27 2022] GET /identity/v3/role_assignments?user.id=126c4d02c86f4cc09f24869db284cd76&scope.project.id=423d65bc866249f28b368e7ba3b45250&role.id=5d2fc6de54204986a2c3aedc42288813 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:27.881037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7d64f-160e-49b8-b4de-e1443ebee2bd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:27.894022 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 62/120] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 17 10:11:27 2022] POST /identity/v3/projects => generated 302 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:11:27.894935 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe45251-c219-4376-bcfe-46e34c6d19b3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:27.995798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:28.030564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7d64f-160e-49b8-b4de-e1443ebee2bd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:28.054093 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:28.089810 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe45251-c219-4376-bcfe-46e34c6d19b3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:28.094590 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e873ab-89eb-4e8b-8940-69d3c6b79b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:28.095017 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e873ab-89eb-4e8b-8940-69d3c6b79b51 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:28.095884 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e873ab-89eb-4e8b-8940-69d3c6b79b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:28.095884 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e873ab-89eb-4e8b-8940-69d3c6b79b51 None admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:28.097534 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e873ab-89eb-4e8b-8940-69d3c6b79b51 None admin] RBAC: Authorizing `identity:get_project(project_id=423d65bc866249f28b368e7ba3b45250)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:28.099299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e873ab-89eb-4e8b-8940-69d3c6b79b51 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:28.101047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 59/121] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:27 2022] GET /identity/v3/projects/423d65bc866249f28b368e7ba3b45250 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:28.102072 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e873ab-89eb-4e8b-8940-69d3c6b79b51 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:28.133109 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b60891-4234-42ff-991a-3d8e34aa59ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:28.133777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b60891-4234-42ff-991a-3d8e34aa59ff None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:28.134043 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b60891-4234-42ff-991a-3d8e34aa59ff None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:28.134323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b60891-4234-42ff-991a-3d8e34aa59ff None admin] PATH_INFO: `/v3/users/b74fb7e0184d4dd9bc4b1b1fd5ed0d2e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:28.136479 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b60891-4234-42ff-991a-3d8e34aa59ff None admin] RBAC: Authorizing `identity:get_user(user_id=b74fb7e0184d4dd9bc4b1b1fd5ed0d2e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:28.138692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b60891-4234-42ff-991a-3d8e34aa59ff None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:28.139420 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 63/122] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:27 2022] GET /identity/v3/users/b74fb7e0184d4dd9bc4b1b1fd5ed0d2e => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:28.140301 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b60891-4234-42ff-991a-3d8e34aa59ff None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:28.221170 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e873ab-89eb-4e8b-8940-69d3c6b79b51 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:28.255450 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc53dc-dab7-4456-b1d3-a0d291b578a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:28.255965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc53dc-dab7-4456-b1d3-a0d291b578a5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:28.256338 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc53dc-dab7-4456-b1d3-a0d291b578a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:28.256576 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc53dc-dab7-4456-b1d3-a0d291b578a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:28.258338 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b60891-4234-42ff-991a-3d8e34aa59ff None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:28.278180 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:28.296358 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12508e13-ea52-4915-a021-cf5a0a62cbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:28.297153 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12508e13-ea52-4915-a021-cf5a0a62cbc7 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:28.297433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12508e13-ea52-4915-a021-cf5a0a62cbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:28.297702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12508e13-ea52-4915-a021-cf5a0a62cbc7 None admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250/users/d237f062c69e4594a9c5887ebef7f532/roles/42fcdd5fbf1e4056bd623ff078b31886` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:28.299687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12508e13-ea52-4915-a021-cf5a0a62cbc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=423d65bc866249f28b368e7ba3b45250, user_id=d237f062c69e4594a9c5887ebef7f532, role_id=42fcdd5fbf1e4056bd623ff078b31886)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:28.301289 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12508e13-ea52-4915-a021-cf5a0a62cbc7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:28.305982 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:28.322205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 64/123] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:11:28 2022] PUT /identity/v3/projects/423d65bc866249f28b368e7ba3b45250/users/d237f062c69e4594a9c5887ebef7f532/roles/42fcdd5fbf1e4056bd623ff078b31886 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:11:28.322205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12508e13-ea52-4915-a021-cf5a0a62cbc7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:28.336281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc53dc-dab7-4456-b1d3-a0d291b578a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:28.337893 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc53dc-dab7-4456-b1d3-a0d291b578a5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:28.442021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12508e13-ea52-4915-a021-cf5a0a62cbc7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:28.477413 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 60/124] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:11:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:11:28.481588 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbc344-b650-4e90-91b0-459912671f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:28.482559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbc344-b650-4e90-91b0-459912671f85 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:28.483392 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbc344-b650-4e90-91b0-459912671f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:28.483671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbc344-b650-4e90-91b0-459912671f85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:28.484535 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc53dc-dab7-4456-b1d3-a0d291b578a5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:28.538220 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:28.561754 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbc344-b650-4e90-91b0-459912671f85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:28.563149 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbc344-b650-4e90-91b0-459912671f85 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:28.592228 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:28.618929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc53dc-dab7-4456-b1d3-a0d291b578a5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:28.660125 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0f525-06d3-44d2-9502-cb0842d29d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:28.661059 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0f525-06d3-44d2-9502-cb0842d29d81 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:28.661509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0f525-06d3-44d2-9502-cb0842d29d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:28.661973 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0f525-06d3-44d2-9502-cb0842d29d81 None admin] PATH_INFO: `/v3/projects/ca53f4119726409db9ca11fa234f4ace` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:28.664049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0f525-06d3-44d2-9502-cb0842d29d81 None admin] RBAC: Authorizing `identity:get_project(project_id=ca53f4119726409db9ca11fa234f4ace)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:28.666070 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0f525-06d3-44d2-9502-cb0842d29d81 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:28.668325 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 61/125] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:28 2022] GET /identity/v3/projects/ca53f4119726409db9ca11fa234f4ace => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:28.679722 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 65/126] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:11:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:11:28.679897 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0f525-06d3-44d2-9502-cb0842d29d81 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:28.680649 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbc344-b650-4e90-91b0-459912671f85 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:28.764910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:28.790886 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbc344-b650-4e90-91b0-459912671f85 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:28.804435 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0f525-06d3-44d2-9502-cb0842d29d81 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:28.826352 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043e7c9-61b3-4b0c-ba51-811038369136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:28.826989 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043e7c9-61b3-4b0c-ba51-811038369136 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:28.827227 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043e7c9-61b3-4b0c-ba51-811038369136 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:28.827724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043e7c9-61b3-4b0c-ba51-811038369136 None admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:28.828934 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043e7c9-61b3-4b0c-ba51-811038369136 None admin] RBAC: Authorizing `identity:get_project(project_id=423d65bc866249f28b368e7ba3b45250)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:28.830430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043e7c9-61b3-4b0c-ba51-811038369136 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:28.837011 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 66/127] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:28 2022] GET /identity/v3/projects/423d65bc866249f28b368e7ba3b45250 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:28.838758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043e7c9-61b3-4b0c-ba51-811038369136 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:28.857161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a441b7-5bfd-420c-a272-90393b3889ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:28.859749 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a441b7-5bfd-420c-a272-90393b3889ea None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:28.860252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a441b7-5bfd-420c-a272-90393b3889ea None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:28.861019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a441b7-5bfd-420c-a272-90393b3889ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:28.862431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a441b7-5bfd-420c-a272-90393b3889ea None admin] RBAC: Adding query filter params (role.id=5d2fc6de54204986a2c3aedc42288813, scope.project.id=ca53f4119726409db9ca11fa234f4ace, user.id=126c4d02c86f4cc09f24869db284cd76) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:28.862941 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a441b7-5bfd-420c-a272-90393b3889ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:28.865123 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a441b7-5bfd-420c-a272-90393b3889ea None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:28.880468 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 62/128] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:11:28 2022] GET /identity/v3/role_assignments?user.id=126c4d02c86f4cc09f24869db284cd76&scope.project.id=ca53f4119726409db9ca11fa234f4ace&role.id=5d2fc6de54204986a2c3aedc42288813 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:28.959231 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043e7c9-61b3-4b0c-ba51-811038369136 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:28.997708 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd585f9-2dab-4504-9826-f05293e6949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:28.998336 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd585f9-2dab-4504-9826-f05293e6949e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:28.998658 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd585f9-2dab-4504-9826-f05293e6949e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:28.998935 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd585f9-2dab-4504-9826-f05293e6949e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:28.999679 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd585f9-2dab-4504-9826-f05293e6949e None admin] RBAC: Adding query filter params (role.id=5e3dfffec8aa470fab9232cc439aec74, scope.project.id=423d65bc866249f28b368e7ba3b45250, user.id=b74fb7e0184d4dd9bc4b1b1fd5ed0d2e) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:29.000016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd585f9-2dab-4504-9826-f05293e6949e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:29.001485 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd585f9-2dab-4504-9826-f05293e6949e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:29.008328 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 67/129] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:11:28 2022] GET /identity/v3/role_assignments?user.id=b74fb7e0184d4dd9bc4b1b1fd5ed0d2e&scope.project.id=423d65bc866249f28b368e7ba3b45250&role.id=5e3dfffec8aa470fab9232cc439aec74 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:30.108565 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79637e4-e70b-4a09-abb6-a2ed05d94386 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:30.109039 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79637e4-e70b-4a09-abb6-a2ed05d94386 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:30.109118 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79637e4-e70b-4a09-abb6-a2ed05d94386 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:30.110475 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 63/130] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:30.115669 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd8d87-ff5e-4e48-af5f-14dd8b6fbe59 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:30.116083 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd8d87-ff5e-4e48-af5f-14dd8b6fbe59 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:30.116276 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd8d87-ff5e-4e48-af5f-14dd8b6fbe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:30.134781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6dcd8d87-ff5e-4e48-af5f-14dd8b6fbe59 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:30.135993 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6dcd8d87-ff5e-4e48-af5f-14dd8b6fbe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:30.138719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:30.201366 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 68/131] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:30.469348 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79637e4-e70b-4a09-abb6-a2ed05d94386 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:30.485571 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:30.569532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79637e4-e70b-4a09-abb6-a2ed05d94386 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:30.571586 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884755de-6b21-4340-bb30-8262af8fcedb None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:30.571989 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884755de-6b21-4340-bb30-8262af8fcedb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:30.572339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884755de-6b21-4340-bb30-8262af8fcedb None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:30.573764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 69/132] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:11:30.579093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2acef-bccf-4d98-b3c8-5f016529cb25 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:30.579384 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2acef-bccf-4d98-b3c8-5f016529cb25 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:30.579658 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2acef-bccf-4d98-b3c8-5f016529cb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:30.597297 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-12c2acef-bccf-4d98-b3c8-5f016529cb25 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:30.598899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-12c2acef-bccf-4d98-b3c8-5f016529cb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:30.604156 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aa10f-6408-4116-96dd-61b66b2a19b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:30.604784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aa10f-6408-4116-96dd-61b66b2a19b4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:30.605329 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aa10f-6408-4116-96dd-61b66b2a19b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:30.605602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aa10f-6408-4116-96dd-61b66b2a19b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:30.606753 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4aa10f-6408-4116-96dd-61b66b2a19b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:30.609152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4aa10f-6408-4116-96dd-61b66b2a19b4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:30.610896 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 64/133] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:11:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:30.616205 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aa10f-6408-4116-96dd-61b66b2a19b4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:30.669809 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 70/134] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:11:30.701205 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:30.719666 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aa10f-6408-4116-96dd-61b66b2a19b4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:30.752707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb0956-968e-4569-9c02-bfecbbb37c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:30.753312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb0956-968e-4569-9c02-bfecbbb37c45 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:30.753597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb0956-968e-4569-9c02-bfecbbb37c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:30.753875 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb0956-968e-4569-9c02-bfecbbb37c45 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:30.754527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb0956-968e-4569-9c02-bfecbbb37c45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:30.756025 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb0956-968e-4569-9c02-bfecbbb37c45 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:30.783507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 65/135] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:11:30 2022] POST /identity/v3/users => generated 283 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:11:30.942536 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2acef-bccf-4d98-b3c8-5f016529cb25 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:31.009940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:31.041518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2acef-bccf-4d98-b3c8-5f016529cb25 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:31.080744 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb6fe7-849a-46ad-b1e7-761abb6cfe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:31.081243 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb6fe7-849a-46ad-b1e7-761abb6cfe75 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:31.081522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb6fe7-849a-46ad-b1e7-761abb6cfe75 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:31.081825 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb6fe7-849a-46ad-b1e7-761abb6cfe75 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:31.093073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb6fe7-849a-46ad-b1e7-761abb6cfe75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:31.097921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-79bb6fe7-849a-46ad-b1e7-761abb6cfe75 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 10:11:31.097921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:31.097921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:31.097921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:31.097921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:31.097921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:31.097921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:31.097921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:31.097921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:31.097921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:31.097921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:31.097921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:31.097921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:31.097921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:31.097921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:31.097921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:31.098791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:31.098791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:31.098791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:31.098791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:31.098791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:31.098791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:31.098791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:31.098791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:31.098791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:31.098791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:31.098791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:31.098791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:31.098791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:31.098791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:31.098791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:31.098791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:31.099589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:31.099589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:31.099589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:31.099589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:31.099589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:31.099589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:31.099589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:31.099589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:31.099589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:31.099589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:31.099589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 10:11:31.099589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:31.099589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 71/136] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:31.105228 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb0956-968e-4569-9c02-bfecbbb37c45 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:31.209594 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb0956-968e-4569-9c02-bfecbbb37c45 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:31.245423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cde326-9212-4c64-bbc6-37d743e4b3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:31.246047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cde326-9212-4c64-bbc6-37d743e4b3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:31.246331 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cde326-9212-4c64-bbc6-37d743e4b3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:31.246608 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cde326-9212-4c64-bbc6-37d743e4b3f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:31.247279 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cde326-9212-4c64-bbc6-37d743e4b3f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:31.247589 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cde326-9212-4c64-bbc6-37d743e4b3f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:31.249032 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cde326-9212-4c64-bbc6-37d743e4b3f6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:31.251213 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:31.260808 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 66/137] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:31.267362 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb6fe7-849a-46ad-b1e7-761abb6cfe75 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:31.374630 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb6fe7-849a-46ad-b1e7-761abb6cfe75 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:31.405080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:31.411309 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf66e3-14c3-492a-8360-3bc2e68c2a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:31.411962 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf66e3-14c3-492a-8360-3bc2e68c2a58 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:31.412257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf66e3-14c3-492a-8360-3bc2e68c2a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:31.412534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf66e3-14c3-492a-8360-3bc2e68c2a58 None admin] PATH_INFO: `/v3/users/d237f062c69e4594a9c5887ebef7f532` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:31.413689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf66e3-14c3-492a-8360-3bc2e68c2a58 None admin] RBAC: Authorizing `identity:get_user(user_id=d237f062c69e4594a9c5887ebef7f532)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:31.415149 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf66e3-14c3-492a-8360-3bc2e68c2a58 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:31.420787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 72/138] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:31 2022] GET /identity/v3/users/d237f062c69e4594a9c5887ebef7f532 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:31.423069 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cde326-9212-4c64-bbc6-37d743e4b3f6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:31.528765 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cde326-9212-4c64-bbc6-37d743e4b3f6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:31.567717 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5281fa5-7eb8-468e-a392-79b4d070f20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:31.568697 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5281fa5-7eb8-468e-a392-79b4d070f20c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:31.569214 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5281fa5-7eb8-468e-a392-79b4d070f20c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:31.569701 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5281fa5-7eb8-468e-a392-79b4d070f20c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:31.644284 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:31.648612 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5281fa5-7eb8-468e-a392-79b4d070f20c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:31.650107 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5281fa5-7eb8-468e-a392-79b4d070f20c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:31.751614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 67/139] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:11:31.761082 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf66e3-14c3-492a-8360-3bc2e68c2a58 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:31.865446 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf66e3-14c3-492a-8360-3bc2e68c2a58 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:31.900391 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffe14f-6518-4d01-8fa5-c589b5cba5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:31.901413 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffe14f-6518-4d01-8fa5-c589b5cba5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:31.901891 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffe14f-6518-4d01-8fa5-c589b5cba5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:31.902376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffe14f-6518-4d01-8fa5-c589b5cba5a1 None admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:31.903717 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffe14f-6518-4d01-8fa5-c589b5cba5a1 None admin] RBAC: Authorizing `identity:get_project(project_id=423d65bc866249f28b368e7ba3b45250)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:31.905517 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffe14f-6518-4d01-8fa5-c589b5cba5a1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:31.907494 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 73/140] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:31 2022] GET /identity/v3/projects/423d65bc866249f28b368e7ba3b45250 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:31.913389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5281fa5-7eb8-468e-a392-79b4d070f20c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:32.014919 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:32.018440 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5281fa5-7eb8-468e-a392-79b4d070f20c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:32.053192 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8876f7d-c3b6-4265-8a2c-5a2dce81ba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:32.053809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8876f7d-c3b6-4265-8a2c-5a2dce81ba3a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:32.054095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8876f7d-c3b6-4265-8a2c-5a2dce81ba3a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:32.054373 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8876f7d-c3b6-4265-8a2c-5a2dce81ba3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:32.055104 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8876f7d-c3b6-4265-8a2c-5a2dce81ba3a None admin] RBAC: Adding query filter params (role.id=42fcdd5fbf1e4056bd623ff078b31886, scope.project.id=423d65bc866249f28b368e7ba3b45250, user.id=d237f062c69e4594a9c5887ebef7f532) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:32.055418 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8876f7d-c3b6-4265-8a2c-5a2dce81ba3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:32.056906 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8876f7d-c3b6-4265-8a2c-5a2dce81ba3a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:32.063762 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 68/141] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:11:31 2022] GET /identity/v3/role_assignments?user.id=d237f062c69e4594a9c5887ebef7f532&scope.project.id=423d65bc866249f28b368e7ba3b45250&role.id=42fcdd5fbf1e4056bd623ff078b31886 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:33.035010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bcca5-21af-46bd-9c07-39030707579e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:33.035547 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bcca5-21af-46bd-9c07-39030707579e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:33.035547 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bcca5-21af-46bd-9c07-39030707579e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:33.037054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 74/142] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:33.041895 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282c375-2bed-42f9-8b57-2883d6e58c7c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:33.042285 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282c375-2bed-42f9-8b57-2883d6e58c7c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:33.042442 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282c375-2bed-42f9-8b57-2883d6e58c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:33.060419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e282c375-2bed-42f9-8b57-2883d6e58c7c None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:33.062140 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e282c375-2bed-42f9-8b57-2883d6e58c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:33.133437 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 69/143] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:33.243745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae61d-6069-4f0b-846b-051329255318 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:33.244144 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae61d-6069-4f0b-846b-051329255318 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:33.244337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae61d-6069-4f0b-846b-051329255318 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:33.245872 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 75/144] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:33.252250 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224eeef1-b4d3-4f70-b896-51224bd37cba None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:33.252552 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224eeef1-b4d3-4f70-b896-51224bd37cba None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:33.252820 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224eeef1-b4d3-4f70-b896-51224bd37cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:33.271024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-224eeef1-b4d3-4f70-b896-51224bd37cba None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:33.272236 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-224eeef1-b4d3-4f70-b896-51224bd37cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:33.337393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 70/145] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:33.344460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fa11a-5a9d-4c7d-985d-2c6bd05e88b5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:33.344847 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fa11a-5a9d-4c7d-985d-2c6bd05e88b5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:33.345197 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fa11a-5a9d-4c7d-985d-2c6bd05e88b5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:33.350214 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 76/146] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:33.351800 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7ea3d-1a2f-41b8-ada4-a3acc2b1b4ee None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:33.352129 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7ea3d-1a2f-41b8-ada4-a3acc2b1b4ee None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:33.352410 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7ea3d-1a2f-41b8-ada4-a3acc2b1b4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:33.370695 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-51b7ea3d-1a2f-41b8-ada4-a3acc2b1b4ee None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:33.371856 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-51b7ea3d-1a2f-41b8-ada4-a3acc2b1b4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:33.388727 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:33.398621 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fa11a-5a9d-4c7d-985d-2c6bd05e88b5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:33.441297 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 71/147] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:33.478123 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:33.515593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fa11a-5a9d-4c7d-985d-2c6bd05e88b5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:33.550687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152b696-0de7-4212-a8ca-4c3ab93f73e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:33.551317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152b696-0de7-4212-a8ca-4c3ab93f73e6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:33.551598 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152b696-0de7-4212-a8ca-4c3ab93f73e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:33.551870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152b696-0de7-4212-a8ca-4c3ab93f73e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:33.563082 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152b696-0de7-4212-a8ca-4c3ab93f73e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:33.568096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-2152b696-0de7-4212-a8ca-4c3ab93f73e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:11:33.568096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:33.568096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:33.568096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:33.568096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:33.568096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:33.568096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:33.568096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:33.568096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:33.568096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:33.568096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:33.568096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:33.568096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:33.568096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:33.568096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:33.568096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:33.568898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:33.568898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:33.568898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:33.568898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:33.568898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:33.568898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:33.568898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:33.568898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:33.568898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:33.568898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:33.568898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:33.568898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:33.568898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:33.568898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:33.568898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:33.568898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:33.572711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:33.572711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:33.572711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:33.572711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:33.572711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:33.572711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:33.572711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:33.572711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:33.572711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:33.572711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:33.572711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:11:33.572711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:33.572711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 77/148] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:11:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:33.575033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7ea3d-1a2f-41b8-ada4-a3acc2b1b4ee None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:33.602253 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152b696-0de7-4212-a8ca-4c3ab93f73e6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:33.684442 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7ea3d-1a2f-41b8-ada4-a3acc2b1b4ee None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:33.708882 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152b696-0de7-4212-a8ca-4c3ab93f73e6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:33.720361 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ba1e0-94f6-4c6b-8516-10f3e00ab5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:33.720978 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ba1e0-94f6-4c6b-8516-10f3e00ab5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:33.721253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ba1e0-94f6-4c6b-8516-10f3e00ab5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:33.721529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ba1e0-94f6-4c6b-8516-10f3e00ab5b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:33.722190 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ba1e0-94f6-4c6b-8516-10f3e00ab5b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:33.722494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ba1e0-94f6-4c6b-8516-10f3e00ab5b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:33.723848 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ba1e0-94f6-4c6b-8516-10f3e00ab5b1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:33.731999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 72/149] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:33.733312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ba1e0-94f6-4c6b-8516-10f3e00ab5b1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:33.737761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:33.746618 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e9436-5ff6-429e-ab78-f0872ec5f1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:33.747252 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e9436-5ff6-429e-ab78-f0872ec5f1ed None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:33.747535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e9436-5ff6-429e-ab78-f0872ec5f1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:33.747809 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e9436-5ff6-429e-ab78-f0872ec5f1ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:33.748350 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:33.758570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e9436-5ff6-429e-ab78-f0872ec5f1ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:33.763823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-cb4e9436-5ff6-429e-ab78-f0872ec5f1ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:11:33.763823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:33.763823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:33.763823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:33.763823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:33.763823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:33.763823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:33.763823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:33.763823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:33.763823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:33.763823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:33.763823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:33.763823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:33.763823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:33.763823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:33.763823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:33.764791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:33.764791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:33.764791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:33.764791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:33.764791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:33.764791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:33.764791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:33.764791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:33.764791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:33.764791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:33.764791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:33.764791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:33.764791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:33.764791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:33.764791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:33.764791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:33.765564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:33.765564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:33.765564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:33.765564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:33.765564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:33.765564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:33.765564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:33.765564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:33.765564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:33.765564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:33.765564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:11:33.765564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:33.765564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 78/150] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 17 10:11:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:11:33.766272 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e9436-5ff6-429e-ab78-f0872ec5f1ed None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:33.830615 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ba1e0-94f6-4c6b-8516-10f3e00ab5b1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:33.863371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e9436-5ff6-429e-ab78-f0872ec5f1ed None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:33.863674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71687fd6-bce4-4b30-a637-38ede2c8dbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:33.864323 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71687fd6-bce4-4b30-a637-38ede2c8dbfd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:33.864611 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71687fd6-bce4-4b30-a637-38ede2c8dbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:33.864874 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71687fd6-bce4-4b30-a637-38ede2c8dbfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:33.865969 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71687fd6-bce4-4b30-a637-38ede2c8dbfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:33.867398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71687fd6-bce4-4b30-a637-38ede2c8dbfd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:33.868978 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 73/151] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:11:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:33.872748 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71687fd6-bce4-4b30-a637-38ede2c8dbfd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:33.896959 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3838431-9541-46c4-bb88-ebf38bbb225e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:33.897585 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3838431-9541-46c4-bb88-ebf38bbb225e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:33.897865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3838431-9541-46c4-bb88-ebf38bbb225e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:33.898143 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3838431-9541-46c4-bb88-ebf38bbb225e None admin] PATH_INFO: `/v3/users/15e458ea10484360b22cc7b296f4c282` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:33.911660 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3838431-9541-46c4-bb88-ebf38bbb225e None admin] RBAC: Authorizing `identity:get_user(user_id=15e458ea10484360b22cc7b296f4c282)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:33.913155 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3838431-9541-46c4-bb88-ebf38bbb225e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:33.914746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 79/152] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:33 2022] GET /identity/v3/users/15e458ea10484360b22cc7b296f4c282 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:33.915493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3838431-9541-46c4-bb88-ebf38bbb225e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:33.957091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:33.960899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:33.975883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71687fd6-bce4-4b30-a637-38ede2c8dbfd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:34.009206 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8c0c9-d16a-4447-8b06-3b6f1a12c0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:34.009813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8c0c9-d16a-4447-8b06-3b6f1a12c0ec None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:34.010091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8c0c9-d16a-4447-8b06-3b6f1a12c0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:34.010365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8c0c9-d16a-4447-8b06-3b6f1a12c0ec None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:34.011022 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8c0c9-d16a-4447-8b06-3b6f1a12c0ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:34.011327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8c0c9-d16a-4447-8b06-3b6f1a12c0ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:34.012747 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8c0c9-d16a-4447-8b06-3b6f1a12c0ec None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:34.013757 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3838431-9541-46c4-bb88-ebf38bbb225e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:34.021073 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 74/153] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:11:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:34.021073 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8c0c9-d16a-4447-8b06-3b6f1a12c0ec None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:34.050840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d24e40-e042-46b9-a2f9-15291746c178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:34.051450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d24e40-e042-46b9-a2f9-15291746c178 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:34.051740 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d24e40-e042-46b9-a2f9-15291746c178 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:34.052040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d24e40-e042-46b9-a2f9-15291746c178 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:34.052692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d24e40-e042-46b9-a2f9-15291746c178 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:34.054142 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d24e40-e042-46b9-a2f9-15291746c178 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:34.079395 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 80/154] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:11:33 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:11:34.080260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d24e40-e042-46b9-a2f9-15291746c178 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:34.130447 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8c0c9-d16a-4447-8b06-3b6f1a12c0ec None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:34.168617 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767178a6-0c54-48fa-9524-1d1a060a66b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:34.169248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767178a6-0c54-48fa-9524-1d1a060a66b4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:34.169525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767178a6-0c54-48fa-9524-1d1a060a66b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:34.169797 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767178a6-0c54-48fa-9524-1d1a060a66b4 None admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:34.171538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767178a6-0c54-48fa-9524-1d1a060a66b4 None admin] RBAC: Authorizing `identity:get_project(project_id=59dbb475fe1d46689ba2116ba560199f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:34.173080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767178a6-0c54-48fa-9524-1d1a060a66b4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:34.174981 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 75/155] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:34 2022] GET /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:34.180746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767178a6-0c54-48fa-9524-1d1a060a66b4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:34.190738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:34.195098 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d24e40-e042-46b9-a2f9-15291746c178 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:34.198921 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:34.237592 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae28546-95db-4832-86a8-63b7281fec3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:34.238339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae28546-95db-4832-86a8-63b7281fec3c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:34.238980 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae28546-95db-4832-86a8-63b7281fec3c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:34.238980 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae28546-95db-4832-86a8-63b7281fec3c None admin] PATH_INFO: `/v3/users/15e458ea10484360b22cc7b296f4c282` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:34.240157 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae28546-95db-4832-86a8-63b7281fec3c None admin] RBAC: Authorizing `identity:get_user(user_id=15e458ea10484360b22cc7b296f4c282)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:34.241744 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae28546-95db-4832-86a8-63b7281fec3c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:34.243487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 81/156] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:34 2022] GET /identity/v3/users/15e458ea10484360b22cc7b296f4c282 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:34.248924 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae28546-95db-4832-86a8-63b7281fec3c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:34.302844 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767178a6-0c54-48fa-9524-1d1a060a66b4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:34.351715 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bd682-717e-47f7-ad65-94c6e4a32754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:34.352561 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bd682-717e-47f7-ad65-94c6e4a32754 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:34.352937 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bd682-717e-47f7-ad65-94c6e4a32754 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:34.353324 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bd682-717e-47f7-ad65-94c6e4a32754 None admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f/users/15e458ea10484360b22cc7b296f4c282/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:34.355961 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bd682-717e-47f7-ad65-94c6e4a32754 None admin] RBAC: Authorizing `identity:create_grant(project_id=59dbb475fe1d46689ba2116ba560199f, user_id=15e458ea10484360b22cc7b296f4c282, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:34.357421 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bd682-717e-47f7-ad65-94c6e4a32754 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:34.372154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae28546-95db-4832-86a8-63b7281fec3c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:34.374428 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 76/157] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:11:34 2022] PUT /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f/users/15e458ea10484360b22cc7b296f4c282/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:11:34.415360 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762c5a5-994e-4e6d-abd8-bc603b63eed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:34.416332 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762c5a5-994e-4e6d-abd8-bc603b63eed6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:34.416772 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762c5a5-994e-4e6d-abd8-bc603b63eed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:34.417285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762c5a5-994e-4e6d-abd8-bc603b63eed6 None admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:34.418695 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762c5a5-994e-4e6d-abd8-bc603b63eed6 None admin] RBAC: Authorizing `identity:get_project(project_id=59dbb475fe1d46689ba2116ba560199f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:34.421130 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762c5a5-994e-4e6d-abd8-bc603b63eed6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:34.423159 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 82/158] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:34 2022] GET /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:34.429436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bd682-717e-47f7-ad65-94c6e4a32754 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:34.510742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:34.548102 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bd682-717e-47f7-ad65-94c6e4a32754 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:34.587561 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ec33f-42da-4d1d-94fe-6f7ccb25ee06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:34.588403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ec33f-42da-4d1d-94fe-6f7ccb25ee06 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:34.588788 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ec33f-42da-4d1d-94fe-6f7ccb25ee06 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:34.589166 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ec33f-42da-4d1d-94fe-6f7ccb25ee06 None admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f/users/15e458ea10484360b22cc7b296f4c282/roles/b76852b6c05a46a9b493c465fd3441a3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:34.592711 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ec33f-42da-4d1d-94fe-6f7ccb25ee06 None admin] RBAC: Authorizing `identity:create_grant(project_id=59dbb475fe1d46689ba2116ba560199f, user_id=15e458ea10484360b22cc7b296f4c282, role_id=b76852b6c05a46a9b493c465fd3441a3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:34.594262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ec33f-42da-4d1d-94fe-6f7ccb25ee06 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:34.611042 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 77/159] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:11:34 2022] PUT /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f/users/15e458ea10484360b22cc7b296f4c282/roles/b76852b6c05a46a9b493c465fd3441a3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:11:36.371649 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bd151-b8cd-4da2-8ef1-b9644edda778 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:36.372174 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bd151-b8cd-4da2-8ef1-b9644edda778 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:36.372174 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bd151-b8cd-4da2-8ef1-b9644edda778 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:36.374387 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 83/160] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:36.380380 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a97eb-d55b-4048-bfd1-f965bd305de5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:36.380890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a97eb-d55b-4048-bfd1-f965bd305de5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:36.380986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a97eb-d55b-4048-bfd1-f965bd305de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:36.400383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f14a97eb-d55b-4048-bfd1-f965bd305de5 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:36.401610 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f14a97eb-d55b-4048-bfd1-f965bd305de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:36.472716 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 78/161] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:36.520170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307ad39-9af2-47b6-974a-b66b84dba58e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:36.520549 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307ad39-9af2-47b6-974a-b66b84dba58e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:36.520901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307ad39-9af2-47b6-974a-b66b84dba58e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:36.522326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 84/162] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:36.527751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e875f-b7e3-4dbd-9e58-db9f1d3fe57e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:36.528066 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e875f-b7e3-4dbd-9e58-db9f1d3fe57e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:36.528341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e875f-b7e3-4dbd-9e58-db9f1d3fe57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:36.547162 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bf6e875f-b7e3-4dbd-9e58-db9f1d3fe57e None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:36.548371 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bf6e875f-b7e3-4dbd-9e58-db9f1d3fe57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:36.589551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd187194-0e2c-42cb-83d5-10547d320c2c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:36.590178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd187194-0e2c-42cb-83d5-10547d320c2c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:36.590644 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd187194-0e2c-42cb-83d5-10547d320c2c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:36.592285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 85/163] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:11:36.597611 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cefe9-286b-4f25-9ef0-335833181148 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:36.598115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cefe9-286b-4f25-9ef0-335833181148 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:36.598580 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cefe9-286b-4f25-9ef0-335833181148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:36.608280 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:36.619560 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 79/164] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:11:36.620434 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-520cefe9-286b-4f25-9ef0-335833181148 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:36.623366 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-520cefe9-286b-4f25-9ef0-335833181148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:36.660884 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:36.707489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 86/165] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:11:36.758612 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e875f-b7e3-4dbd-9e58-db9f1d3fe57e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:36.782232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dac9db-ff92-47b5-b44b-2d9823995378 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:36.782509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dac9db-ff92-47b5-b44b-2d9823995378 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:36.782787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dac9db-ff92-47b5-b44b-2d9823995378 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:36.784459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 87/166] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:11:36.789309 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43105940-af29-45e9-aae8-fa22826051e0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:36.789595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43105940-af29-45e9-aae8-fa22826051e0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:36.789870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43105940-af29-45e9-aae8-fa22826051e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:36.807401 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-43105940-af29-45e9-aae8-fa22826051e0 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:36.808604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-43105940-af29-45e9-aae8-fa22826051e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:36.866723 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e875f-b7e3-4dbd-9e58-db9f1d3fe57e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:36.891978 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 88/167] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:11:36.900761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43105940-af29-45e9-aae8-fa22826051e0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:36.908281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938eaec-1768-43f4-802e-9d5ecb351179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:36.908920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938eaec-1768-43f4-802e-9d5ecb351179 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:36.909196 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938eaec-1768-43f4-802e-9d5ecb351179 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:36.909464 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938eaec-1768-43f4-802e-9d5ecb351179 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:36.924544 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938eaec-1768-43f4-802e-9d5ecb351179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:36.930240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9938eaec-1768-43f4-802e-9d5ecb351179 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:36.930240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:36.930240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:36.930240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:36.930240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:36.930240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:36.930240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:36.930240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:36.930240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:36.930240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:36.930240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:36.930240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:36.930240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:36.930240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:36.930240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:36.930240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:36.931080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:36.931080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:36.931080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:36.931080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:36.931080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:36.931080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:36.931080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:36.931080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:36.931080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:36.931080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:36.931080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:36.931080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:36.931080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:36.931080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:36.931080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:36.931080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:36.931861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:36.931861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:36.931861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:36.931861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:36.931861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:36.931861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:36.931861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:36.931861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:36.931861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:36.931861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:36.931861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:36.931861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:36.934496 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 80/168] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:36.941073 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938eaec-1768-43f4-802e-9d5ecb351179 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:36.997365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:37.028860 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:37.037481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43105940-af29-45e9-aae8-fa22826051e0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:37.050414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938eaec-1768-43f4-802e-9d5ecb351179 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:37.076874 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e8db0-e144-421d-9cf0-efc330c9c53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:37.077514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e8db0-e144-421d-9cf0-efc330c9c53e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:37.077806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e8db0-e144-421d-9cf0-efc330c9c53e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:37.078058 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e8db0-e144-421d-9cf0-efc330c9c53e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:37.079324 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e8db0-e144-421d-9cf0-efc330c9c53e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:37.080856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e8db0-e144-421d-9cf0-efc330c9c53e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:37.084086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 89/169] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:11:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:37.084086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e8db0-e144-421d-9cf0-efc330c9c53e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:37.092824 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa85bfe-6abb-47d5-b097-09690f71af6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:37.093429 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa85bfe-6abb-47d5-b097-09690f71af6d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:37.093708 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa85bfe-6abb-47d5-b097-09690f71af6d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:37.093977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa85bfe-6abb-47d5-b097-09690f71af6d None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:37.094645 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa85bfe-6abb-47d5-b097-09690f71af6d None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:37.094949 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa85bfe-6abb-47d5-b097-09690f71af6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:37.096799 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa85bfe-6abb-47d5-b097-09690f71af6d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:37.107208 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 81/170] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:37.107913 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa85bfe-6abb-47d5-b097-09690f71af6d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:37.194340 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e8db0-e144-421d-9cf0-efc330c9c53e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:37.213215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa85bfe-6abb-47d5-b097-09690f71af6d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:37.226156 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:37.227951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ebe99-fb8a-4df4-8284-b35e74a12f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:37.228612 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ebe99-fb8a-4df4-8284-b35e74a12f55 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:37.228895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ebe99-fb8a-4df4-8284-b35e74a12f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:37.229170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ebe99-fb8a-4df4-8284-b35e74a12f55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:37.240074 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ebe99-fb8a-4df4-8284-b35e74a12f55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:37.244921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-902ebe99-fb8a-4df4-8284-b35e74a12f55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:11:37.244921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:37.244921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:37.244921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:37.244921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:37.244921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:37.244921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:37.244921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:37.244921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:37.244921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:37.244921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:37.244921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:37.244921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:37.244921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:37.244921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:37.244921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:37.245782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:37.245782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:37.245782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:37.245782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:37.245782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:37.245782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:37.245782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:37.245782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:37.245782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:37.245782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:37.245782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:37.245782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:37.245782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:37.245782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:37.245782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:37.245782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:37.247280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:37.247280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:37.247280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:37.247280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:37.247280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:37.247280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:37.247280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:37.247280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:37.247280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:37.247280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:37.247280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:11:37.247280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:37.247280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 90/171] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:11:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:37.247280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ebe99-fb8a-4df4-8284-b35e74a12f55 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:37.250156 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87788375-526c-451f-a78d-b5760e50c079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:37.250761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87788375-526c-451f-a78d-b5760e50c079 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:37.251035 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87788375-526c-451f-a78d-b5760e50c079 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:37.251398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87788375-526c-451f-a78d-b5760e50c079 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:37.252078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87788375-526c-451f-a78d-b5760e50c079 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:37.253528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87788375-526c-451f-a78d-b5760e50c079 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:37.273427 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:37.273761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 82/172] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:11:37 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:11:37.274569 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87788375-526c-451f-a78d-b5760e50c079 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:37.368890 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ebe99-fb8a-4df4-8284-b35e74a12f55 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:37.391855 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87788375-526c-451f-a78d-b5760e50c079 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:37.408953 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d2f29-52ff-4cce-808b-d0093a59587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:37.409792 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d2f29-52ff-4cce-808b-d0093a59587f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:37.410087 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d2f29-52ff-4cce-808b-d0093a59587f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:37.410368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d2f29-52ff-4cce-808b-d0093a59587f None admin] PATH_INFO: `/v3/users/602bb058b7474682a713f8352644090c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:37.428372 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eadd40-04df-4100-8661-6ad137fb9c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:37.428987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d2f29-52ff-4cce-808b-d0093a59587f None admin] RBAC: Authorizing `identity:get_user(user_id=602bb058b7474682a713f8352644090c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:37.429093 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eadd40-04df-4100-8661-6ad137fb9c01 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:37.429284 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eadd40-04df-4100-8661-6ad137fb9c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:37.429558 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eadd40-04df-4100-8661-6ad137fb9c01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:37.430543 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d2f29-52ff-4cce-808b-d0093a59587f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:37.437657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 91/173] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:37 2022] GET /identity/v3/users/602bb058b7474682a713f8352644090c => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:37.437657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d2f29-52ff-4cce-808b-d0093a59587f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:37.443295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eadd40-04df-4100-8661-6ad137fb9c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:37.448814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e8eadd40-04df-4100-8661-6ad137fb9c01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:11:37.448814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:37.448814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:37.448814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:37.448814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:37.448814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:37.448814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:37.448814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:37.448814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:37.448814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:37.448814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:37.448814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:37.448814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:37.448814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:37.448814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:37.448814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:37.449655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:37.449655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:37.449655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:37.449655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:37.449655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:37.449655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:37.449655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:37.449655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:37.449655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:37.449655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:37.449655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:37.449655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:37.449655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:37.449655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:37.449655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:37.449655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:37.451804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:37.451804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:37.451804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:37.451804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:37.451804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:37.451804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:37.451804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:37.451804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:37.451804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:37.451804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:37.451804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:11:37.451804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:37.451804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 83/174] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 17 10:11:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:37.451804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eadd40-04df-4100-8661-6ad137fb9c01 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:37.485862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:37.543239 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:37.572063 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d2f29-52ff-4cce-808b-d0093a59587f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:37.572963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eadd40-04df-4100-8661-6ad137fb9c01 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:37.611114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef165d-1a60-4cc1-8c0c-540aaacf9cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:37.611727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef165d-1a60-4cc1-8c0c-540aaacf9cbb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:37.612070 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef165d-1a60-4cc1-8c0c-540aaacf9cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:37.612350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef165d-1a60-4cc1-8c0c-540aaacf9cbb None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:37.613016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef165d-1a60-4cc1-8c0c-540aaacf9cbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:37.613319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef165d-1a60-4cc1-8c0c-540aaacf9cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:37.614736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef165d-1a60-4cc1-8c0c-540aaacf9cbb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:37.617745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6576d-92f7-487c-9a29-41af7ea0265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:37.618608 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6576d-92f7-487c-9a29-41af7ea0265c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:37.619064 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6576d-92f7-487c-9a29-41af7ea0265c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:37.619520 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6576d-92f7-487c-9a29-41af7ea0265c None admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:37.621662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6576d-92f7-487c-9a29-41af7ea0265c None admin] RBAC: Authorizing `identity:get_project(project_id=59dbb475fe1d46689ba2116ba560199f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:37.623807 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 92/175] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:37.624338 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6576d-92f7-487c-9a29-41af7ea0265c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:37.624532 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef165d-1a60-4cc1-8c0c-540aaacf9cbb None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:37.626427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 84/176] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:37 2022] GET /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:37.629572 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6576d-92f7-487c-9a29-41af7ea0265c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:37.749052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef165d-1a60-4cc1-8c0c-540aaacf9cbb None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:37.749903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:37.754058 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6576d-92f7-487c-9a29-41af7ea0265c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:37.794514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de64eeb-e69e-4f40-ab52-cbc922c532ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:37.795273 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de64eeb-e69e-4f40-ab52-cbc922c532ef None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:37.795557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de64eeb-e69e-4f40-ab52-cbc922c532ef None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:37.795830 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de64eeb-e69e-4f40-ab52-cbc922c532ef None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:37.796722 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de64eeb-e69e-4f40-ab52-cbc922c532ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:37.796948 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de64eeb-e69e-4f40-ab52-cbc922c532ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:37.798336 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de64eeb-e69e-4f40-ab52-cbc922c532ef None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:37.802014 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055723a3-f8b3-453f-8109-28f2d1dbe0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:37.802896 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055723a3-f8b3-453f-8109-28f2d1dbe0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:37.803390 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055723a3-f8b3-453f-8109-28f2d1dbe0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:37.803875 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055723a3-f8b3-453f-8109-28f2d1dbe0b1 None admin] PATH_INFO: `/v3/users/15e458ea10484360b22cc7b296f4c282` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:37.805255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055723a3-f8b3-453f-8109-28f2d1dbe0b1 None admin] RBAC: Authorizing `identity:get_user(user_id=15e458ea10484360b22cc7b296f4c282)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:37.807139 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 93/177] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:11:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:37.807378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055723a3-f8b3-453f-8109-28f2d1dbe0b1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:37.809554 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 85/178] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:37 2022] GET /identity/v3/users/15e458ea10484360b22cc7b296f4c282 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:37.816106 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de64eeb-e69e-4f40-ab52-cbc922c532ef None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:37.816253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055723a3-f8b3-453f-8109-28f2d1dbe0b1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:37.826806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:37.921190 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055723a3-f8b3-453f-8109-28f2d1dbe0b1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:37.932288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de64eeb-e69e-4f40-ab52-cbc922c532ef None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:37.956892 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8960a-ca34-468f-803e-7711eba5d630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:37.957626 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8960a-ca34-468f-803e-7711eba5d630 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:37.957977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8960a-ca34-468f-803e-7711eba5d630 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:37.958333 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8960a-ca34-468f-803e-7711eba5d630 None admin] PATH_INFO: `/v3/users/15e458ea10484360b22cc7b296f4c282` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:37.959551 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8960a-ca34-468f-803e-7711eba5d630 None admin] RBAC: Authorizing `identity:get_user(user_id=15e458ea10484360b22cc7b296f4c282)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:37.961099 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8960a-ca34-468f-803e-7711eba5d630 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:37.963066 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 86/179] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:37 2022] GET /identity/v3/users/15e458ea10484360b22cc7b296f4c282 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:37.964418 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8960a-ca34-468f-803e-7711eba5d630 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:37.976448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f45ad3-15ef-4a2b-9e1b-f0da8e0629f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:37.977229 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f45ad3-15ef-4a2b-9e1b-f0da8e0629f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:37.977577 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f45ad3-15ef-4a2b-9e1b-f0da8e0629f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:37.977924 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f45ad3-15ef-4a2b-9e1b-f0da8e0629f2 None admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f/users/602bb058b7474682a713f8352644090c/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:37.980244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f45ad3-15ef-4a2b-9e1b-f0da8e0629f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=59dbb475fe1d46689ba2116ba560199f, user_id=602bb058b7474682a713f8352644090c, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:37.981776 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f45ad3-15ef-4a2b-9e1b-f0da8e0629f2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:37.998485 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 94/180] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:11:37 2022] PUT /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f/users/602bb058b7474682a713f8352644090c/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:11:37.999571 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f45ad3-15ef-4a2b-9e1b-f0da8e0629f2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:38.010373 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:38.125806 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8960a-ca34-468f-803e-7711eba5d630 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:38.179440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:38.204276 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76adf3f-bb6e-4b2b-8aae-d047654f3fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:38.205238 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76adf3f-bb6e-4b2b-8aae-d047654f3fcd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:38.205521 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76adf3f-bb6e-4b2b-8aae-d047654f3fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:38.205797 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76adf3f-bb6e-4b2b-8aae-d047654f3fcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:38.228273 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f45ad3-15ef-4a2b-9e1b-f0da8e0629f2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:38.267028 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241fc58-b8b2-4489-ba85-09a0cde77abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:38.267681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241fc58-b8b2-4489-ba85-09a0cde77abb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:38.268001 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241fc58-b8b2-4489-ba85-09a0cde77abb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:38.268283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241fc58-b8b2-4489-ba85-09a0cde77abb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:38.286683 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76adf3f-bb6e-4b2b-8aae-d047654f3fcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:38.288263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76adf3f-bb6e-4b2b-8aae-d047654f3fcd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:38.327243 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:38.371584 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241fc58-b8b2-4489-ba85-09a0cde77abb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:38.373748 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241fc58-b8b2-4489-ba85-09a0cde77abb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:38.399102 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 87/181] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:11:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:11:38.407955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76adf3f-bb6e-4b2b-8aae-d047654f3fcd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:38.538114 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76adf3f-bb6e-4b2b-8aae-d047654f3fcd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:38.541191 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:38.575171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5532fa-04ee-4cf9-9e80-0d1828424763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:38.575806 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5532fa-04ee-4cf9-9e80-0d1828424763 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:38.576118 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5532fa-04ee-4cf9-9e80-0d1828424763 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:38.576453 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5532fa-04ee-4cf9-9e80-0d1828424763 None admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:38.578060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5532fa-04ee-4cf9-9e80-0d1828424763 None admin] RBAC: Authorizing `identity:get_project(project_id=59dbb475fe1d46689ba2116ba560199f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:38.579696 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5532fa-04ee-4cf9-9e80-0d1828424763 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:38.581857 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 88/182] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:38 2022] GET /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:38.587718 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5532fa-04ee-4cf9-9e80-0d1828424763 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:38.596029 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:38.626755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 95/183] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:11:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:11:38.632846 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241fc58-b8b2-4489-ba85-09a0cde77abb None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:38.771546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5532fa-04ee-4cf9-9e80-0d1828424763 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:38.793173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241fc58-b8b2-4489-ba85-09a0cde77abb None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:38.833932 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2466f52-a0f6-4b18-8b49-aa08cd1feb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:38.834547 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2466f52-a0f6-4b18-8b49-aa08cd1feb3b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:38.834828 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2466f52-a0f6-4b18-8b49-aa08cd1feb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:38.835148 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2466f52-a0f6-4b18-8b49-aa08cd1feb3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:38.835884 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2466f52-a0f6-4b18-8b49-aa08cd1feb3b None admin] RBAC: Adding query filter params (role.id=5e3dfffec8aa470fab9232cc439aec74, scope.project.id=59dbb475fe1d46689ba2116ba560199f, user.id=15e458ea10484360b22cc7b296f4c282) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:38.836214 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2466f52-a0f6-4b18-8b49-aa08cd1feb3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:38.837678 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2466f52-a0f6-4b18-8b49-aa08cd1feb3b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:38.846228 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 89/184] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:11:38 2022] GET /identity/v3/role_assignments?user.id=15e458ea10484360b22cc7b296f4c282&scope.project.id=59dbb475fe1d46689ba2116ba560199f&role.id=5e3dfffec8aa470fab9232cc439aec74 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:38.867767 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad976ab-67b5-4bfa-874b-d11d40b098e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:38.868470 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad976ab-67b5-4bfa-874b-d11d40b098e1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:38.868750 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad976ab-67b5-4bfa-874b-d11d40b098e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:38.869024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad976ab-67b5-4bfa-874b-d11d40b098e1 None admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:38.870265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad976ab-67b5-4bfa-874b-d11d40b098e1 None admin] RBAC: Authorizing `identity:get_project(project_id=59dbb475fe1d46689ba2116ba560199f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:38.871764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad976ab-67b5-4bfa-874b-d11d40b098e1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:38.873620 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 96/185] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:38 2022] GET /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:38.880037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2466f52-a0f6-4b18-8b49-aa08cd1feb3b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:38.973710 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:39.014072 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2466f52-a0f6-4b18-8b49-aa08cd1feb3b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:39.052126 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c045de-7dc6-4949-99c9-0cf2d74cd00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:39.052655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c045de-7dc6-4949-99c9-0cf2d74cd00a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:39.052938 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c045de-7dc6-4949-99c9-0cf2d74cd00a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:39.053217 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c045de-7dc6-4949-99c9-0cf2d74cd00a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:39.053955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c045de-7dc6-4949-99c9-0cf2d74cd00a None admin] RBAC: Adding query filter params (role.id=b76852b6c05a46a9b493c465fd3441a3, scope.project.id=59dbb475fe1d46689ba2116ba560199f, user.id=15e458ea10484360b22cc7b296f4c282) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:39.054265 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c045de-7dc6-4949-99c9-0cf2d74cd00a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:39.055721 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c045de-7dc6-4949-99c9-0cf2d74cd00a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:39.071973 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 90/186] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:11:38 2022] GET /identity/v3/role_assignments?user.id=15e458ea10484360b22cc7b296f4c282&scope.project.id=59dbb475fe1d46689ba2116ba560199f&role.id=b76852b6c05a46a9b493c465fd3441a3 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:39.693959 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efdf65-99fe-4e6c-a778-9020a337717e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:39.694498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efdf65-99fe-4e6c-a778-9020a337717e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:39.694498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efdf65-99fe-4e6c-a778-9020a337717e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:39.695862 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 97/187] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:39.701149 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53863ce1-9c5e-49cb-ab43-582144e9765b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:39.702030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53863ce1-9c5e-49cb-ab43-582144e9765b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:39.702241 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53863ce1-9c5e-49cb-ab43-582144e9765b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:39.721324 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-53863ce1-9c5e-49cb-ab43-582144e9765b None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:39.722569 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-53863ce1-9c5e-49cb-ab43-582144e9765b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:39.794256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 91/188] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:39.846425 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f09a8-b108-4349-830b-7fbfc3e5637c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:39.846709 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f09a8-b108-4349-830b-7fbfc3e5637c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:39.847153 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f09a8-b108-4349-830b-7fbfc3e5637c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:39.848538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 98/189] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:39.853791 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb3466-aa06-4d79-b410-cbae4236ced7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:39.854100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb3466-aa06-4d79-b410-cbae4236ced7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:39.854430 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb3466-aa06-4d79-b410-cbae4236ced7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:39.872523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5acb3466-aa06-4d79-b410-cbae4236ced7 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:39.874187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5acb3466-aa06-4d79-b410-cbae4236ced7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:39.929094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:39.941440 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 92/190] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:40.066871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f09a8-b108-4349-830b-7fbfc3e5637c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:40.103283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:40.172527 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f09a8-b108-4349-830b-7fbfc3e5637c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:40.204287 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb3466-aa06-4d79-b410-cbae4236ced7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:40.207198 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca8c4c-f085-477c-b970-167feb3a1111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:40.208704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca8c4c-f085-477c-b970-167feb3a1111 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:40.208989 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca8c4c-f085-477c-b970-167feb3a1111 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:40.209264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca8c4c-f085-477c-b970-167feb3a1111 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:40.220977 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca8c4c-f085-477c-b970-167feb3a1111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:40.225805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d4ca8c4c-f085-477c-b970-167feb3a1111 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 10:11:40.225805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:40.225805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:40.225805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:40.225805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:40.225805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:40.225805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:40.225805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:40.225805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:40.225805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:40.225805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:40.225805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:40.225805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:40.225805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:40.225805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:40.225805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:40.226692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:40.226692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:40.226692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:40.226692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:40.226692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:40.226692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:40.226692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:40.226692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:40.226692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:40.226692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:40.226692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:40.226692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:40.226692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:40.226692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:40.226692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:40.226692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:40.227538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:40.227538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:40.227538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:40.227538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:40.227538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:40.227538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:40.227538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:40.227538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:40.227538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:40.227538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:40.227538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 10:11:40.227538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:40.227538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 99/191] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:40.233401 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca8c4c-f085-477c-b970-167feb3a1111 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:40.308476 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb3466-aa06-4d79-b410-cbae4236ced7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:40.328723 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:40.336322 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca8c4c-f085-477c-b970-167feb3a1111 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:40.345485 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57315326-fb3c-4adb-831f-6a32ce62ab4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:40.346134 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57315326-fb3c-4adb-831f-6a32ce62ab4f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:40.346414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57315326-fb3c-4adb-831f-6a32ce62ab4f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:40.346683 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57315326-fb3c-4adb-831f-6a32ce62ab4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:40.347860 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57315326-fb3c-4adb-831f-6a32ce62ab4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:40.349405 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57315326-fb3c-4adb-831f-6a32ce62ab4f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:40.351187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 93/192] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:11:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:40.357204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57315326-fb3c-4adb-831f-6a32ce62ab4f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:40.374748 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffdaab-7760-4b93-9b6a-09341cd3e2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:40.375382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffdaab-7760-4b93-9b6a-09341cd3e2be None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:40.375662 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffdaab-7760-4b93-9b6a-09341cd3e2be None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:40.375972 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffdaab-7760-4b93-9b6a-09341cd3e2be None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:40.376656 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffdaab-7760-4b93-9b6a-09341cd3e2be None admin] RBAC: Adding query filter params (name=reader) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:40.376963 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffdaab-7760-4b93-9b6a-09341cd3e2be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:40.378391 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffdaab-7760-4b93-9b6a-09341cd3e2be None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:40.388337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 100/193] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:40.393922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffdaab-7760-4b93-9b6a-09341cd3e2be None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:40.427724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:40.474632 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57315326-fb3c-4adb-831f-6a32ce62ab4f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:40.502485 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffdaab-7760-4b93-9b6a-09341cd3e2be None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:40.508234 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162670b-3216-4e1d-8270-072753547521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:40.508832 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162670b-3216-4e1d-8270-072753547521 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:40.509109 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162670b-3216-4e1d-8270-072753547521 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:40.509376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162670b-3216-4e1d-8270-072753547521 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:40.510018 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162670b-3216-4e1d-8270-072753547521 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:40.511465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162670b-3216-4e1d-8270-072753547521 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:40.532074 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 94/194] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:11:40 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:11:40.533269 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b922816-043b-416a-87c8-340b1615d5ee None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:40.533554 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b922816-043b-416a-87c8-340b1615d5ee None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:40.533826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b922816-043b-416a-87c8-340b1615d5ee None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:40.535036 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 95/195] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:40.540894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052efe66-d5dd-473c-91c8-d34891aa5ace None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:40.541185 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052efe66-d5dd-473c-91c8-d34891aa5ace None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:40.541456 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052efe66-d5dd-473c-91c8-d34891aa5ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:40.549171 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a9288-146d-4cdc-96a5-41f7603176d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:40.549833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a9288-146d-4cdc-96a5-41f7603176d3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:40.550118 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a9288-146d-4cdc-96a5-41f7603176d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:40.550392 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a9288-146d-4cdc-96a5-41f7603176d3 None admin] PATH_INFO: `/v3/users/905d5b2e4a6d4b4f94695333a008c6b6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:40.562187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-052efe66-d5dd-473c-91c8-d34891aa5ace None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:40.563427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-052efe66-d5dd-473c-91c8-d34891aa5ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:40.566094 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a9288-146d-4cdc-96a5-41f7603176d3 None admin] RBAC: Authorizing `identity:get_user(user_id=905d5b2e4a6d4b4f94695333a008c6b6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:40.567593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a9288-146d-4cdc-96a5-41f7603176d3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:40.569535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 101/196] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:40 2022] GET /identity/v3/users/905d5b2e4a6d4b4f94695333a008c6b6 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:40.575113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a9288-146d-4cdc-96a5-41f7603176d3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:40.593241 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:40.642124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 96/197] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:40.690262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a9288-146d-4cdc-96a5-41f7603176d3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:40.727690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce17c4-1293-4a15-a92f-e01b3ce54a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:40.728369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce17c4-1293-4a15-a92f-e01b3ce54a60 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:40.728673 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce17c4-1293-4a15-a92f-e01b3ce54a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:40.728954 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce17c4-1293-4a15-a92f-e01b3ce54a60 None admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:40.730361 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce17c4-1293-4a15-a92f-e01b3ce54a60 None admin] RBAC: Authorizing `identity:get_project(project_id=59dbb475fe1d46689ba2116ba560199f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:40.731831 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce17c4-1293-4a15-a92f-e01b3ce54a60 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:40.733902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 102/198] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:40 2022] GET /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:40.739597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052efe66-d5dd-473c-91c8-d34891aa5ace None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:40.790844 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:40.849772 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052efe66-d5dd-473c-91c8-d34891aa5ace None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:40.890211 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f492dd8-d026-453a-b3d9-b40933816eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:40.890878 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f492dd8-d026-453a-b3d9-b40933816eb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:40.891157 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f492dd8-d026-453a-b3d9-b40933816eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:40.891430 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f492dd8-d026-453a-b3d9-b40933816eb2 None admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f/users/905d5b2e4a6d4b4f94695333a008c6b6/roles/42fcdd5fbf1e4056bd623ff078b31886` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:40.893405 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f492dd8-d026-453a-b3d9-b40933816eb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=59dbb475fe1d46689ba2116ba560199f, user_id=905d5b2e4a6d4b4f94695333a008c6b6, role_id=42fcdd5fbf1e4056bd623ff078b31886)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:40.894925 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f492dd8-d026-453a-b3d9-b40933816eb2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:40.911335 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 97/199] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:11:40 2022] PUT /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f/users/905d5b2e4a6d4b4f94695333a008c6b6/roles/42fcdd5fbf1e4056bd623ff078b31886 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:11:40.916038 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce17c4-1293-4a15-a92f-e01b3ce54a60 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:41.018328 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:41.041196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce17c4-1293-4a15-a92f-e01b3ce54a60 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:41.081840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101891eb-9cde-4055-9656-0cb5cf018179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:41.082506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101891eb-9cde-4055-9656-0cb5cf018179 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:41.082788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101891eb-9cde-4055-9656-0cb5cf018179 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:41.083062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101891eb-9cde-4055-9656-0cb5cf018179 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:41.095360 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101891eb-9cde-4055-9656-0cb5cf018179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:41.100629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-101891eb-9cde-4055-9656-0cb5cf018179 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:41.100629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:41.100629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:41.100629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:41.100629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:41.100629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:41.100629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:41.100629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:41.100629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:41.100629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:41.100629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:41.100629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:41.100629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:41.100629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:41.100629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:41.100629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:41.101489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:41.101489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:41.101489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:41.101489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:41.101489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:41.101489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:41.101489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:41.101489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:41.101489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:41.101489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:41.101489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:41.101489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:41.101489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:41.101489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:41.101489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:41.101489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:41.102265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:41.102265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:41.102265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:41.102265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:41.102265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:41.102265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:41.102265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:41.102265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:41.102265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:41.102265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:41.102265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:41.102265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:41.104263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 103/200] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:41.108451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f492dd8-d026-453a-b3d9-b40933816eb2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:41.217817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f492dd8-d026-453a-b3d9-b40933816eb2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:41.220232 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:41.254186 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69bad0-018c-4c69-a0ba-5234f7801576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:41.254791 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69bad0-018c-4c69-a0ba-5234f7801576 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:41.255064 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69bad0-018c-4c69-a0ba-5234f7801576 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:41.255332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69bad0-018c-4c69-a0ba-5234f7801576 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:41.256022 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69bad0-018c-4c69-a0ba-5234f7801576 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:41.256328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69bad0-018c-4c69-a0ba-5234f7801576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:41.257751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69bad0-018c-4c69-a0ba-5234f7801576 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:41.266705 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 98/201] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:41.273236 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101891eb-9cde-4055-9656-0cb5cf018179 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:41.377987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101891eb-9cde-4055-9656-0cb5cf018179 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:41.413235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbf844-ea5e-429a-be0d-23f586c4a003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:41.413879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbf844-ea5e-429a-be0d-23f586c4a003 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:41.414162 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbf844-ea5e-429a-be0d-23f586c4a003 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:41.414441 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbf844-ea5e-429a-be0d-23f586c4a003 None admin] PATH_INFO: `/v3/users/602bb058b7474682a713f8352644090c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:41.415616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbf844-ea5e-429a-be0d-23f586c4a003 None admin] RBAC: Authorizing `identity:get_user(user_id=602bb058b7474682a713f8352644090c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:41.417110 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbf844-ea5e-429a-be0d-23f586c4a003 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:41.422448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 104/202] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:41 2022] GET /identity/v3/users/602bb058b7474682a713f8352644090c => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:41.425026 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69bad0-018c-4c69-a0ba-5234f7801576 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:41.529890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69bad0-018c-4c69-a0ba-5234f7801576 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:41.563836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15653af-fafd-4093-a3c0-a51684289f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:41.564489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15653af-fafd-4093-a3c0-a51684289f26 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:41.564768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15653af-fafd-4093-a3c0-a51684289f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:41.565036 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15653af-fafd-4093-a3c0-a51684289f26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:41.608293 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:41.637804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15653af-fafd-4093-a3c0-a51684289f26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:41.639249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15653af-fafd-4093-a3c0-a51684289f26 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:41.741359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 99/203] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:11:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:11:41.747190 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbf844-ea5e-429a-be0d-23f586c4a003 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:41.760308 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:41.853583 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbf844-ea5e-429a-be0d-23f586c4a003 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:41.888007 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edc29e-b5b4-42f0-90dd-32da4638d24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:41.889113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edc29e-b5b4-42f0-90dd-32da4638d24f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:41.889411 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edc29e-b5b4-42f0-90dd-32da4638d24f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:41.889686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edc29e-b5b4-42f0-90dd-32da4638d24f None admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:41.890989 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edc29e-b5b4-42f0-90dd-32da4638d24f None admin] RBAC: Authorizing `identity:get_project(project_id=59dbb475fe1d46689ba2116ba560199f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:41.892557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edc29e-b5b4-42f0-90dd-32da4638d24f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:41.899037 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 105/204] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:41 2022] GET /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:41.901019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15653af-fafd-4093-a3c0-a51684289f26 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:41.966123 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:42.001015 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15653af-fafd-4093-a3c0-a51684289f26 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:42.034673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa66e5-29a6-4b99-a7b3-3395e40a43da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:42.035277 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa66e5-29a6-4b99-a7b3-3395e40a43da None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:42.035553 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa66e5-29a6-4b99-a7b3-3395e40a43da None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:42.035825 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa66e5-29a6-4b99-a7b3-3395e40a43da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:42.036582 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa66e5-29a6-4b99-a7b3-3395e40a43da None admin] RBAC: Adding query filter params (role.id=5d2fc6de54204986a2c3aedc42288813, scope.project.id=59dbb475fe1d46689ba2116ba560199f, user.id=602bb058b7474682a713f8352644090c) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:42.036889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa66e5-29a6-4b99-a7b3-3395e40a43da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:42.038329 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa66e5-29a6-4b99-a7b3-3395e40a43da None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:42.044537 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 100/205] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:11:41 2022] GET /identity/v3/role_assignments?user.id=602bb058b7474682a713f8352644090c&scope.project.id=59dbb475fe1d46689ba2116ba560199f&role.id=5d2fc6de54204986a2c3aedc42288813 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:42.896040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1355af7-920e-4cd2-a2d4-06abc7cb1937 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:42.896555 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1355af7-920e-4cd2-a2d4-06abc7cb1937 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:42.896661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1355af7-920e-4cd2-a2d4-06abc7cb1937 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:42.898080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 106/206] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:42.903191 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73766e0-bdb8-4496-ac2d-a581963c5cd7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:42.903563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73766e0-bdb8-4496-ac2d-a581963c5cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:42.903740 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73766e0-bdb8-4496-ac2d-a581963c5cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:42.923243 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b73766e0-bdb8-4496-ac2d-a581963c5cd7 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:42.924473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b73766e0-bdb8-4496-ac2d-a581963c5cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:42.976148 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadeeb3-a16f-40ac-b969-77a4df588a6f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:42.976433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadeeb3-a16f-40ac-b969-77a4df588a6f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:42.976713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadeeb3-a16f-40ac-b969-77a4df588a6f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:42.978191 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 107/207] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:42.983508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff34720-c645-40c9-9fd9-55b8eb87b7c5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:42.983794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff34720-c645-40c9-9fd9-55b8eb87b7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:42.984120 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff34720-c645-40c9-9fd9-55b8eb87b7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:42.995303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 101/208] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:43.006297 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8ff34720-c645-40c9-9fd9-55b8eb87b7c5 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:43.007533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8ff34720-c645-40c9-9fd9-55b8eb87b7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:43.088236 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 108/209] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:11:43.123718 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927fbea-53f0-4524-8279-11819ce20711 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:43.124034 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927fbea-53f0-4524-8279-11819ce20711 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:43.124314 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927fbea-53f0-4524-8279-11819ce20711 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:43.125790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 102/210] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:43.130735 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb201ce-2dac-4f0d-bc7d-6dac690f27ab None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:43.131023 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb201ce-2dac-4f0d-bc7d-6dac690f27ab None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:43.131301 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb201ce-2dac-4f0d-bc7d-6dac690f27ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:43.149707 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7bb201ce-2dac-4f0d-bc7d-6dac690f27ab None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:43.150798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7bb201ce-2dac-4f0d-bc7d-6dac690f27ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:43.152719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:43.218328 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 109/211] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:43.269979 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927fbea-53f0-4524-8279-11819ce20711 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:43.331351 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:43.354284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb201ce-2dac-4f0d-bc7d-6dac690f27ab None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:43.379594 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927fbea-53f0-4524-8279-11819ce20711 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:43.423644 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffad5c-9fc6-43c6-9248-f962334782d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:43.424404 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffad5c-9fc6-43c6-9248-f962334782d8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:43.424676 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffad5c-9fc6-43c6-9248-f962334782d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:43.424943 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffad5c-9fc6-43c6-9248-f962334782d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:43.436987 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffad5c-9fc6-43c6-9248-f962334782d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:43.441724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-14ffad5c-9fc6-43c6-9248-f962334782d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:43.441724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:43.441724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:43.441724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:43.441724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:43.441724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:43.441724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:43.441724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:43.441724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:43.441724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:43.441724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:43.441724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:43.441724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:43.441724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:43.441724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:43.441724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:43.442777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:43.442777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:43.442777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:43.442777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:43.442777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:43.442777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:43.442777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:43.442777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:43.442777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:43.442777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:43.442777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:43.442777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:43.442777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:43.442777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:43.442777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:43.442777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:43.443667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:43.443667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:43.443667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:43.443667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:43.443667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:43.443667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:43.443667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:43.443667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:43.443667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:43.443667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:43.443667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:43.443667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:43.443667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 103/212] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:43.448543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffad5c-9fc6-43c6-9248-f962334782d8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:43.461850 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb201ce-2dac-4f0d-bc7d-6dac690f27ab None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:43.497722 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb839d-4e0a-4115-b5f3-05e38033b26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:43.498876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb839d-4e0a-4115-b5f3-05e38033b26b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:43.499157 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb839d-4e0a-4115-b5f3-05e38033b26b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:43.499433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb839d-4e0a-4115-b5f3-05e38033b26b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:43.500566 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb839d-4e0a-4115-b5f3-05e38033b26b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:43.502024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb839d-4e0a-4115-b5f3-05e38033b26b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:43.503604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 110/213] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:11:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:43.504397 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb839d-4e0a-4115-b5f3-05e38033b26b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:43.516285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:43.549193 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffad5c-9fc6-43c6-9248-f962334782d8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:43.568564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:43.583623 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ec25f-6612-4f01-80f4-a66e58686841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:43.584269 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ec25f-6612-4f01-80f4-a66e58686841 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:43.584556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ec25f-6612-4f01-80f4-a66e58686841 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:43.585191 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ec25f-6612-4f01-80f4-a66e58686841 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:43.585863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ec25f-6612-4f01-80f4-a66e58686841 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:43.586486 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ec25f-6612-4f01-80f4-a66e58686841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:43.587863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ec25f-6612-4f01-80f4-a66e58686841 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:43.596839 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 104/214] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:43.597526 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ec25f-6612-4f01-80f4-a66e58686841 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:43.609723 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb839d-4e0a-4115-b5f3-05e38033b26b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:43.644333 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a0bdd-dc8f-48dc-933b-ba2709e3a535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:43.644952 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a0bdd-dc8f-48dc-933b-ba2709e3a535 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:43.645227 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a0bdd-dc8f-48dc-933b-ba2709e3a535 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:43.645492 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a0bdd-dc8f-48dc-933b-ba2709e3a535 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:43.655747 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a0bdd-dc8f-48dc-933b-ba2709e3a535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:43.660530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c75a0bdd-dc8f-48dc-933b-ba2709e3a535 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 10:11:43.660530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:43.660530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:43.660530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:43.660530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:43.660530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:43.660530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:43.660530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:43.660530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:43.660530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:43.660530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:43.660530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:43.660530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:43.660530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:43.660530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:43.660530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:43.661450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:43.661450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:43.661450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:43.661450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:43.661450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:43.661450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:43.661450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:43.661450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:43.661450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:43.661450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:43.661450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:43.661450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:43.661450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:43.661450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:43.661450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:43.661450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:43.662474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:43.662474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:43.662474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:43.662474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:43.662474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:43.662474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:43.662474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:43.662474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:43.662474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:43.662474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:43.662474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 10:11:43.662474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:43.662474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 111/215] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:43.662474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a0bdd-dc8f-48dc-933b-ba2709e3a535 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:43.699740 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ec25f-6612-4f01-80f4-a66e58686841 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:43.728635 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:43.736895 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70ff4f-5684-43d0-b754-aaac1efd58ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:43.737497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70ff4f-5684-43d0-b754-aaac1efd58ed None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:43.737778 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70ff4f-5684-43d0-b754-aaac1efd58ed None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:43.738049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70ff4f-5684-43d0-b754-aaac1efd58ed None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:43.738696 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70ff4f-5684-43d0-b754-aaac1efd58ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:43.740171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70ff4f-5684-43d0-b754-aaac1efd58ed None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:43.761953 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 105/216] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:11:43 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:11:43.776160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a0bdd-dc8f-48dc-933b-ba2709e3a535 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:43.776243 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70ff4f-5684-43d0-b754-aaac1efd58ed None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:43.801468 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666d5a3-30bd-4444-9d2c-5d299113842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:43.802172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666d5a3-30bd-4444-9d2c-5d299113842b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:43.802459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666d5a3-30bd-4444-9d2c-5d299113842b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:43.802740 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666d5a3-30bd-4444-9d2c-5d299113842b None admin] PATH_INFO: `/v3/users/99cdcb563990482599e8c5e903011417` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:43.812598 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:43.818218 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666d5a3-30bd-4444-9d2c-5d299113842b None admin] RBAC: Authorizing `identity:get_user(user_id=99cdcb563990482599e8c5e903011417)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:43.819756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666d5a3-30bd-4444-9d2c-5d299113842b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:43.821554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 112/217] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:43 2022] GET /identity/v3/users/99cdcb563990482599e8c5e903011417 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:43.827891 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666d5a3-30bd-4444-9d2c-5d299113842b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:43.886109 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70ff4f-5684-43d0-b754-aaac1efd58ed None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:43.926343 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c79063-8850-43e6-9dfe-26e554c0d630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:43.926998 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c79063-8850-43e6-9dfe-26e554c0d630 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:43.927355 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c79063-8850-43e6-9dfe-26e554c0d630 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:43.927541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c79063-8850-43e6-9dfe-26e554c0d630 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:43.928187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c79063-8850-43e6-9dfe-26e554c0d630 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:43.928494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c79063-8850-43e6-9dfe-26e554c0d630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:43.929951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c79063-8850-43e6-9dfe-26e554c0d630 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:43.938986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 106/218] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:43.944853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c79063-8850-43e6-9dfe-26e554c0d630 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:43.950394 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666d5a3-30bd-4444-9d2c-5d299113842b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:43.979759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:43.992900 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa172d-95a8-4da8-900a-42c591ae3150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:43.993538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa172d-95a8-4da8-900a-42c591ae3150 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:43.993813 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa172d-95a8-4da8-900a-42c591ae3150 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:43.994080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa172d-95a8-4da8-900a-42c591ae3150 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:43.994919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa172d-95a8-4da8-900a-42c591ae3150 None admin] RBAC: Adding query filter params (role.id=5d2fc6de54204986a2c3aedc42288813, user.id=99cdcb563990482599e8c5e903011417, scope.system=all) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:43.995224 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa172d-95a8-4da8-900a-42c591ae3150 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:43.997225 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa172d-95a8-4da8-900a-42c591ae3150 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:44.003483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 113/219] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Oct 17 10:11:43 2022] GET /identity/v3/role_assignments?user.id=99cdcb563990482599e8c5e903011417&scope.system=all&role.id=5d2fc6de54204986a2c3aedc42288813 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:44.071971 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c79063-8850-43e6-9dfe-26e554c0d630 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:44.075195 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:44.114281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bb6cc-9bb1-4bb5-8741-1c19e1ab5e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:44.114930 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bb6cc-9bb1-4bb5-8741-1c19e1ab5e0f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:44.115202 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bb6cc-9bb1-4bb5-8741-1c19e1ab5e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:44.115469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bb6cc-9bb1-4bb5-8741-1c19e1ab5e0f None admin] PATH_INFO: `/v3/users/905d5b2e4a6d4b4f94695333a008c6b6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:44.117602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bb6cc-9bb1-4bb5-8741-1c19e1ab5e0f None admin] RBAC: Authorizing `identity:get_user(user_id=905d5b2e4a6d4b4f94695333a008c6b6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:44.119075 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bb6cc-9bb1-4bb5-8741-1c19e1ab5e0f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:44.120801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 107/220] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:43 2022] GET /identity/v3/users/905d5b2e4a6d4b4f94695333a008c6b6 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:44.127431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa172d-95a8-4da8-900a-42c591ae3150 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:44.241555 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa172d-95a8-4da8-900a-42c591ae3150 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:44.278841 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2e346-a85f-4cd3-ba2f-9c1963b9f7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:44.280047 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2e346-a85f-4cd3-ba2f-9c1963b9f7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:44.280324 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2e346-a85f-4cd3-ba2f-9c1963b9f7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:44.280590 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2e346-a85f-4cd3-ba2f-9c1963b9f7a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:44.338753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:44.353405 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2e346-a85f-4cd3-ba2f-9c1963b9f7a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:44.355191 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2e346-a85f-4cd3-ba2f-9c1963b9f7a8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:44.459030 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 114/221] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:11:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:11:44.464461 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bb6cc-9bb1-4bb5-8741-1c19e1ab5e0f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:44.573308 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bb6cc-9bb1-4bb5-8741-1c19e1ab5e0f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:44.612475 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc67b9-ee97-4c89-b1c5-189494486aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:44.613453 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc67b9-ee97-4c89-b1c5-189494486aec None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:44.613937 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc67b9-ee97-4c89-b1c5-189494486aec None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:44.614410 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc67b9-ee97-4c89-b1c5-189494486aec None admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:44.615756 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc67b9-ee97-4c89-b1c5-189494486aec None admin] RBAC: Authorizing `identity:get_project(project_id=59dbb475fe1d46689ba2116ba560199f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:44.617454 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc67b9-ee97-4c89-b1c5-189494486aec None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:44.619313 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 108/222] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:44 2022] GET /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:44.631963 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2e346-a85f-4cd3-ba2f-9c1963b9f7a8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:44.720300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:44.734873 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2e346-a85f-4cd3-ba2f-9c1963b9f7a8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:44.771728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef1389-a344-4f3c-8ba4-271c1bcc022e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:44.772376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef1389-a344-4f3c-8ba4-271c1bcc022e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:44.772650 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef1389-a344-4f3c-8ba4-271c1bcc022e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:44.772920 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef1389-a344-4f3c-8ba4-271c1bcc022e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:44.773642 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef1389-a344-4f3c-8ba4-271c1bcc022e None admin] RBAC: Adding query filter params (role.id=42fcdd5fbf1e4056bd623ff078b31886, scope.project.id=59dbb475fe1d46689ba2116ba560199f, user.id=905d5b2e4a6d4b4f94695333a008c6b6) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:44.773947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef1389-a344-4f3c-8ba4-271c1bcc022e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:44.775394 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef1389-a344-4f3c-8ba4-271c1bcc022e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:44.781938 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 115/223] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:11:44 2022] GET /identity/v3/role_assignments?user.id=905d5b2e4a6d4b4f94695333a008c6b6&scope.project.id=59dbb475fe1d46689ba2116ba560199f&role.id=42fcdd5fbf1e4056bd623ff078b31886 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:46.108776 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defaac1-aaf9-473c-b0cf-62f443c7a1fb None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:46.109332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defaac1-aaf9-473c-b0cf-62f443c7a1fb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:46.109332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defaac1-aaf9-473c-b0cf-62f443c7a1fb None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:46.110762 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 109/224] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:46.116988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b414f3-d4a9-4e3a-b07f-eac013cf3be9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:46.117491 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b414f3-d4a9-4e3a-b07f-eac013cf3be9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:46.117593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b414f3-d4a9-4e3a-b07f-eac013cf3be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:46.137504 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-89b414f3-d4a9-4e3a-b07f-eac013cf3be9 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:46.139266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-89b414f3-d4a9-4e3a-b07f-eac013cf3be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:46.163193 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a02db7-23ca-4d60-bfa6-b0a98dda3096 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:46.163482 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a02db7-23ca-4d60-bfa6-b0a98dda3096 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:46.163758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a02db7-23ca-4d60-bfa6-b0a98dda3096 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:46.165144 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 110/225] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:11:46.171329 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ee543-718f-482b-a495-5d25d35ac8cb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:46.171887 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ee543-718f-482b-a495-5d25d35ac8cb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:46.172191 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ee543-718f-482b-a495-5d25d35ac8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:46.193060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1b5ee543-718f-482b-a495-5d25d35ac8cb None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:46.194349 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1b5ee543-718f-482b-a495-5d25d35ac8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:46.215970 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 116/226] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:46.223740 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79cd77-bd37-4a39-bdce-3cc19d1878e5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:46.224060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79cd77-bd37-4a39-bdce-3cc19d1878e5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:46.224338 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79cd77-bd37-4a39-bdce-3cc19d1878e5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:46.225651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 117/227] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:11:46.227860 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:46.230794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c91e3-eb09-49ee-be19-3f97695fabf9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:46.231083 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c91e3-eb09-49ee-be19-3f97695fabf9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:46.231363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c91e3-eb09-49ee-be19-3f97695fabf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:46.249974 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-de4c91e3-eb09-49ee-be19-3f97695fabf9 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:46.251152 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-de4c91e3-eb09-49ee-be19-3f97695fabf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:46.269536 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 111/228] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:11:46.317640 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 118/229] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:46.487774 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ee543-718f-482b-a495-5d25d35ac8cb None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:46.533287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c91e3-eb09-49ee-be19-3f97695fabf9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:46.548210 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:46.598419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ee543-718f-482b-a495-5d25d35ac8cb None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:46.631811 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91aa01-9a5e-4452-8a1f-e91b50c11fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:46.632819 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91aa01-9a5e-4452-8a1f-e91b50c11fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:46.633100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91aa01-9a5e-4452-8a1f-e91b50c11fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:46.633375 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91aa01-9a5e-4452-8a1f-e91b50c11fd6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:46.636068 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c91e3-eb09-49ee-be19-3f97695fabf9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:46.643541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91aa01-9a5e-4452-8a1f-e91b50c11fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:46.648406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-8f91aa01-9a5e-4452-8a1f-e91b50c11fd6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 10:11:46.648406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:46.648406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:46.648406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:46.648406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:46.648406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:46.648406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:46.648406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:46.648406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:46.648406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:46.648406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:46.648406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:46.648406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:46.648406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:46.648406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:46.648406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:46.649366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:46.649366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:46.649366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:46.649366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:46.649366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:46.649366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:46.649366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:46.649366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:46.649366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:46.649366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:46.649366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:46.649366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:46.649366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:46.649366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:46.649366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:46.649366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:46.650147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:46.650147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:46.650147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:46.650147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:46.650147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:46.650147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:46.650147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:46.650147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:46.650147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:46.650147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:46.650147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 10:11:46.650147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:46.650147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 112/230] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:46.650798 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91aa01-9a5e-4452-8a1f-e91b50c11fd6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:46.672780 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0015a9-4582-4b36-9651-882b5db6759c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:46.673411 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0015a9-4582-4b36-9651-882b5db6759c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:46.673688 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0015a9-4582-4b36-9651-882b5db6759c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:46.673956 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0015a9-4582-4b36-9651-882b5db6759c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:46.675055 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0015a9-4582-4b36-9651-882b5db6759c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:46.676533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0015a9-4582-4b36-9651-882b5db6759c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:46.678105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 119/231] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:11:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:46.678852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0015a9-4582-4b36-9651-882b5db6759c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:46.679750 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:46.754971 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91aa01-9a5e-4452-8a1f-e91b50c11fd6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:46.759988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:46.780080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0015a9-4582-4b36-9651-882b5db6759c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:46.789100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032749a-0e13-41f1-a62d-0f0e2e5296a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:46.789723 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032749a-0e13-41f1-a62d-0f0e2e5296a4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:46.790002 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032749a-0e13-41f1-a62d-0f0e2e5296a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:46.790508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032749a-0e13-41f1-a62d-0f0e2e5296a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:46.800770 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032749a-0e13-41f1-a62d-0f0e2e5296a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:46.805591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-b032749a-0e13-41f1-a62d-0f0e2e5296a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:46.805591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:46.805591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:46.805591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:46.805591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:46.805591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:46.805591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:46.805591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:46.805591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:46.805591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:46.805591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:46.805591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:46.805591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:46.805591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:46.805591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:46.805591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:46.806457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:46.806457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:46.806457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:46.806457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:46.806457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:46.806457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:46.806457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:46.806457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:46.806457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:46.806457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:46.806457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:46.806457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:46.806457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:46.806457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:46.806457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:46.806457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:46.807378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:46.807378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:46.807378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:46.807378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:46.807378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:46.807378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:46.807378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:46.807378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:46.807378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:46.807378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:46.807378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:46.807378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:46.807378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 113/232] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:46.808272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032749a-0e13-41f1-a62d-0f0e2e5296a4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:46.813929 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e973d13-411d-471b-97b4-eeeaaff04e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:46.814531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e973d13-411d-471b-97b4-eeeaaff04e2c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:46.814804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e973d13-411d-471b-97b4-eeeaaff04e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:46.815072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e973d13-411d-471b-97b4-eeeaaff04e2c None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:46.815726 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e973d13-411d-471b-97b4-eeeaaff04e2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:46.816053 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e973d13-411d-471b-97b4-eeeaaff04e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:46.817420 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e973d13-411d-471b-97b4-eeeaaff04e2c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:46.825384 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 120/233] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:46.826671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e973d13-411d-471b-97b4-eeeaaff04e2c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:46.895398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:46.910346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032749a-0e13-41f1-a62d-0f0e2e5296a4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:46.924391 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e973d13-411d-471b-97b4-eeeaaff04e2c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:46.944734 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504b902-34d8-44b2-a907-9ecaeb34161f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:46.945340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504b902-34d8-44b2-a907-9ecaeb34161f None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:46.945616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504b902-34d8-44b2-a907-9ecaeb34161f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:46.945893 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504b902-34d8-44b2-a907-9ecaeb34161f None admin] PATH_INFO: `/v3/groups` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:46.946523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504b902-34d8-44b2-a907-9ecaeb34161f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:46.948003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504b902-34d8-44b2-a907-9ecaeb34161f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:46.957732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e263b-5ac0-4268-9131-638b64dc7ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:46.958392 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e263b-5ac0-4268-9131-638b64dc7ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:46.958876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e263b-5ac0-4268-9131-638b64dc7ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:46.958983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e263b-5ac0-4268-9131-638b64dc7ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:46.959680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e263b-5ac0-4268-9131-638b64dc7ef3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:46.960025 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e263b-5ac0-4268-9131-638b64dc7ef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:46.961386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e263b-5ac0-4268-9131-638b64dc7ef3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:46.963045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 114/234] 10.222.0.13 () {60 vars in 1134 bytes} [Mon Oct 17 10:11:46 2022] POST /identity/v3/groups => generated 229 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:11:46.963916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504b902-34d8-44b2-a907-9ecaeb34161f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:46.975562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 121/235] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:46.976603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e263b-5ac0-4268-9131-638b64dc7ef3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:46.987076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:47.091176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e263b-5ac0-4268-9131-638b64dc7ef3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:47.091400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504b902-34d8-44b2-a907-9ecaeb34161f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:47.129740 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2186f3f-7958-40e7-8bce-223930e69d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:47.130406 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2186f3f-7958-40e7-8bce-223930e69d9a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:47.130681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2186f3f-7958-40e7-8bce-223930e69d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:47.130950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2186f3f-7958-40e7-8bce-223930e69d9a None admin] PATH_INFO: `/v3/users/99cdcb563990482599e8c5e903011417` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:47.132017 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849cb00-5e65-4348-8974-700806987e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:47.132454 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2186f3f-7958-40e7-8bce-223930e69d9a None admin] RBAC: Authorizing `identity:get_user(user_id=99cdcb563990482599e8c5e903011417)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:47.132659 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849cb00-5e65-4348-8974-700806987e20 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:47.132929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849cb00-5e65-4348-8974-700806987e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:47.133202 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849cb00-5e65-4348-8974-700806987e20 None admin] PATH_INFO: `/v3/users/dc77b537adcd4f70b7263a79043e396d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:47.133565 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2186f3f-7958-40e7-8bce-223930e69d9a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:47.135809 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 122/236] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:46 2022] GET /identity/v3/users/99cdcb563990482599e8c5e903011417 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:47.142123 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2186f3f-7958-40e7-8bce-223930e69d9a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:47.149409 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849cb00-5e65-4348-8974-700806987e20 None admin] RBAC: Authorizing `identity:get_user(user_id=dc77b537adcd4f70b7263a79043e396d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:47.151018 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849cb00-5e65-4348-8974-700806987e20 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:47.152592 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 115/237] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:46 2022] GET /identity/v3/users/dc77b537adcd4f70b7263a79043e396d => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:47.160541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849cb00-5e65-4348-8974-700806987e20 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:47.163731 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:47.219847 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:47.251819 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2186f3f-7958-40e7-8bce-223930e69d9a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:47.264661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849cb00-5e65-4348-8974-700806987e20 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:47.286431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df577c1-22a7-4da1-beb2-68090ef72120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:47.287079 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df577c1-22a7-4da1-beb2-68090ef72120 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:47.287355 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df577c1-22a7-4da1-beb2-68090ef72120 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:47.287631 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df577c1-22a7-4da1-beb2-68090ef72120 None admin] PATH_INFO: `/v3/system/users/99cdcb563990482599e8c5e903011417/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:47.289065 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df577c1-22a7-4da1-beb2-68090ef72120 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=99cdcb563990482599e8c5e903011417, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:47.290496 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df577c1-22a7-4da1-beb2-68090ef72120 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:47.299651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 123/238] 10.222.0.13 () {58 vars in 1334 bytes} [Mon Oct 17 10:11:47 2022] PUT /identity/v3/system/users/99cdcb563990482599e8c5e903011417/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:11:47.301922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32917e38-1d9c-48af-a12e-1e9a20b6a47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:47.302532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32917e38-1d9c-48af-a12e-1e9a20b6a47c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:47.302814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32917e38-1d9c-48af-a12e-1e9a20b6a47c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:47.303077 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32917e38-1d9c-48af-a12e-1e9a20b6a47c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:47.303814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32917e38-1d9c-48af-a12e-1e9a20b6a47c None admin] RBAC: Adding query filter params (role.id=42fcdd5fbf1e4056bd623ff078b31886, user.id=dc77b537adcd4f70b7263a79043e396d, scope.system=all) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:47.304145 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32917e38-1d9c-48af-a12e-1e9a20b6a47c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:47.305616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32917e38-1d9c-48af-a12e-1e9a20b6a47c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:47.312327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 116/239] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Oct 17 10:11:47 2022] GET /identity/v3/role_assignments?user.id=dc77b537adcd4f70b7263a79043e396d&scope.system=all&role.id=42fcdd5fbf1e4056bd623ff078b31886 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:49.140292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9f37b-081a-4279-af8e-5724c64f1ac3 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:49.140788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9f37b-081a-4279-af8e-5724c64f1ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:49.140858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9f37b-081a-4279-af8e-5724c64f1ac3 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:49.142317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 124/240] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:49.147181 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb02026-3b98-46a4-9288-8fdd8118504e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:49.147547 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb02026-3b98-46a4-9288-8fdd8118504e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:49.148141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb02026-3b98-46a4-9288-8fdd8118504e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:49.166821 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3eb02026-3b98-46a4-9288-8fdd8118504e None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:49.168022 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3eb02026-3b98-46a4-9288-8fdd8118504e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:49.230910 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:49.240053 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 117/241] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:49.438004 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d1ffa-cb81-40c7-8a50-420418d3f2ed None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:49.438359 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d1ffa-cb81-40c7-8a50-420418d3f2ed None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:49.438553 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d1ffa-cb81-40c7-8a50-420418d3f2ed None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:49.439961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 125/242] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:49.444872 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434d3d5-49b7-4a8d-a99c-edd0969b92b5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:49.445158 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434d3d5-49b7-4a8d-a99c-edd0969b92b5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:49.445429 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434d3d5-49b7-4a8d-a99c-edd0969b92b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:49.452718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26befab-c28f-418f-af76-ddb160f03985 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:49.453012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26befab-c28f-418f-af76-ddb160f03985 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:49.453288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26befab-c28f-418f-af76-ddb160f03985 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:49.454595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 126/243] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:49.459466 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3802e-559a-4292-baaf-6da34bf3681d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:49.459758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3802e-559a-4292-baaf-6da34bf3681d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:49.460069 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3802e-559a-4292-baaf-6da34bf3681d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:49.464584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2434d3d5-49b7-4a8d-a99c-edd0969b92b5 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:49.465693 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2434d3d5-49b7-4a8d-a99c-edd0969b92b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:49.478283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a2b3802e-559a-4292-baaf-6da34bf3681d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:49.479456 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a2b3802e-559a-4292-baaf-6da34bf3681d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:49.534426 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 118/244] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:49.535481 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434d3d5-49b7-4a8d-a99c-edd0969b92b5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:49.547079 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 127/245] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:11:49.635140 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434d3d5-49b7-4a8d-a99c-edd0969b92b5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:49.660731 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:49.669465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e10ae7-fd91-46d9-a4b0-e0b405bb223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:49.670628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e10ae7-fd91-46d9-a4b0-e0b405bb223c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:49.670901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e10ae7-fd91-46d9-a4b0-e0b405bb223c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:49.671168 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e10ae7-fd91-46d9-a4b0-e0b405bb223c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:49.672278 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e10ae7-fd91-46d9-a4b0-e0b405bb223c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:49.673702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e10ae7-fd91-46d9-a4b0-e0b405bb223c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:49.675400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 119/246] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:11:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:49.680756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3802e-559a-4292-baaf-6da34bf3681d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:49.747553 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:49.782962 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3802e-559a-4292-baaf-6da34bf3681d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:49.803187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e10ae7-fd91-46d9-a4b0-e0b405bb223c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:49.818938 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6c57c-ea5d-44cc-9384-39719dbd4a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:49.819556 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6c57c-ea5d-44cc-9384-39719dbd4a1e None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:49.819831 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6c57c-ea5d-44cc-9384-39719dbd4a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:49.820130 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6c57c-ea5d-44cc-9384-39719dbd4a1e None admin] PATH_INFO: `/v3/groups` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:49.820769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6c57c-ea5d-44cc-9384-39719dbd4a1e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:49.822203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6c57c-ea5d-44cc-9384-39719dbd4a1e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:49.846857 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 128/247] 10.222.0.13 () {60 vars in 1134 bytes} [Mon Oct 17 10:11:49 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:11:49.846857 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6c57c-ea5d-44cc-9384-39719dbd4a1e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:49.925947 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e10ae7-fd91-46d9-a4b0-e0b405bb223c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:49.956207 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6c57c-ea5d-44cc-9384-39719dbd4a1e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:49.965104 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef968f-79bc-4eca-bacb-d37a1e076660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:49.965763 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef968f-79bc-4eca-bacb-d37a1e076660 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:49.966041 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef968f-79bc-4eca-bacb-d37a1e076660 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:49.966312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef968f-79bc-4eca-bacb-d37a1e076660 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:49.979170 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef968f-79bc-4eca-bacb-d37a1e076660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:49.985511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-caef968f-79bc-4eca-bacb-d37a1e076660 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 10:11:49.985511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:49.985511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:49.985511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:49.985511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:49.985511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:49.985511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:49.985511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:49.985511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:49.985511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:49.985511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:49.985511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:49.985511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:49.985511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:49.985511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:49.985511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:49.986458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:49.986458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:49.986458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:49.986458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:49.986458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:49.986458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:49.986458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:49.986458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:49.986458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:49.986458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:49.986458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:49.986458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:49.986458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:49.986458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:49.986458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:49.986458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:49.987270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:49.987270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:49.987270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:49.987270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:49.987270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:49.987270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:49.987270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:49.987270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:49.987270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:49.987270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:49.987270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 10:11:49.987270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:49.987270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 120/248] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:11:49.989083 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:49.992794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef968f-79bc-4eca-bacb-d37a1e076660 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:50.000992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4ea59-3774-415f-9b97-2448cc99e472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:50.001999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4ea59-3774-415f-9b97-2448cc99e472 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:50.002287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4ea59-3774-415f-9b97-2448cc99e472 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:50.002550 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4ea59-3774-415f-9b97-2448cc99e472 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:50.014666 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4ea59-3774-415f-9b97-2448cc99e472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:50.020244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-79d4ea59-3774-415f-9b97-2448cc99e472 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:50.020244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:50.020244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:50.020244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:50.020244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:50.020244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:50.020244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:50.020244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:50.020244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:50.020244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:50.020244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:50.020244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:50.020244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:50.020244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:50.020244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:50.020244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:50.021138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:50.021138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:50.021138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:50.021138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:50.021138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:50.021138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:50.021138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:50.021138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:50.021138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:50.021138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:50.021138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:50.021138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:50.021138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:50.021138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:50.021138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:50.021138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:50.021899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:50.021899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:50.021899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:50.021899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:50.021899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:50.021899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:50.021899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:50.021899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:50.021899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:50.021899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:50.021899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:50.021899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:50.021899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 129/249] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:50.027528 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4ea59-3774-415f-9b97-2448cc99e472 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:50.058798 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:50.117077 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef968f-79bc-4eca-bacb-d37a1e076660 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:50.156896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4ea59-3774-415f-9b97-2448cc99e472 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:50.158188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759b43b-e7a5-40a0-9ffb-f0855aa2845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:50.158874 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759b43b-e7a5-40a0-9ffb-f0855aa2845f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:50.159228 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759b43b-e7a5-40a0-9ffb-f0855aa2845f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:50.159601 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759b43b-e7a5-40a0-9ffb-f0855aa2845f None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:50.160721 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759b43b-e7a5-40a0-9ffb-f0855aa2845f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:50.160721 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759b43b-e7a5-40a0-9ffb-f0855aa2845f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:50.162073 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759b43b-e7a5-40a0-9ffb-f0855aa2845f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:50.173611 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 121/250] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:50.179239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759b43b-e7a5-40a0-9ffb-f0855aa2845f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:50.202447 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fa948-a654-4ab0-8167-3e3f1602ca95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:50.203083 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fa948-a654-4ab0-8167-3e3f1602ca95 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:50.203351 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fa948-a654-4ab0-8167-3e3f1602ca95 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:50.203609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fa948-a654-4ab0-8167-3e3f1602ca95 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:50.204342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fa948-a654-4ab0-8167-3e3f1602ca95 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:50.204644 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fa948-a654-4ab0-8167-3e3f1602ca95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:50.206046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fa948-a654-4ab0-8167-3e3f1602ca95 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:50.218724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 130/251] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:50.224776 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fa948-a654-4ab0-8167-3e3f1602ca95 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:50.295257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:50.312031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759b43b-e7a5-40a0-9ffb-f0855aa2845f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:50.338073 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:50.361118 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0ccb-3a72-4383-ab98-5b260dbe5ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:50.361967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0ccb-3a72-4383-ab98-5b260dbe5ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:50.362360 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0ccb-3a72-4383-ab98-5b260dbe5ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:50.362744 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0ccb-3a72-4383-ab98-5b260dbe5ba4 None admin] PATH_INFO: `/v3/users/dc77b537adcd4f70b7263a79043e396d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:50.364390 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f0ccb-3a72-4383-ab98-5b260dbe5ba4 None admin] RBAC: Authorizing `identity:get_user(user_id=dc77b537adcd4f70b7263a79043e396d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:50.366656 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f0ccb-3a72-4383-ab98-5b260dbe5ba4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:50.369449 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 122/252] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:50 2022] GET /identity/v3/users/dc77b537adcd4f70b7263a79043e396d => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:50.372395 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fa948-a654-4ab0-8167-3e3f1602ca95 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:50.376163 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0ccb-3a72-4383-ab98-5b260dbe5ba4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:50.417955 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed8382-d8db-492d-9cd9-89297600e49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:50.418599 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed8382-d8db-492d-9cd9-89297600e49c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:50.418882 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed8382-d8db-492d-9cd9-89297600e49c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:50.419151 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed8382-d8db-492d-9cd9-89297600e49c None admin] PATH_INFO: `/v3/users/99cdcb563990482599e8c5e903011417` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:50.420976 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed8382-d8db-492d-9cd9-89297600e49c None admin] RBAC: Authorizing `identity:get_user(user_id=99cdcb563990482599e8c5e903011417)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:50.422507 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed8382-d8db-492d-9cd9-89297600e49c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:50.424731 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 131/253] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:50 2022] GET /identity/v3/users/99cdcb563990482599e8c5e903011417 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:50.430673 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed8382-d8db-492d-9cd9-89297600e49c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:50.510211 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0ccb-3a72-4383-ab98-5b260dbe5ba4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:50.555784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ded575-fa06-4fe9-a253-a93109e63708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:50.556558 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ded575-fa06-4fe9-a253-a93109e63708 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:50.556835 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ded575-fa06-4fe9-a253-a93109e63708 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:50.557053 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed8382-d8db-492d-9cd9-89297600e49c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:50.557156 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ded575-fa06-4fe9-a253-a93109e63708 None admin] PATH_INFO: `/v3/system/users/dc77b537adcd4f70b7263a79043e396d/roles/42fcdd5fbf1e4056bd623ff078b31886` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:50.559804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ded575-fa06-4fe9-a253-a93109e63708 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dc77b537adcd4f70b7263a79043e396d, role_id=42fcdd5fbf1e4056bd623ff078b31886)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:50.559948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ded575-fa06-4fe9-a253-a93109e63708 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:50.573375 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 123/254] 10.222.0.13 () {58 vars in 1334 bytes} [Mon Oct 17 10:11:50 2022] PUT /identity/v3/system/users/dc77b537adcd4f70b7263a79043e396d/roles/42fcdd5fbf1e4056bd623ff078b31886 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:11:50.589067 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:50.600803 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d0816-5b7a-4a2c-8c21-5769d3678e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:50.601418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d0816-5b7a-4a2c-8c21-5769d3678e3c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:50.601745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d0816-5b7a-4a2c-8c21-5769d3678e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:50.602020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d0816-5b7a-4a2c-8c21-5769d3678e3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:50.604087 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d0816-5b7a-4a2c-8c21-5769d3678e3c None admin] RBAC: Adding query filter params (role.id=5d2fc6de54204986a2c3aedc42288813, user.id=99cdcb563990482599e8c5e903011417, scope.system=all) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:50.604722 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d0816-5b7a-4a2c-8c21-5769d3678e3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:50.606768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d0816-5b7a-4a2c-8c21-5769d3678e3c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:50.627040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 132/255] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Oct 17 10:11:50 2022] GET /identity/v3/role_assignments?user.id=99cdcb563990482599e8c5e903011417&scope.system=all&role.id=5d2fc6de54204986a2c3aedc42288813 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:52.192147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8d498-848a-489d-a792-dd98d5bf2c85 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:52.192665 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8d498-848a-489d-a792-dd98d5bf2c85 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:52.192665 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8d498-848a-489d-a792-dd98d5bf2c85 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:52.194295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 124/256] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:52.199849 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f198-6f0b-4162-9618-fc62be1bedab None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:52.200701 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f198-6f0b-4162-9618-fc62be1bedab None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:52.201714 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f198-6f0b-4162-9618-fc62be1bedab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:52.224804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c6d6f198-6f0b-4162-9618-fc62be1bedab None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:52.226428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c6d6f198-6f0b-4162-9618-fc62be1bedab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:52.305611 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 133/257] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 17 10:11:52.735675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8d498-848a-489d-a792-dd98d5bf2c85 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:52.751189 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8d498-848a-489d-a792-dd98d5bf2c85 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:52.755517 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2febfa-1f43-4c79-9088-2d5d065b27bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:52.756175 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2febfa-1f43-4c79-9088-2d5d065b27bf admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:52.756450 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2febfa-1f43-4c79-9088-2d5d065b27bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:52.756722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2febfa-1f43-4c79-9088-2d5d065b27bf admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:52.776841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2febfa-1f43-4c79-9088-2d5d065b27bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:52.782255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-de2febfa-1f43-4c79-9088-2d5d065b27bf admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:52.782255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:52.782255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:52.782255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:52.782255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:52.782255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:52.782255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:52.782255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:52.782255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:52.782255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:52.782255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:52.782255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:52.782255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:52.782255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:52.782255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:52.782255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:52.783116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:52.783116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:52.783116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:52.783116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:52.783116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:52.783116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:52.783116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:52.783116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:52.783116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:52.783116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:52.783116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:52.783116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:52.783116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:52.783116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:52.783116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:52.783116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:52.783899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:52.783899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:52.783899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:52.783899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:52.783899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:52.783899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:52.783899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:52.783899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:52.783899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:52.783899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:52.783899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:52.783899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:52.783899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 125/258] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Oct 17 10:11:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:52.789331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64696230-7d83-41b9-b7d9-67ee70e3557a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:52.789628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64696230-7d83-41b9-b7d9-67ee70e3557a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:52.789913 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64696230-7d83-41b9-b7d9-67ee70e3557a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:52.790159 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2febfa-1f43-4c79-9088-2d5d065b27bf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:52.791508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 134/259] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:52.799730 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e540761-ec41-4866-8bb1-6a80353c9e0c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:52.799730 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e540761-ec41-4866-8bb1-6a80353c9e0c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:52.800133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e540761-ec41-4866-8bb1-6a80353c9e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:52.803243 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2febfa-1f43-4c79-9088-2d5d065b27bf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:52.809318 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb5b2e-22d5-40ad-a342-e93fc1d4391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:52.809925 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb5b2e-22d5-40ad-a342-e93fc1d4391d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:52.810729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb5b2e-22d5-40ad-a342-e93fc1d4391d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:52.811013 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb5b2e-22d5-40ad-a342-e93fc1d4391d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:52.811678 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb5b2e-22d5-40ad-a342-e93fc1d4391d admin admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:52.812006 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb5b2e-22d5-40ad-a342-e93fc1d4391d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:52.813877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-cbdb5b2e-22d5-40ad-a342-e93fc1d4391d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:11:52.813877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: warnings.warn(msg) Oct 17 10:11:52.813877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: Oct 17 10:11:52.815152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb5b2e-22d5-40ad-a342-e93fc1d4391d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:52.835375 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 126/260] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 17 10:11:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:52.839064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2e540761-ec41-4866-8bb1-6a80353c9e0c None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:52.840427 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2e540761-ec41-4866-8bb1-6a80353c9e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:52.840743 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb5b2e-22d5-40ad-a342-e93fc1d4391d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:52.854581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 135/261] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 17 10:11:52.857308 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb5b2e-22d5-40ad-a342-e93fc1d4391d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:52.867715 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b5b63-5c32-422b-a710-875bc70b7202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:52.868467 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b5b63-5c32-422b-a710-875bc70b7202 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:52.868738 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b5b63-5c32-422b-a710-875bc70b7202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:52.869001 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b5b63-5c32-422b-a710-875bc70b7202 admin admin] PATH_INFO: `/v3/groups/acfedbc720f84b02b4a151e21d2cfb15` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:52.878305 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b5b63-5c32-422b-a710-875bc70b7202 admin admin] RBAC: Authorizing `identity:get_group(group_id=acfedbc720f84b02b4a151e21d2cfb15)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:52.879330 dv-cinder-860209-5-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-f13b5b63-5c32-422b-a710-875bc70b7202 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:11:52.879330 dv-cinder-860209-5-smb devstack@keystone.service[81386]: warnings.warn(msg) Oct 17 10:11:52.879330 dv-cinder-860209-5-smb devstack@keystone.service[81386]: Oct 17 10:11:52.880570 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b5b63-5c32-422b-a710-875bc70b7202 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:52.882331 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 127/262] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Oct 17 10:11:52 2022] GET /identity/v3/groups/acfedbc720f84b02b4a151e21d2cfb15 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:52.887605 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e540761-ec41-4866-8bb1-6a80353c9e0c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:52.900052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e540761-ec41-4866-8bb1-6a80353c9e0c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:52.908312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ffb68-a54c-4cc0-8ee1-ebaeebd5c4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:52.909013 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ffb68-a54c-4cc0-8ee1-ebaeebd5c4ce admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:52.909295 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ffb68-a54c-4cc0-8ee1-ebaeebd5c4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:52.909568 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ffb68-a54c-4cc0-8ee1-ebaeebd5c4ce admin admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:52.911235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ffb68-a54c-4cc0-8ee1-ebaeebd5c4ce admin admin] RBAC: Authorizing `identity:get_project(project_id=423d65bc866249f28b368e7ba3b45250)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:52.913365 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ffb68-a54c-4cc0-8ee1-ebaeebd5c4ce admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:52.916052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 136/263] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Oct 17 10:11:52 2022] GET /identity/v3/projects/423d65bc866249f28b368e7ba3b45250 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:52.921249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b5b63-5c32-422b-a710-875bc70b7202 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:52.937617 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b5b63-5c32-422b-a710-875bc70b7202 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:52.944393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d1f48-0995-4c13-b45e-f2ab2e2db698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:52.945057 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d1f48-0995-4c13-b45e-f2ab2e2db698 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:52.945336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d1f48-0995-4c13-b45e-f2ab2e2db698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:52.945607 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d1f48-0995-4c13-b45e-f2ab2e2db698 admin admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250/groups/acfedbc720f84b02b4a151e21d2cfb15/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:52.949952 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d1f48-0995-4c13-b45e-f2ab2e2db698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=423d65bc866249f28b368e7ba3b45250, group_id=acfedbc720f84b02b4a151e21d2cfb15, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:52.951700 dv-cinder-860209-5-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-d92d1f48-0995-4c13-b45e-f2ab2e2db698 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:11:52.951700 dv-cinder-860209-5-smb devstack@keystone.service[81386]: warnings.warn(msg) Oct 17 10:11:52.951700 dv-cinder-860209-5-smb devstack@keystone.service[81386]: Oct 17 10:11:52.953699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d1f48-0995-4c13-b45e-f2ab2e2db698 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:52.974725 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 128/264] 10.222.0.13 () {58 vars in 1463 bytes} [Mon Oct 17 10:11:52 2022] PUT /identity/v3/projects/423d65bc866249f28b368e7ba3b45250/groups/acfedbc720f84b02b4a151e21d2cfb15/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:11:53.290762 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ffb68-a54c-4cc0-8ee1-ebaeebd5c4ce admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:53.301377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ffb68-a54c-4cc0-8ee1-ebaeebd5c4ce admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:53.365384 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72970a62-d89e-417f-b970-c95a5adb439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:53.365946 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72970a62-d89e-417f-b970-c95a5adb439c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:53.366228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72970a62-d89e-417f-b970-c95a5adb439c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:53.366506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72970a62-d89e-417f-b970-c95a5adb439c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:53.379437 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72970a62-d89e-417f-b970-c95a5adb439c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:53.384418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-72970a62-d89e-417f-b970-c95a5adb439c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:11:53.384418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:53.384418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:53.384418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:53.384418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:53.384418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:53.384418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:53.384418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:53.384418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:53.384418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:53.384418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:53.384418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:53.384418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:53.384418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:53.384418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:53.384418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:53.385259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:53.385259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:53.385259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:53.385259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:53.385259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:53.385259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:53.385259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:53.385259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:53.385259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:53.385259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:53.385259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:53.385259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:53.385259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:53.385259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:53.385259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:53.385259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:53.386048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:53.386048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:53.386048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:53.386048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:53.386048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:53.386048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:53.386048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:53.386048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:53.386048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:53.386048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:53.386048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:11:53.386048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:53.386048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 137/265] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Oct 17 10:11:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:53.391527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d1f48-0995-4c13-b45e-f2ab2e2db698 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:53.413563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d1f48-0995-4c13-b45e-f2ab2e2db698 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:53.417953 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7865ad-23a9-4e36-84c9-69b48814d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:53.418558 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7865ad-23a9-4e36-84c9-69b48814d381 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:53.418829 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7865ad-23a9-4e36-84c9-69b48814d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:53.419093 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7865ad-23a9-4e36-84c9-69b48814d381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:53.419820 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7865ad-23a9-4e36-84c9-69b48814d381 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:53.420141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7865ad-23a9-4e36-84c9-69b48814d381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:53.421730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7865ad-23a9-4e36-84c9-69b48814d381 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:53.428855 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:53.438391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 129/266] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Oct 17 10:11:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:53.444251 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72970a62-d89e-417f-b970-c95a5adb439c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:53.461937 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72970a62-d89e-417f-b970-c95a5adb439c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:53.470522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99746fa5-9bf1-4bcb-bda7-482443bb5569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:53.471227 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99746fa5-9bf1-4bcb-bda7-482443bb5569 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:53.471509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99746fa5-9bf1-4bcb-bda7-482443bb5569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:53.471839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99746fa5-9bf1-4bcb-bda7-482443bb5569 admin admin] PATH_INFO: `/v3/groups/acfedbc720f84b02b4a151e21d2cfb15` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:53.473547 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99746fa5-9bf1-4bcb-bda7-482443bb5569 admin admin] RBAC: Authorizing `identity:get_group(group_id=acfedbc720f84b02b4a151e21d2cfb15)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:53.475376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-99746fa5-9bf1-4bcb-bda7-482443bb5569 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:11:53.475376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: warnings.warn(msg) Oct 17 10:11:53.475376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: Oct 17 10:11:53.476810 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99746fa5-9bf1-4bcb-bda7-482443bb5569 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:53.478564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 138/267] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Oct 17 10:11:53 2022] GET /identity/v3/groups/acfedbc720f84b02b4a151e21d2cfb15 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:53.484547 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7865ad-23a9-4e36-84c9-69b48814d381 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:53.497382 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7865ad-23a9-4e36-84c9-69b48814d381 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:53.507948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f3572-1561-4db2-ba53-618e191aa827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:53.509045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f3572-1561-4db2-ba53-618e191aa827 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:53.509551 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f3572-1561-4db2-ba53-618e191aa827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:53.510042 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f3572-1561-4db2-ba53-618e191aa827 admin admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:53.511610 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f3572-1561-4db2-ba53-618e191aa827 admin admin] RBAC: Authorizing `identity:get_project(project_id=423d65bc866249f28b368e7ba3b45250)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:53.514164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f3572-1561-4db2-ba53-618e191aa827 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:53.516738 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 130/268] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Oct 17 10:11:53 2022] GET /identity/v3/projects/423d65bc866249f28b368e7ba3b45250 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:53.522933 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99746fa5-9bf1-4bcb-bda7-482443bb5569 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:53.537994 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99746fa5-9bf1-4bcb-bda7-482443bb5569 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:53.544725 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad8a3c-91b7-496e-956c-2daafaf3df10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:53.545474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad8a3c-91b7-496e-956c-2daafaf3df10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:53.545756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad8a3c-91b7-496e-956c-2daafaf3df10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:53.546024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad8a3c-91b7-496e-956c-2daafaf3df10 admin admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250/groups/acfedbc720f84b02b4a151e21d2cfb15/roles/b76852b6c05a46a9b493c465fd3441a3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:53.548646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad8a3c-91b7-496e-956c-2daafaf3df10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=423d65bc866249f28b368e7ba3b45250, group_id=acfedbc720f84b02b4a151e21d2cfb15, role_id=b76852b6c05a46a9b493c465fd3441a3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:53.549733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-9cad8a3c-91b7-496e-956c-2daafaf3df10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:11:53.549733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: warnings.warn(msg) Oct 17 10:11:53.549733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: Oct 17 10:11:53.551785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad8a3c-91b7-496e-956c-2daafaf3df10 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:53.576282 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 139/269] 10.222.0.13 () {58 vars in 1463 bytes} [Mon Oct 17 10:11:53 2022] PUT /identity/v3/projects/423d65bc866249f28b368e7ba3b45250/groups/acfedbc720f84b02b4a151e21d2cfb15/roles/b76852b6c05a46a9b493c465fd3441a3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:11:53.598966 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77133d8e-3611-4ede-b15d-9e57721e5015 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:53.599614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77133d8e-3611-4ede-b15d-9e57721e5015 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:53.600139 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77133d8e-3611-4ede-b15d-9e57721e5015 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:53.601836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 131/270] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:53.609057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472f0d1-00df-45d3-939f-d02f2d69698a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:53.609346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472f0d1-00df-45d3-939f-d02f2d69698a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:53.609626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472f0d1-00df-45d3-939f-d02f2d69698a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:53.633129 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9472f0d1-00df-45d3-939f-d02f2d69698a None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:53.634371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9472f0d1-00df-45d3-939f-d02f2d69698a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:53.668227 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:53.717722 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 140/271] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:53.757453 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e197c9-5c55-4829-a805-9b3507681524 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:53.758057 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e197c9-5c55-4829-a805-9b3507681524 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:53.758521 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e197c9-5c55-4829-a805-9b3507681524 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:53.760067 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 132/272] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:53.766104 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dd31e-4818-4c07-b320-11cc71f57fa5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:53.766397 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dd31e-4818-4c07-b320-11cc71f57fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:53.766678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dd31e-4818-4c07-b320-11cc71f57fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:53.793072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ed8dd31e-4818-4c07-b320-11cc71f57fa5 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:53.794296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ed8dd31e-4818-4c07-b320-11cc71f57fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:53.863506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 141/273] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 17 10:11:54.076270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e197c9-5c55-4829-a805-9b3507681524 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:54.206330 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e197c9-5c55-4829-a805-9b3507681524 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:54.247323 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc05e9-c99d-43a4-a4e1-a48d8b734e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:54.248525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc05e9-c99d-43a4-a4e1-a48d8b734e52 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:54.248801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc05e9-c99d-43a4-a4e1-a48d8b734e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:54.249067 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc05e9-c99d-43a4-a4e1-a48d8b734e52 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:54.259714 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc05e9-c99d-43a4-a4e1-a48d8b734e52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:54.268649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-79bc05e9-c99d-43a4-a4e1-a48d8b734e52 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 10:11:54.268649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:54.268649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:54.268649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:54.268649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:54.268649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:54.268649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:54.268649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:54.268649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:54.268649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:54.268649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:54.268649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:54.268649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:54.268649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:54.268649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:54.268649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:54.269541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:54.269541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:54.269541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:54.269541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:54.269541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:54.269541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:54.269541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:54.269541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:54.269541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:54.269541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:54.269541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:54.269541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:54.269541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:54.269541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:54.269541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:54.269541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:54.270340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:54.270340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:54.270340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:54.270340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:54.270340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:54.270340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:54.270340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:54.270340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:54.270340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:54.270340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:54.270340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 10:11:54.270340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:54.270340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 133/274] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:54.281059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8dd31e-4818-4c07-b320-11cc71f57fa5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:54.332373 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc05e9-c99d-43a4-a4e1-a48d8b734e52 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:54.346944 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc05e9-c99d-43a4-a4e1-a48d8b734e52 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:54.352215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086d1d2-811d-4c79-a00c-14597b473cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:54.352842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086d1d2-811d-4c79-a00c-14597b473cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:54.353114 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086d1d2-811d-4c79-a00c-14597b473cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:54.353382 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086d1d2-811d-4c79-a00c-14597b473cb5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:54.370191 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086d1d2-811d-4c79-a00c-14597b473cb5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:54.386473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9086d1d2-811d-4c79-a00c-14597b473cb5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:54.386473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:54.386473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:54.386473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:54.386473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:54.386473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:54.386473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:54.386473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:54.386473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:54.386473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:54.386473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:54.386473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:54.386473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:54.386473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:54.386473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:54.386473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:54.389031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:54.389031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:54.389031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:54.389031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:54.389031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:54.389031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:54.389031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:54.389031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:54.389031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:54.389031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:54.389031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:54.389031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:54.389031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:54.389031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:54.389031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:54.389031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:54.391030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:54.391030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:54.391030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:54.391030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:54.391030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:54.391030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:54.391030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:54.391030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:54.391030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:54.391030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:54.391030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:54.391030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:54.391030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 134/275] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Oct 17 10:11:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:54.399192 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086d1d2-811d-4c79-a00c-14597b473cb5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:54.413892 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086d1d2-811d-4c79-a00c-14597b473cb5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:54.418269 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee6eb6-4f18-43c6-819a-f64a4eb39be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:54.418865 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee6eb6-4f18-43c6-819a-f64a4eb39be2 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:54.419160 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee6eb6-4f18-43c6-819a-f64a4eb39be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:54.419405 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee6eb6-4f18-43c6-819a-f64a4eb39be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:54.424682 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee6eb6-4f18-43c6-819a-f64a4eb39be2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:54.424986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee6eb6-4f18-43c6-819a-f64a4eb39be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:54.426627 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee6eb6-4f18-43c6-819a-f64a4eb39be2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:54.440986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 135/276] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 17 10:11:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:54.446728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee6eb6-4f18-43c6-819a-f64a4eb39be2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:54.451512 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8dd31e-4818-4c07-b320-11cc71f57fa5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:54.457850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee6eb6-4f18-43c6-819a-f64a4eb39be2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:54.468478 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:54.468700 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4325f-9ff4-4075-850e-be100d7d1cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:54.468988 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4325f-9ff4-4075-850e-be100d7d1cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:54.469264 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4325f-9ff4-4075-850e-be100d7d1cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:54.469537 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4325f-9ff4-4075-850e-be100d7d1cb9 admin admin] PATH_INFO: `/v3/groups/acfedbc720f84b02b4a151e21d2cfb15` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:54.470711 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4325f-9ff4-4075-850e-be100d7d1cb9 admin admin] RBAC: Authorizing `identity:get_group(group_id=acfedbc720f84b02b4a151e21d2cfb15)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:54.472737 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4325f-9ff4-4075-850e-be100d7d1cb9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:54.481513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 136/277] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Oct 17 10:11:54 2022] GET /identity/v3/groups/acfedbc720f84b02b4a151e21d2cfb15 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:54.487755 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4325f-9ff4-4075-850e-be100d7d1cb9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:54.499304 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4325f-9ff4-4075-850e-be100d7d1cb9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:54.507966 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d68bb9-2cdf-4cd2-af5f-fc0d2810eee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:54.508612 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d68bb9-2cdf-4cd2-af5f-fc0d2810eee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:54.508889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d68bb9-2cdf-4cd2-af5f-fc0d2810eee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:54.509160 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d68bb9-2cdf-4cd2-af5f-fc0d2810eee9 admin admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:54.510283 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d68bb9-2cdf-4cd2-af5f-fc0d2810eee9 admin admin] RBAC: Authorizing `identity:get_project(project_id=59dbb475fe1d46689ba2116ba560199f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:54.512375 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d68bb9-2cdf-4cd2-af5f-fc0d2810eee9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:54.514532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 137/278] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Oct 17 10:11:54 2022] GET /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:54.520428 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d68bb9-2cdf-4cd2-af5f-fc0d2810eee9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:54.533234 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d68bb9-2cdf-4cd2-af5f-fc0d2810eee9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:54.538031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea9b32-3d89-4ded-bd34-ae98fc58f8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:54.538683 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea9b32-3d89-4ded-bd34-ae98fc58f8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:54.538961 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea9b32-3d89-4ded-bd34-ae98fc58f8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:54.539234 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea9b32-3d89-4ded-bd34-ae98fc58f8ec admin admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f/groups/acfedbc720f84b02b4a151e21d2cfb15/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:54.540564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff63d7-0325-4ff5-879c-cfd005bfca47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:54.541189 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff63d7-0325-4ff5-879c-cfd005bfca47 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:54.541469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff63d7-0325-4ff5-879c-cfd005bfca47 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:54.541742 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff63d7-0325-4ff5-879c-cfd005bfca47 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:54.542424 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff63d7-0325-4ff5-879c-cfd005bfca47 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:54.542730 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff63d7-0325-4ff5-879c-cfd005bfca47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:54.544162 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff63d7-0325-4ff5-879c-cfd005bfca47 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:54.545869 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea9b32-3d89-4ded-bd34-ae98fc58f8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=59dbb475fe1d46689ba2116ba560199f, group_id=acfedbc720f84b02b4a151e21d2cfb15, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:54.548553 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea9b32-3d89-4ded-bd34-ae98fc58f8ec admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:54.557990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 142/279] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:54.565480 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff63d7-0325-4ff5-879c-cfd005bfca47 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:54.570057 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 138/280] 10.222.0.13 () {58 vars in 1463 bytes} [Mon Oct 17 10:11:54 2022] PUT /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f/groups/acfedbc720f84b02b4a151e21d2cfb15/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:11:54.633159 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7532a3e-6d69-48de-9ea9-9de108274f84 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:54.633508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7532a3e-6d69-48de-9ea9-9de108274f84 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:54.633712 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7532a3e-6d69-48de-9ea9-9de108274f84 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:54.635291 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 139/281] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:11:54.641215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f4734-0436-4b19-8d57-ff48dcfae4f2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:54.641504 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f4734-0436-4b19-8d57-ff48dcfae4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:54.641744 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f4734-0436-4b19-8d57-ff48dcfae4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:54.670452 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9d9f4734-0436-4b19-8d57-ff48dcfae4f2 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:54.671696 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9d9f4734-0436-4b19-8d57-ff48dcfae4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:54.684093 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:54.741820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff63d7-0325-4ff5-879c-cfd005bfca47 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:54.772239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 140/282] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 17 10:11:54.805231 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcab226-02d6-4bc0-9ca8-a781d069a83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:54.805888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcab226-02d6-4bc0-9ca8-a781d069a83c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:54.806170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcab226-02d6-4bc0-9ca8-a781d069a83c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:54.806447 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcab226-02d6-4bc0-9ca8-a781d069a83c None admin] PATH_INFO: `/v3/users/dc77b537adcd4f70b7263a79043e396d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:54.807633 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcab226-02d6-4bc0-9ca8-a781d069a83c None admin] RBAC: Authorizing `identity:get_user(user_id=dc77b537adcd4f70b7263a79043e396d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:54.809150 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcab226-02d6-4bc0-9ca8-a781d069a83c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:54.812372 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 143/283] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:11:54 2022] GET /identity/v3/users/dc77b537adcd4f70b7263a79043e396d => generated 293 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:54.817551 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f4734-0436-4b19-8d57-ff48dcfae4f2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:54.956656 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f4734-0436-4b19-8d57-ff48dcfae4f2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:54.995127 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eff5c-5d15-4edd-8ea9-d6d1fc96368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:54.995738 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eff5c-5d15-4edd-8ea9-d6d1fc96368c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:54.996040 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eff5c-5d15-4edd-8ea9-d6d1fc96368c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:54.996359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eff5c-5d15-4edd-8ea9-d6d1fc96368c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:54.997099 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0eff5c-5d15-4edd-8ea9-d6d1fc96368c None admin] RBAC: Adding query filter params (role.id=42fcdd5fbf1e4056bd623ff078b31886, user.id=dc77b537adcd4f70b7263a79043e396d, scope.system=all) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:54.997405 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0eff5c-5d15-4edd-8ea9-d6d1fc96368c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:54.999439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0eff5c-5d15-4edd-8ea9-d6d1fc96368c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:55.011773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 141/284] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Oct 17 10:11:54 2022] GET /identity/v3/role_assignments?user.id=dc77b537adcd4f70b7263a79043e396d&scope.system=all&role.id=42fcdd5fbf1e4056bd623ff078b31886 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:55.372770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcab226-02d6-4bc0-9ca8-a781d069a83c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:55.383864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcab226-02d6-4bc0-9ca8-a781d069a83c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:55.392183 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45deb501-5b04-42de-b95b-8f00ddd8978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:55.392822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deb501-5b04-42de-b95b-8f00ddd8978c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:55.393105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deb501-5b04-42de-b95b-8f00ddd8978c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:55.393383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deb501-5b04-42de-b95b-8f00ddd8978c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:55.405336 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45deb501-5b04-42de-b95b-8f00ddd8978c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:55.410266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-45deb501-5b04-42de-b95b-8f00ddd8978c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:11:55.410266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:55.410266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:55.410266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:55.410266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:55.410266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:55.410266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:55.410266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:55.410266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:55.410266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:55.410266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:55.410266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:55.410266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:55.410266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:55.410266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:55.410266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:55.411136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:55.411136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:55.411136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:55.411136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:55.411136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:55.411136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:55.411136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:55.411136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:55.411136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:55.411136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:55.411136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:55.411136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:55.411136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:55.411136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:55.411136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:55.411136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:55.411896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:55.411896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:55.411896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:55.411896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:55.411896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:55.411896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:55.411896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:55.411896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:55.411896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:55.411896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:55.411896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:11:55.411896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:55.411896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 144/285] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Oct 17 10:11:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:55.418736 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eff5c-5d15-4edd-8ea9-d6d1fc96368c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:55.434981 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eff5c-5d15-4edd-8ea9-d6d1fc96368c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:55.442399 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb306ceb-0beb-4515-bb42-9fb75c718a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:55.443107 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb306ceb-0beb-4515-bb42-9fb75c718a08 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:55.443387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb306ceb-0beb-4515-bb42-9fb75c718a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:55.443662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb306ceb-0beb-4515-bb42-9fb75c718a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:55.444412 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb306ceb-0beb-4515-bb42-9fb75c718a08 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:55.444714 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb306ceb-0beb-4515-bb42-9fb75c718a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:55.446419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb306ceb-0beb-4515-bb42-9fb75c718a08 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:55.459894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 142/286] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Oct 17 10:11:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:55.465805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45deb501-5b04-42de-b95b-8f00ddd8978c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:55.481425 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45deb501-5b04-42de-b95b-8f00ddd8978c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:55.491674 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0186c6f-2d1f-4988-8f5c-ed1f597f7da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:55.492388 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0186c6f-2d1f-4988-8f5c-ed1f597f7da1 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:55.492673 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0186c6f-2d1f-4988-8f5c-ed1f597f7da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:55.492947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0186c6f-2d1f-4988-8f5c-ed1f597f7da1 admin admin] PATH_INFO: `/v3/groups/acfedbc720f84b02b4a151e21d2cfb15` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:55.496595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0186c6f-2d1f-4988-8f5c-ed1f597f7da1 admin admin] RBAC: Authorizing `identity:get_group(group_id=acfedbc720f84b02b4a151e21d2cfb15)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:55.498608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0186c6f-2d1f-4988-8f5c-ed1f597f7da1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:55.500255 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 145/287] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Oct 17 10:11:55 2022] GET /identity/v3/groups/acfedbc720f84b02b4a151e21d2cfb15 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:55.505926 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb306ceb-0beb-4515-bb42-9fb75c718a08 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:55.523601 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb306ceb-0beb-4515-bb42-9fb75c718a08 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:55.532620 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe7e0b-eeb7-4e23-ab53-ec1c9beebb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:55.533323 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe7e0b-eeb7-4e23-ab53-ec1c9beebb40 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:55.533605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe7e0b-eeb7-4e23-ab53-ec1c9beebb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:55.533905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe7e0b-eeb7-4e23-ab53-ec1c9beebb40 admin admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:55.539826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe7e0b-eeb7-4e23-ab53-ec1c9beebb40 admin admin] RBAC: Authorizing `identity:get_project(project_id=59dbb475fe1d46689ba2116ba560199f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:55.541945 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe7e0b-eeb7-4e23-ab53-ec1c9beebb40 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:55.543978 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 143/288] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Oct 17 10:11:55 2022] GET /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:55.549770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0186c6f-2d1f-4988-8f5c-ed1f597f7da1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:55.565588 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0186c6f-2d1f-4988-8f5c-ed1f597f7da1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:55.575665 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b1749-17d6-498b-ac37-a9e7eaa2bbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:55.576452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1749-17d6-498b-ac37-a9e7eaa2bbb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:55.576739 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1749-17d6-498b-ac37-a9e7eaa2bbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:55.577019 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1749-17d6-498b-ac37-a9e7eaa2bbb6 admin admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f/groups/acfedbc720f84b02b4a151e21d2cfb15/roles/b76852b6c05a46a9b493c465fd3441a3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:55.581685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b1749-17d6-498b-ac37-a9e7eaa2bbb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59dbb475fe1d46689ba2116ba560199f, group_id=acfedbc720f84b02b4a151e21d2cfb15, role_id=b76852b6c05a46a9b493c465fd3441a3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:55.584399 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b1749-17d6-498b-ac37-a9e7eaa2bbb6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:55.607143 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 146/289] 10.222.0.13 () {58 vars in 1463 bytes} [Mon Oct 17 10:11:55 2022] PUT /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f/groups/acfedbc720f84b02b4a151e21d2cfb15/roles/b76852b6c05a46a9b493c465fd3441a3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:11:55.745699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ee583-bcef-4b0e-acea-0de9a65227d0 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:55.746005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ee583-bcef-4b0e-acea-0de9a65227d0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:55.746162 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ee583-bcef-4b0e-acea-0de9a65227d0 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:55.748292 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 144/290] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:55.753452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec98ef4-263b-456e-b1d3-0a00f145061e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:55.753741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec98ef4-263b-456e-b1d3-0a00f145061e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:55.754016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec98ef4-263b-456e-b1d3-0a00f145061e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:55.778102 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3ec98ef4-263b-456e-b1d3-0a00f145061e None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:55.779867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3ec98ef4-263b-456e-b1d3-0a00f145061e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:55.792304 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:55.863886 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 147/291] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 17 10:11:56.272096 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ee583-bcef-4b0e-acea-0de9a65227d0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:56.280036 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:56.286358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ee583-bcef-4b0e-acea-0de9a65227d0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:56.296172 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55b1dc-adda-45b8-b687-3ab557286931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:56.296841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55b1dc-adda-45b8-b687-3ab557286931 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:56.297122 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55b1dc-adda-45b8-b687-3ab557286931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:56.297397 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55b1dc-adda-45b8-b687-3ab557286931 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:56.317333 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55b1dc-adda-45b8-b687-3ab557286931 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:56.322509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-bf55b1dc-adda-45b8-b687-3ab557286931 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:11:56.322509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:56.322509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:56.322509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:56.322509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:56.322509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:56.322509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:56.322509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:56.322509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:56.322509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:56.322509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:56.322509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:56.322509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:56.322509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:56.322509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:56.322509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:56.323419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:56.323419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:56.323419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:56.323419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:56.323419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:56.323419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:56.323419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:56.323419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:56.323419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:56.323419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:56.323419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:56.323419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:56.323419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:56.323419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:56.323419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:56.323419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:56.324275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:56.324275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:56.324275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:56.324275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:56.324275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:56.324275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:56.324275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:56.324275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:56.324275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:56.324275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:56.324275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:11:56.324275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:56.324890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 145/292] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Oct 17 10:11:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:56.329762 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec98ef4-263b-456e-b1d3-0a00f145061e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:56.342321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec98ef4-263b-456e-b1d3-0a00f145061e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:56.349904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b18b82-95ff-4396-bcbe-c6b55e5304ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:56.350529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b18b82-95ff-4396-bcbe-c6b55e5304ae admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:56.350811 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b18b82-95ff-4396-bcbe-c6b55e5304ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:56.351143 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b18b82-95ff-4396-bcbe-c6b55e5304ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:56.351832 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b18b82-95ff-4396-bcbe-c6b55e5304ae admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:56.352175 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b18b82-95ff-4396-bcbe-c6b55e5304ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:56.353209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-77b18b82-95ff-4396-bcbe-c6b55e5304ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:11:56.353209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: warnings.warn(msg) Oct 17 10:11:56.353209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: Oct 17 10:11:56.354097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b18b82-95ff-4396-bcbe-c6b55e5304ae admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:56.367756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 148/293] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Oct 17 10:11:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:56.373603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55b1dc-adda-45b8-b687-3ab557286931 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:56.389261 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55b1dc-adda-45b8-b687-3ab557286931 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:56.397054 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a3979-0863-4371-91fc-1f6b22904a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:56.397702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a3979-0863-4371-91fc-1f6b22904a0f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:56.397979 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a3979-0863-4371-91fc-1f6b22904a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:56.398249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a3979-0863-4371-91fc-1f6b22904a0f admin admin] PATH_INFO: `/v3/groups/a23b6e75375b4f98bf876b14c0ce3aa6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:56.403530 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a3979-0863-4371-91fc-1f6b22904a0f admin admin] RBAC: Authorizing `identity:get_group(group_id=a23b6e75375b4f98bf876b14c0ce3aa6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:56.406027 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a3979-0863-4371-91fc-1f6b22904a0f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:56.407640 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 146/294] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Oct 17 10:11:56 2022] GET /identity/v3/groups/a23b6e75375b4f98bf876b14c0ce3aa6 => generated 229 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:56.413215 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b18b82-95ff-4396-bcbe-c6b55e5304ae admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:56.429133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b18b82-95ff-4396-bcbe-c6b55e5304ae admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:56.437572 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216e93c-128b-49b2-926d-5da7c1ac92ea None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:56.438101 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216e93c-128b-49b2-926d-5da7c1ac92ea None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:56.438101 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216e93c-128b-49b2-926d-5da7c1ac92ea None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:56.439586 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 147/295] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:11:56.439815 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567b1ef-c055-45f0-80f3-ae977fc6c26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:56.440553 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567b1ef-c055-45f0-80f3-ae977fc6c26e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:56.440845 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567b1ef-c055-45f0-80f3-ae977fc6c26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:56.441119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567b1ef-c055-45f0-80f3-ae977fc6c26e admin admin] PATH_INFO: `/v3/projects/4fb717994bee40c5a122b7bec779dc47` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:56.442338 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567b1ef-c055-45f0-80f3-ae977fc6c26e admin admin] RBAC: Authorizing `identity:get_project(project_id=4fb717994bee40c5a122b7bec779dc47)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:56.444297 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567b1ef-c055-45f0-80f3-ae977fc6c26e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:56.444700 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813daf77-5219-42b0-a678-ed068e96df42 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:56.445183 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813daf77-5219-42b0-a678-ed068e96df42 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:56.445656 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813daf77-5219-42b0-a678-ed068e96df42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:56.446052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 149/296] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Oct 17 10:11:56 2022] GET /identity/v3/projects/4fb717994bee40c5a122b7bec779dc47 => generated 344 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:56.451534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567b1ef-c055-45f0-80f3-ae977fc6c26e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:56.468438 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567b1ef-c055-45f0-80f3-ae977fc6c26e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:56.473837 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-813daf77-5219-42b0-a678-ed068e96df42 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:56.475604 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-813daf77-5219-42b0-a678-ed068e96df42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:56.478656 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717ccfb-9c28-4a6f-86c6-8f4c0c636e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:56.479761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717ccfb-9c28-4a6f-86c6-8f4c0c636e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:56.481477 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717ccfb-9c28-4a6f-86c6-8f4c0c636e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:56.481952 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717ccfb-9c28-4a6f-86c6-8f4c0c636e1f admin admin] PATH_INFO: `/v3/projects/4fb717994bee40c5a122b7bec779dc47/groups/a23b6e75375b4f98bf876b14c0ce3aa6/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:56.485566 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717ccfb-9c28-4a6f-86c6-8f4c0c636e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb717994bee40c5a122b7bec779dc47, group_id=a23b6e75375b4f98bf876b14c0ce3aa6, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:56.493207 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717ccfb-9c28-4a6f-86c6-8f4c0c636e1f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:56.518350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 150/297] 10.222.0.13 () {58 vars in 1463 bytes} [Mon Oct 17 10:11:56 2022] PUT /identity/v3/projects/4fb717994bee40c5a122b7bec779dc47/groups/a23b6e75375b4f98bf876b14c0ce3aa6/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:11:56.579851 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 148/298] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:56.889987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072cb11-991c-44de-8556-67f2f0d88a5e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:56.890345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072cb11-991c-44de-8556-67f2f0d88a5e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:56.890569 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072cb11-991c-44de-8556-67f2f0d88a5e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:56.892384 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 151/299] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:56.897353 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4525e4-725d-4269-93df-13e12dc133d0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:56.897889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4525e4-725d-4269-93df-13e12dc133d0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:56.898358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4525e4-725d-4269-93df-13e12dc133d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:56.921625 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ee4525e4-725d-4269-93df-13e12dc133d0 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:56.923126 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ee4525e4-725d-4269-93df-13e12dc133d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:56.947453 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072cb11-991c-44de-8556-67f2f0d88a5e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:57.029449 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 149/300] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:57.131693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072cb11-991c-44de-8556-67f2f0d88a5e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:57.169869 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:57.179017 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5ef78-cea9-43f2-886c-7132c287d003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:57.179691 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5ef78-cea9-43f2-886c-7132c287d003 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:57.180412 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5ef78-cea9-43f2-886c-7132c287d003 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:57.181080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5ef78-cea9-43f2-886c-7132c287d003 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:57.198783 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5ef78-cea9-43f2-886c-7132c287d003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:57.203764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-edd5ef78-cea9-43f2-886c-7132c287d003 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:57.203764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:57.203764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:57.203764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:57.203764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:57.203764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:57.203764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:57.203764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:57.203764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:57.203764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:57.203764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:57.203764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:57.203764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:57.203764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:57.203764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:57.203764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:57.204680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:57.204680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:57.204680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:57.204680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:57.204680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:57.204680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:57.204680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:57.204680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:57.204680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:57.204680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:57.204680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:57.204680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:57.204680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:57.204680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:57.204680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:57.204680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:57.205873 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:57.205873 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:57.205873 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:57.205873 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:57.205873 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:57.205873 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:57.205873 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:57.205873 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:57.205873 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:57.205873 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:57.205873 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:57.205873 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:57.205873 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 152/301] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:57.210948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4525e4-725d-4269-93df-13e12dc133d0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:57.276324 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:57.342477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4525e4-725d-4269-93df-13e12dc133d0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:57.386507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031c49c-239a-41c3-8cb1-efd7ef53495f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:57.387122 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031c49c-239a-41c3-8cb1-efd7ef53495f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:57.387396 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031c49c-239a-41c3-8cb1-efd7ef53495f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:57.387661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031c49c-239a-41c3-8cb1-efd7ef53495f None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:57.388904 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031c49c-239a-41c3-8cb1-efd7ef53495f None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:57.389213 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031c49c-239a-41c3-8cb1-efd7ef53495f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:57.390590 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031c49c-239a-41c3-8cb1-efd7ef53495f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:57.400620 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5ef78-cea9-43f2-886c-7132c287d003 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:57.413396 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 150/302] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:57.431704 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031c49c-239a-41c3-8cb1-efd7ef53495f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:57.583395 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031c49c-239a-41c3-8cb1-efd7ef53495f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:57.591026 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:57.617438 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5ef78-cea9-43f2-886c-7132c287d003 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:57.642823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9f7ed-9172-45a7-8715-71819e29ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:57.643437 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9f7ed-9172-45a7-8715-71819e29ef93 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:57.643715 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9f7ed-9172-45a7-8715-71819e29ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:57.644007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9f7ed-9172-45a7-8715-71819e29ef93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:57.674783 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca95c6-4408-4e8f-94b7-7f2dfecdcc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:57.675914 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca95c6-4408-4e8f-94b7-7f2dfecdcc7d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:57.676237 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca95c6-4408-4e8f-94b7-7f2dfecdcc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:57.676514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca95c6-4408-4e8f-94b7-7f2dfecdcc7d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:57.691120 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca95c6-4408-4e8f-94b7-7f2dfecdcc7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:57.697320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-42ca95c6-4408-4e8f-94b7-7f2dfecdcc7d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:11:57.697320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:57.697320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:57.697320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:57.697320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:57.697320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:57.697320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:57.697320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:57.697320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:57.697320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:57.697320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:57.697320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:57.697320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:57.697320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:57.697320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:57.697320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:57.698186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:57.698186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:57.698186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:57.698186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:57.698186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:57.698186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:57.698186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:57.698186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:57.698186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:57.698186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:57.698186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:57.698186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:57.698186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:57.698186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:57.698186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:57.698186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:57.700232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:57.700232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:57.700232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:57.700232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:57.700232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:57.700232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:57.700232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:57.700232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:57.700232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:57.700232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:57.700232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:11:57.700232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:57.700232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 153/303] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 17 10:11:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:11:57.700232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf99ac-199d-40be-8d16-8013f7dcaf60 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:57.701805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf99ac-199d-40be-8d16-8013f7dcaf60 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:57.701805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf99ac-199d-40be-8d16-8013f7dcaf60 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:57.702904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 154/304] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:57.709653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10b522-9e55-464b-9906-4e6d527f1d84 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:57.709935 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10b522-9e55-464b-9906-4e6d527f1d84 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:57.710209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10b522-9e55-464b-9906-4e6d527f1d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:57.739998 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0e10b522-9e55-464b-9906-4e6d527f1d84 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:57.740982 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9f7ed-9172-45a7-8715-71819e29ef93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:57.741220 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0e10b522-9e55-464b-9906-4e6d527f1d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:57.742944 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9f7ed-9172-45a7-8715-71819e29ef93 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:57.807619 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:57.835467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 155/305] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:57.838646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10b522-9e55-464b-9906-4e6d527f1d84 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:57.882868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 151/306] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:11:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 17 10:11:57.888930 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9f7ed-9172-45a7-8715-71819e29ef93 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:57.894225 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:57.955364 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10b522-9e55-464b-9906-4e6d527f1d84 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:57.996780 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfab6b0-a2d1-482f-8650-34a6872d2741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:57.997525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfab6b0-a2d1-482f-8650-34a6872d2741 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:57.998336 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfab6b0-a2d1-482f-8650-34a6872d2741 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:57.998684 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfab6b0-a2d1-482f-8650-34a6872d2741 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:57.999434 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfab6b0-a2d1-482f-8650-34a6872d2741 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:57.999803 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfab6b0-a2d1-482f-8650-34a6872d2741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:58.001381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfab6b0-a2d1-482f-8650-34a6872d2741 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:58.014334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 156/307] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:11:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:58.016771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfab6b0-a2d1-482f-8650-34a6872d2741 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:58.058397 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9f7ed-9172-45a7-8715-71819e29ef93 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:58.065170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:58.125199 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfab6b0-a2d1-482f-8650-34a6872d2741 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:58.133233 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c743c79-003b-49e3-a0a6-e7fbcada6c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:58.133888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c743c79-003b-49e3-a0a6-e7fbcada6c95 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:58.134169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c743c79-003b-49e3-a0a6-e7fbcada6c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:58.134438 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c743c79-003b-49e3-a0a6-e7fbcada6c95 None admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:58.135588 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c743c79-003b-49e3-a0a6-e7fbcada6c95 None admin] RBAC: Authorizing `identity:get_project(project_id=423d65bc866249f28b368e7ba3b45250)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:58.137142 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c743c79-003b-49e3-a0a6-e7fbcada6c95 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:58.138828 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 152/308] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:57 2022] GET /identity/v3/projects/423d65bc866249f28b368e7ba3b45250 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:58.144557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c743c79-003b-49e3-a0a6-e7fbcada6c95 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:58.160905 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b46f6-9480-4a18-85c6-69a0a4fd4646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:58.161526 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b46f6-9480-4a18-85c6-69a0a4fd4646 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:58.161810 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b46f6-9480-4a18-85c6-69a0a4fd4646 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:58.162089 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b46f6-9480-4a18-85c6-69a0a4fd4646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:58.236319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b46f6-9480-4a18-85c6-69a0a4fd4646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:58.237842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b46f6-9480-4a18-85c6-69a0a4fd4646 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:58.251890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:58.286620 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:58.300842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c743c79-003b-49e3-a0a6-e7fbcada6c95 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:58.346676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 157/309] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:11:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:11:58.352230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b46f6-9480-4a18-85c6-69a0a4fd4646 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:58.357654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f528841-094f-4112-8a87-3308b9098d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:58.358533 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f528841-094f-4112-8a87-3308b9098d80 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:58.359001 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f528841-094f-4112-8a87-3308b9098d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:58.359485 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f528841-094f-4112-8a87-3308b9098d80 None admin] PATH_INFO: `/v3/groups/acfedbc720f84b02b4a151e21d2cfb15` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:58.360988 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f528841-094f-4112-8a87-3308b9098d80 None admin] RBAC: Authorizing `identity:get_group(group_id=acfedbc720f84b02b4a151e21d2cfb15)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:58.362692 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f528841-094f-4112-8a87-3308b9098d80 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:58.364898 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 153/310] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Oct 17 10:11:58 2022] GET /identity/v3/groups/acfedbc720f84b02b4a151e21d2cfb15 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:58.370456 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f528841-094f-4112-8a87-3308b9098d80 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:58.461525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b46f6-9480-4a18-85c6-69a0a4fd4646 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:58.498983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b41c1-d2e9-40aa-96d6-d8176aa3f02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:58.499651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b41c1-d2e9-40aa-96d6-d8176aa3f02b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:58.500023 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b41c1-d2e9-40aa-96d6-d8176aa3f02b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:58.500213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b41c1-d2e9-40aa-96d6-d8176aa3f02b None admin] PATH_INFO: `/v3/projects/423d65bc866249f28b368e7ba3b45250` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:58.501372 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b41c1-d2e9-40aa-96d6-d8176aa3f02b None admin] RBAC: Authorizing `identity:get_project(project_id=423d65bc866249f28b368e7ba3b45250)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:58.503404 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b41c1-d2e9-40aa-96d6-d8176aa3f02b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:58.504690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 158/311] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:58 2022] GET /identity/v3/projects/423d65bc866249f28b368e7ba3b45250 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:58.510365 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b41c1-d2e9-40aa-96d6-d8176aa3f02b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:58.526741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:58.541674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f528841-094f-4112-8a87-3308b9098d80 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:58.579987 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83412ba9-0120-4017-b64a-526fe8fd9195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:58.580593 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412ba9-0120-4017-b64a-526fe8fd9195 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:58.580975 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412ba9-0120-4017-b64a-526fe8fd9195 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:58.581248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412ba9-0120-4017-b64a-526fe8fd9195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:58.582092 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83412ba9-0120-4017-b64a-526fe8fd9195 None admin] RBAC: Adding query filter params (group.id=acfedbc720f84b02b4a151e21d2cfb15, role.id=5d2fc6de54204986a2c3aedc42288813, scope.project.id=423d65bc866249f28b368e7ba3b45250) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:58.582399 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83412ba9-0120-4017-b64a-526fe8fd9195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:58.585426 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83412ba9-0120-4017-b64a-526fe8fd9195 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:58.591214 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 154/312] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Oct 17 10:11:58 2022] GET /identity/v3/role_assignments?group.id=acfedbc720f84b02b4a151e21d2cfb15&scope.project.id=423d65bc866249f28b368e7ba3b45250&role.id=5d2fc6de54204986a2c3aedc42288813 => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:58.592663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83412ba9-0120-4017-b64a-526fe8fd9195 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:58.596283 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:58.647099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b41c1-d2e9-40aa-96d6-d8176aa3f02b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:58.697447 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7d30a-6ffd-4810-8b8f-c46a74bbfb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:58.698103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7d30a-6ffd-4810-8b8f-c46a74bbfb24 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:58.698380 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7d30a-6ffd-4810-8b8f-c46a74bbfb24 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:58.698653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7d30a-6ffd-4810-8b8f-c46a74bbfb24 None admin] PATH_INFO: `/v3/groups/acfedbc720f84b02b4a151e21d2cfb15` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:58.700530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7d30a-6ffd-4810-8b8f-c46a74bbfb24 None admin] RBAC: Authorizing `identity:get_group(group_id=acfedbc720f84b02b4a151e21d2cfb15)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:58.702616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7d30a-6ffd-4810-8b8f-c46a74bbfb24 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:58.704686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 159/313] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Oct 17 10:11:58 2022] GET /identity/v3/groups/acfedbc720f84b02b4a151e21d2cfb15 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:58.706222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67671f5c-c982-4498-b869-3c4e6cf5006d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:58.706523 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67671f5c-c982-4498-b869-3c4e6cf5006d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:58.707240 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67671f5c-c982-4498-b869-3c4e6cf5006d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:58.712056 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 160/314] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:58.714029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67671f5c-c982-4498-b869-3c4e6cf5006d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:58.746363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83412ba9-0120-4017-b64a-526fe8fd9195 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:58.787826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722aa4a-4d12-44c3-ac41-e19379c68004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:58.788427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722aa4a-4d12-44c3-ac41-e19379c68004 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:58.788690 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722aa4a-4d12-44c3-ac41-e19379c68004 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:58.789113 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722aa4a-4d12-44c3-ac41-e19379c68004 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:58.804079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722aa4a-4d12-44c3-ac41-e19379c68004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:58.811477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-0722aa4a-4d12-44c3-ac41-e19379c68004 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:58.811477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:58.811477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:58.811477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:58.811477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:58.811477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:58.811477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:58.811477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:58.811477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:58.811477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:58.811477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:58.811477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:58.811477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:58.811477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:58.811477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:58.811477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:58.812651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:58.812651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:58.812651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:58.812651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:58.812651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:58.812651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:58.812651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:58.812651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:58.812651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:58.812651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:58.812651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:58.812651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:58.812651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:58.812651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:58.812651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:58.812651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:58.813432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:58.813432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:58.813432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:58.813432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:58.813432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:58.813432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:58.813432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:58.813432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:58.813432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:58.813432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:58.813432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 10:11:58.813432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:11:58.813432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 155/315] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:11:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:58.814111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c5471-7ac4-478c-a378-aa521aa21f6b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:58.814111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c5471-7ac4-478c-a378-aa521aa21f6b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:58.814664 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c5471-7ac4-478c-a378-aa521aa21f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:58.840366 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:58.841225 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0a6c5471-7ac4-478c-a378-aa521aa21f6b None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:58.842493 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0a6c5471-7ac4-478c-a378-aa521aa21f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:58.850407 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67671f5c-c982-4498-b869-3c4e6cf5006d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:58.895253 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760f1b7-07f5-4b04-879e-f348900f9105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:58.896049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760f1b7-07f5-4b04-879e-f348900f9105 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:58.896315 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760f1b7-07f5-4b04-879e-f348900f9105 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:58.896588 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760f1b7-07f5-4b04-879e-f348900f9105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:58.897503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760f1b7-07f5-4b04-879e-f348900f9105 None admin] RBAC: Adding query filter params (group.id=acfedbc720f84b02b4a151e21d2cfb15, role.id=b76852b6c05a46a9b493c465fd3441a3, scope.project.id=423d65bc866249f28b368e7ba3b45250) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:58.897870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760f1b7-07f5-4b04-879e-f348900f9105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:58.899709 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760f1b7-07f5-4b04-879e-f348900f9105 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:58.906949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 161/316] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Oct 17 10:11:58 2022] GET /identity/v3/role_assignments?group.id=acfedbc720f84b02b4a151e21d2cfb15&scope.project.id=423d65bc866249f28b368e7ba3b45250&role.id=b76852b6c05a46a9b493c465fd3441a3 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:58.907462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760f1b7-07f5-4b04-879e-f348900f9105 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:58.915398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:58.936400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 156/317] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:11:59.033738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760f1b7-07f5-4b04-879e-f348900f9105 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:59.072390 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868c6c1-eb3c-4140-8e28-5de972013889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:59.073262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868c6c1-eb3c-4140-8e28-5de972013889 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:59.073733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868c6c1-eb3c-4140-8e28-5de972013889 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:59.074222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868c6c1-eb3c-4140-8e28-5de972013889 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:59.075084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868c6c1-eb3c-4140-8e28-5de972013889 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:59.075577 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868c6c1-eb3c-4140-8e28-5de972013889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:59.077795 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868c6c1-eb3c-4140-8e28-5de972013889 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:59.087984 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 162/318] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:11:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:59.097397 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c5471-7ac4-478c-a378-aa521aa21f6b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:59.222981 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c5471-7ac4-478c-a378-aa521aa21f6b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:59.241013 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868c6c1-eb3c-4140-8e28-5de972013889 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:59.254564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:59.270398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc51988-989e-4e59-bd45-97995f951088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:59.271004 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc51988-989e-4e59-bd45-97995f951088 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:59.271281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc51988-989e-4e59-bd45-97995f951088 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:59.271544 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc51988-989e-4e59-bd45-97995f951088 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:59.340073 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:59.349013 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc51988-989e-4e59-bd45-97995f951088 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:59.350562 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc51988-989e-4e59-bd45-97995f951088 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:59.371223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868c6c1-eb3c-4140-8e28-5de972013889 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:59.411274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d90da6-ad4c-49b7-876b-a03f2316c3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:59.411961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d90da6-ad4c-49b7-876b-a03f2316c3af None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:59.412269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d90da6-ad4c-49b7-876b-a03f2316c3af None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:59.412547 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d90da6-ad4c-49b7-876b-a03f2316c3af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:59.423010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d90da6-ad4c-49b7-876b-a03f2316c3af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:11:59.428570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-88d90da6-ad4c-49b7-876b-a03f2316c3af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:11:59.428570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:11:59.428570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:11:59.428570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:11:59.428570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:11:59.428570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:11:59.428570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:11:59.428570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:11:59.428570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:11:59.428570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:11:59.428570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:11:59.428570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:11:59.428570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:11:59.428570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:11:59.428570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:11:59.428570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:11:59.429439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:11:59.429439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:11:59.429439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:11:59.429439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:11:59.429439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:11:59.429439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:11:59.429439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:11:59.429439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:11:59.429439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:11:59.429439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:11:59.429439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:11:59.429439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:11:59.429439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:11:59.429439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:11:59.429439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:11:59.429439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:11:59.430400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:11:59.430400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:11:59.430400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:11:59.430400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:11:59.430400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:11:59.430400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:11:59.430400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:11:59.430400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:11:59.430400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:11:59.430400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:11:59.430400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:11:59.430400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:11:59.430400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 163/319] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 17 10:11:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:11:59.431204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60adae9-d26e-4ef1-800a-83849f874896 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:59.431204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60adae9-d26e-4ef1-800a-83849f874896 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:59.431358 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60adae9-d26e-4ef1-800a-83849f874896 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:59.432649 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 164/320] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:11:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:11:59.438523 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ff38d-6de5-4153-af70-e21254c9da53 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:59.438805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ff38d-6de5-4153-af70-e21254c9da53 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:59.439075 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ff38d-6de5-4153-af70-e21254c9da53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:59.457021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-637ff38d-6de5-4153-af70-e21254c9da53 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:11:59.458224 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-637ff38d-6de5-4153-af70-e21254c9da53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:11:59.475521 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 157/321] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:11:59.481153 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc51988-989e-4e59-bd45-97995f951088 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:59.526185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:59.538203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 165/322] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:11:59.539249 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ff38d-6de5-4153-af70-e21254c9da53 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:59.589253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:59.601459 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc51988-989e-4e59-bd45-97995f951088 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:59.648882 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7ecb1-64a9-4d19-bb68-7d8ce89ccd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:59.649666 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7ecb1-64a9-4d19-bb68-7d8ce89ccd8d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:59.649953 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7ecb1-64a9-4d19-bb68-7d8ce89ccd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:59.650224 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7ecb1-64a9-4d19-bb68-7d8ce89ccd8d None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:59.650893 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7ecb1-64a9-4d19-bb68-7d8ce89ccd8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:11:59.651199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7ecb1-64a9-4d19-bb68-7d8ce89ccd8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:59.653039 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7ecb1-64a9-4d19-bb68-7d8ce89ccd8d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:59.659788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ff38d-6de5-4153-af70-e21254c9da53 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:59.661122 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 158/323] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:11:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:59.667578 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7ecb1-64a9-4d19-bb68-7d8ce89ccd8d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:59.709766 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7a04f-f4c9-4773-bd74-895d78e5ccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:59.709766 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7a04f-f4c9-4773-bd74-895d78e5ccd2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:59.709766 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7a04f-f4c9-4773-bd74-895d78e5ccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:59.710119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7a04f-f4c9-4773-bd74-895d78e5ccd2 None admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:59.712524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7a04f-f4c9-4773-bd74-895d78e5ccd2 None admin] RBAC: Authorizing `identity:get_project(project_id=59dbb475fe1d46689ba2116ba560199f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:59.714539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7a04f-f4c9-4773-bd74-895d78e5ccd2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:59.716949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 166/324] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:11:59 2022] GET /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:11:59.722305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7a04f-f4c9-4773-bd74-895d78e5ccd2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:59.791973 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7ecb1-64a9-4d19-bb68-7d8ce89ccd8d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:59.798283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:59.837394 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e580d-15ed-49da-9131-4aac2fd109fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:59.837997 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e580d-15ed-49da-9131-4aac2fd109fb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:59.838275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e580d-15ed-49da-9131-4aac2fd109fb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:59.838543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e580d-15ed-49da-9131-4aac2fd109fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:59.843836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7a04f-f4c9-4773-bd74-895d78e5ccd2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:11:59.866333 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:11:59.885766 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539a006-ec2b-4f2c-abfb-46ecaf42ff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:11:59.886531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539a006-ec2b-4f2c-abfb-46ecaf42ff16 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:11:59.887163 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539a006-ec2b-4f2c-abfb-46ecaf42ff16 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:11:59.887453 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539a006-ec2b-4f2c-abfb-46ecaf42ff16 None admin] PATH_INFO: `/v3/groups/acfedbc720f84b02b4a151e21d2cfb15` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:11:59.889459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539a006-ec2b-4f2c-abfb-46ecaf42ff16 None admin] RBAC: Authorizing `identity:get_group(group_id=acfedbc720f84b02b4a151e21d2cfb15)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:59.892093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539a006-ec2b-4f2c-abfb-46ecaf42ff16 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:11:59.893432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 167/325] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Oct 17 10:11:59 2022] GET /identity/v3/groups/acfedbc720f84b02b4a151e21d2cfb15 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:11:59.894234 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539a006-ec2b-4f2c-abfb-46ecaf42ff16 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:11:59.923543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e580d-15ed-49da-9131-4aac2fd109fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:11:59.925023 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e580d-15ed-49da-9131-4aac2fd109fb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:00.009461 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539a006-ec2b-4f2c-abfb-46ecaf42ff16 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:00.040230 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 159/326] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:12:00.041279 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e580d-15ed-49da-9131-4aac2fd109fb None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:00.042063 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:00.049549 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa442d48-ad2e-4349-92cb-f35bed10fe4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:00.050371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa442d48-ad2e-4349-92cb-f35bed10fe4b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:00.050745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa442d48-ad2e-4349-92cb-f35bed10fe4b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:00.051124 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa442d48-ad2e-4349-92cb-f35bed10fe4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:00.065165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa442d48-ad2e-4349-92cb-f35bed10fe4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:00.070080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-aa442d48-ad2e-4349-92cb-f35bed10fe4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:12:00.070080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:00.070080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:00.070080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:00.070080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:00.070080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:00.070080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:00.070080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:00.070080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:00.070080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:00.070080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:00.070080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:00.070080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:00.070080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:00.070080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:00.070080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:00.070951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:00.070951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:00.070951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:00.070951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:00.070951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:00.070951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:00.070951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:00.070951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:00.070951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:00.070951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:00.070951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:00.070951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:00.070951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:00.070951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:00.070951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:00.070951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:00.072303 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:00.072303 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:00.072303 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:00.072303 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:00.072303 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:00.072303 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:00.072303 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:00.072303 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:00.072303 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:00.072303 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:00.072303 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:12:00.072303 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:00.072303 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 168/327] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:11:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:00.072942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa442d48-ad2e-4349-92cb-f35bed10fe4b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:00.114036 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:00.165088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e580d-15ed-49da-9131-4aac2fd109fb None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:00.197378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa442d48-ad2e-4349-92cb-f35bed10fe4b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:00.209826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28ba1d-a2d8-4d28-8368-0259e64d6f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:00.210593 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28ba1d-a2d8-4d28-8368-0259e64d6f45 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:00.210880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28ba1d-a2d8-4d28-8368-0259e64d6f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:00.211155 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28ba1d-a2d8-4d28-8368-0259e64d6f45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:00.212088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28ba1d-a2d8-4d28-8368-0259e64d6f45 None admin] RBAC: Adding query filter params (group.id=acfedbc720f84b02b4a151e21d2cfb15, role.id=5d2fc6de54204986a2c3aedc42288813, scope.project.id=59dbb475fe1d46689ba2116ba560199f) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:00.212402 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28ba1d-a2d8-4d28-8368-0259e64d6f45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:00.213831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28ba1d-a2d8-4d28-8368-0259e64d6f45 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:00.220710 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 160/328] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Oct 17 10:12:00 2022] GET /identity/v3/role_assignments?group.id=acfedbc720f84b02b4a151e21d2cfb15&scope.project.id=59dbb475fe1d46689ba2116ba560199f&role.id=5d2fc6de54204986a2c3aedc42288813 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:00.221377 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28ba1d-a2d8-4d28-8368-0259e64d6f45 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:00.241894 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7baf8-94ac-4515-ba0b-ae5d83e3439a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:00.242544 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7baf8-94ac-4515-ba0b-ae5d83e3439a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:00.242828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7baf8-94ac-4515-ba0b-ae5d83e3439a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:00.243103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7baf8-94ac-4515-ba0b-ae5d83e3439a None admin] PATH_INFO: `/v3/projects/59dbb475fe1d46689ba2116ba560199f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:00.244367 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7baf8-94ac-4515-ba0b-ae5d83e3439a None admin] RBAC: Authorizing `identity:get_project(project_id=59dbb475fe1d46689ba2116ba560199f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:00.245882 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7baf8-94ac-4515-ba0b-ae5d83e3439a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:00.249156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 169/329] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:12:00 2022] GET /identity/v3/projects/59dbb475fe1d46689ba2116ba560199f => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:00.255121 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7baf8-94ac-4515-ba0b-ae5d83e3439a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:00.336804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:00.354808 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28ba1d-a2d8-4d28-8368-0259e64d6f45 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:00.377208 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:00.387302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7baf8-94ac-4515-ba0b-ae5d83e3439a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:00.393562 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f81d90-db3e-4176-b1cc-6ba65b2bdb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:00.394184 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f81d90-db3e-4176-b1cc-6ba65b2bdb46 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:00.394463 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f81d90-db3e-4176-b1cc-6ba65b2bdb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:00.394738 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f81d90-db3e-4176-b1cc-6ba65b2bdb46 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:00.395411 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f81d90-db3e-4176-b1cc-6ba65b2bdb46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:00.396231 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f81d90-db3e-4176-b1cc-6ba65b2bdb46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:00.397608 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f81d90-db3e-4176-b1cc-6ba65b2bdb46 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:00.408476 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 161/330] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:12:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:00.414280 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f81d90-db3e-4176-b1cc-6ba65b2bdb46 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:00.425846 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b0d8e-49d2-4b8c-a76b-ffc58457d0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:00.426416 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b0d8e-49d2-4b8c-a76b-ffc58457d0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:00.426697 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b0d8e-49d2-4b8c-a76b-ffc58457d0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:00.426971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b0d8e-49d2-4b8c-a76b-ffc58457d0a3 None admin] PATH_INFO: `/v3/groups/acfedbc720f84b02b4a151e21d2cfb15` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:00.428142 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b0d8e-49d2-4b8c-a76b-ffc58457d0a3 None admin] RBAC: Authorizing `identity:get_group(group_id=acfedbc720f84b02b4a151e21d2cfb15)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:00.429599 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b0d8e-49d2-4b8c-a76b-ffc58457d0a3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:00.431550 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 170/331] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Oct 17 10:12:00 2022] GET /identity/v3/groups/acfedbc720f84b02b4a151e21d2cfb15 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:00.439056 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b0d8e-49d2-4b8c-a76b-ffc58457d0a3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:00.531210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f81d90-db3e-4176-b1cc-6ba65b2bdb46 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:00.564684 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b0d8e-49d2-4b8c-a76b-ffc58457d0a3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:00.573764 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bb2af-821d-4859-834b-1936ffcb89c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:00.574377 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bb2af-821d-4859-834b-1936ffcb89c4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:00.574654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bb2af-821d-4859-834b-1936ffcb89c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:00.574927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bb2af-821d-4859-834b-1936ffcb89c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:00.598862 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:00.608025 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5d3bf-dd2b-4d2d-a931-4eb09f2d3a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:00.608825 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5d3bf-dd2b-4d2d-a931-4eb09f2d3a29 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:00.609427 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5d3bf-dd2b-4d2d-a931-4eb09f2d3a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:00.609711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5d3bf-dd2b-4d2d-a931-4eb09f2d3a29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:00.610728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5d3bf-dd2b-4d2d-a931-4eb09f2d3a29 None admin] RBAC: Adding query filter params (group.id=acfedbc720f84b02b4a151e21d2cfb15, role.id=b76852b6c05a46a9b493c465fd3441a3, scope.project.id=59dbb475fe1d46689ba2116ba560199f) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:00.612534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5d3bf-dd2b-4d2d-a931-4eb09f2d3a29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:00.613986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5d3bf-dd2b-4d2d-a931-4eb09f2d3a29 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:00.620233 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 171/332] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Oct 17 10:12:00 2022] GET /identity/v3/role_assignments?group.id=acfedbc720f84b02b4a151e21d2cfb15&scope.project.id=59dbb475fe1d46689ba2116ba560199f&role.id=b76852b6c05a46a9b493c465fd3441a3 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:00.630938 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:00.651634 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bb2af-821d-4859-834b-1936ffcb89c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:00.653161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bb2af-821d-4859-834b-1936ffcb89c4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:00.762287 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 162/333] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:12:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 17 10:12:00.768445 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5d3bf-dd2b-4d2d-a931-4eb09f2d3a29 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:00.871254 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5d3bf-dd2b-4d2d-a931-4eb09f2d3a29 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:00.906817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e053fd-ff88-4b01-b5a9-aaa6a9016ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:00.907450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e053fd-ff88-4b01-b5a9-aaa6a9016ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:00.907736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e053fd-ff88-4b01-b5a9-aaa6a9016ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:00.908038 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e053fd-ff88-4b01-b5a9-aaa6a9016ab1 None admin] PATH_INFO: `/v3/projects/4fb717994bee40c5a122b7bec779dc47` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:00.909174 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e053fd-ff88-4b01-b5a9-aaa6a9016ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=4fb717994bee40c5a122b7bec779dc47)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:00.910609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e053fd-ff88-4b01-b5a9-aaa6a9016ab1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:00.912302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 172/334] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:12:00 2022] GET /identity/v3/projects/4fb717994bee40c5a122b7bec779dc47 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:00.918047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bb2af-821d-4859-834b-1936ffcb89c4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:01.001306 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:01.019770 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bb2af-821d-4859-834b-1936ffcb89c4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:01.051541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f511799-c4a0-48f5-ac9a-650e50d1dfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:01.052185 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f511799-c4a0-48f5-ac9a-650e50d1dfa1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:01.052465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f511799-c4a0-48f5-ac9a-650e50d1dfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:01.052737 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f511799-c4a0-48f5-ac9a-650e50d1dfa1 None admin] PATH_INFO: `/v3/groups/a23b6e75375b4f98bf876b14c0ce3aa6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:01.053826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f511799-c4a0-48f5-ac9a-650e50d1dfa1 None admin] RBAC: Authorizing `identity:get_group(group_id=a23b6e75375b4f98bf876b14c0ce3aa6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:01.055258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f511799-c4a0-48f5-ac9a-650e50d1dfa1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:01.056848 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 163/335] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Oct 17 10:12:00 2022] GET /identity/v3/groups/a23b6e75375b4f98bf876b14c0ce3aa6 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:01.063192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e053fd-ff88-4b01-b5a9-aaa6a9016ab1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:01.121821 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:01.161357 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e053fd-ff88-4b01-b5a9-aaa6a9016ab1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:01.192891 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfc836-3dbc-44db-af56-d1f3d6d5bc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:01.193485 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfc836-3dbc-44db-af56-d1f3d6d5bc86 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:01.193763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfc836-3dbc-44db-af56-d1f3d6d5bc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:01.194032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfc836-3dbc-44db-af56-d1f3d6d5bc86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:01.194753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfc836-3dbc-44db-af56-d1f3d6d5bc86 None admin] RBAC: Adding query filter params (group.id=a23b6e75375b4f98bf876b14c0ce3aa6, role.id=5e3dfffec8aa470fab9232cc439aec74, scope.project.id=4fb717994bee40c5a122b7bec779dc47) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:01.195057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfc836-3dbc-44db-af56-d1f3d6d5bc86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:01.196511 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfc836-3dbc-44db-af56-d1f3d6d5bc86 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:01.202521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 173/336] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Oct 17 10:12:01 2022] GET /identity/v3/role_assignments?group.id=a23b6e75375b4f98bf876b14c0ce3aa6&scope.project.id=4fb717994bee40c5a122b7bec779dc47&role.id=5e3dfffec8aa470fab9232cc439aec74 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:04.007550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d97cad-8867-42d2-b74f-6aa40d0e1e2f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:04.008144 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d97cad-8867-42d2-b74f-6aa40d0e1e2f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:04.008144 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d97cad-8867-42d2-b74f-6aa40d0e1e2f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:04.009785 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 164/337] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:04.014842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10aead-c52b-4748-a683-6bed63166475 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:04.015290 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10aead-c52b-4748-a683-6bed63166475 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:04.015371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10aead-c52b-4748-a683-6bed63166475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:04.040924 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1c10aead-c52b-4748-a683-6bed63166475 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:04.042132 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1c10aead-c52b-4748-a683-6bed63166475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:04.046200 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57aa1f-3246-425a-bcb2-12f10d71e5f9 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:04.046484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57aa1f-3246-425a-bcb2-12f10d71e5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:04.046758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57aa1f-3246-425a-bcb2-12f10d71e5f9 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:04.048368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 165/338] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:04.053456 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09313e6a-c8aa-4db5-8fae-eb4e455d4583 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:04.053748 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09313e6a-c8aa-4db5-8fae-eb4e455d4583 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:04.054029 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09313e6a-c8aa-4db5-8fae-eb4e455d4583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:04.081722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-09313e6a-c8aa-4db5-8fae-eb4e455d4583 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:04.082917 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-09313e6a-c8aa-4db5-8fae-eb4e455d4583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:04.160769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 174/339] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:04.223638 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 166/340] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:04.280324 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153872c-6ffa-4d9e-8c6a-7d0ec7c99044 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:04.280610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153872c-6ffa-4d9e-8c6a-7d0ec7c99044 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:04.280802 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153872c-6ffa-4d9e-8c6a-7d0ec7c99044 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:04.282377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 175/341] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:04.287756 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64764f01-0458-4b7e-bf3c-6caaa014ffba None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:04.288080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64764f01-0458-4b7e-bf3c-6caaa014ffba None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:04.288351 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64764f01-0458-4b7e-bf3c-6caaa014ffba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:04.312865 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-64764f01-0458-4b7e-bf3c-6caaa014ffba None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:04.314054 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-64764f01-0458-4b7e-bf3c-6caaa014ffba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:04.402487 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 167/342] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:04.518627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153872c-6ffa-4d9e-8c6a-7d0ec7c99044 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:04.546576 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64764f01-0458-4b7e-bf3c-6caaa014ffba None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:04.563293 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:04.616798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:04.674110 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153872c-6ffa-4d9e-8c6a-7d0ec7c99044 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:04.702107 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64764f01-0458-4b7e-bf3c-6caaa014ffba None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:04.712994 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabed81d-b707-4f9c-aa28-502474cbbd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:04.713636 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabed81d-b707-4f9c-aa28-502474cbbd4d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:04.713950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabed81d-b707-4f9c-aa28-502474cbbd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:04.714486 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabed81d-b707-4f9c-aa28-502474cbbd4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:04.726108 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabed81d-b707-4f9c-aa28-502474cbbd4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:04.727727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabed81d-b707-4f9c-aa28-502474cbbd4d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:04.739154 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051c67a-a106-4db8-9d4d-9c63235e78d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:04.739786 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051c67a-a106-4db8-9d4d-9c63235e78d3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:04.740092 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051c67a-a106-4db8-9d4d-9c63235e78d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:04.740358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051c67a-a106-4db8-9d4d-9c63235e78d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:04.743581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-dabed81d-b707-4f9c-aa28-502474cbbd4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:04.743581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:04.743581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:04.743581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:04.743581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:04.743581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:04.743581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:04.743581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:04.743581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:04.743581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:04.743581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:04.743581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:04.743581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:04.743581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:04.743581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:04.743581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:04.744671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:04.748817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:04.748817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:04.748817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:04.748817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 176/343] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:04.748817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70bbe2-772f-4ba1-b77a-b15b41762be1 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:04.748817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70bbe2-772f-4ba1-b77a-b15b41762be1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:04.748817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70bbe2-772f-4ba1-b77a-b15b41762be1 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:04.748817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 177/344] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:04.749408 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70bbe2-772f-4ba1-b77a-b15b41762be1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:04.756091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051c67a-a106-4db8-9d4d-9c63235e78d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:04.757586 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051c67a-a106-4db8-9d4d-9c63235e78d3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:04.773543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-2051c67a-a106-4db8-9d4d-9c63235e78d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:04.773543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:04.773543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:04.773543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:04.773543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:04.773543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:04.773543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:04.773543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:04.773543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:04.773543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:04.773543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:04.773543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:04.773543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:04.773543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:04.773543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:04.773543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:04.774639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:04.775515 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:04.775515 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:04.775515 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:04.775515 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 168/345] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:04.775837 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051c67a-a106-4db8-9d4d-9c63235e78d3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:04.838658 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:04.865230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70bbe2-772f-4ba1-b77a-b15b41762be1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:04.874055 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:04.882014 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051c67a-a106-4db8-9d4d-9c63235e78d3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:04.907218 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb67162-f30b-4aca-9620-d3a50b1f5694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:04.907898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb67162-f30b-4aca-9620-d3a50b1f5694 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:04.908206 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb67162-f30b-4aca-9620-d3a50b1f5694 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:04.908486 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb67162-f30b-4aca-9620-d3a50b1f5694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:04.917228 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db87c3-335a-46d1-a6ee-5aa242c2ace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:04.917868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db87c3-335a-46d1-a6ee-5aa242c2ace7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:04.918126 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db87c3-335a-46d1-a6ee-5aa242c2ace7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:04.918366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db87c3-335a-46d1-a6ee-5aa242c2ace7 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:04.918795 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb67162-f30b-4aca-9620-d3a50b1f5694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:04.919007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db87c3-335a-46d1-a6ee-5aa242c2ace7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:04.919824 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db87c3-335a-46d1-a6ee-5aa242c2ace7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:04.920883 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb67162-f30b-4aca-9620-d3a50b1f5694 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:04.921259 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db87c3-335a-46d1-a6ee-5aa242c2ace7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:04.933990 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 169/346] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:04.936126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4cb67162-f30b-4aca-9620-d3a50b1f5694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:04.936126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:04.936126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:04.936126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:04.936126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:04.936126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:04.936126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:04.936126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:04.936126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:04.936126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:04.936126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:04.936126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:04.936126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:04.936126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:04.936126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:04.936126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:04.937010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:04.937828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:04.937828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:04.937828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:04.937828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 178/347] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:04.938049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb67162-f30b-4aca-9620-d3a50b1f5694 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:04.943677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec2d72-9eb0-4f72-b32a-8c1e3a82f71e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:04.943677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec2d72-9eb0-4f72-b32a-8c1e3a82f71e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:04.943677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec2d72-9eb0-4f72-b32a-8c1e3a82f71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:04.959372 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-42ec2d72-9eb0-4f72-b32a-8c1e3a82f71e None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:04.961090 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-42ec2d72-9eb0-4f72-b32a-8c1e3a82f71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:05.040117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 170/348] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:05.041787 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec2d72-9eb0-4f72-b32a-8c1e3a82f71e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:05.055132 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb67162-f30b-4aca-9620-d3a50b1f5694 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:05.097212 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fadff-6ce6-460b-b401-4122aaa54d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:05.097834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fadff-6ce6-460b-b401-4122aaa54d73 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:05.098182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fadff-6ce6-460b-b401-4122aaa54d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:05.098524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fadff-6ce6-460b-b401-4122aaa54d73 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:05.099247 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fadff-6ce6-460b-b401-4122aaa54d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:05.099629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fadff-6ce6-460b-b401-4122aaa54d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:05.101157 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fadff-6ce6-460b-b401-4122aaa54d73 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:05.114537 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 179/349] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:05.115055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:05.115409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fadff-6ce6-460b-b401-4122aaa54d73 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:05.135679 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:05.172166 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec2d72-9eb0-4f72-b32a-8c1e3a82f71e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:05.208274 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71592a60-7f0b-4365-afa5-9495ddc4294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:05.208857 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71592a60-7f0b-4365-afa5-9495ddc4294f None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:05.209136 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71592a60-7f0b-4365-afa5-9495ddc4294f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:05.209406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71592a60-7f0b-4365-afa5-9495ddc4294f None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:05.210042 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71592a60-7f0b-4365-afa5-9495ddc4294f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:05.211474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71592a60-7f0b-4365-afa5-9495ddc4294f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:05.221872 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fadff-6ce6-460b-b401-4122aaa54d73 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:05.233816 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 171/350] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:12:05 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:05.235021 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71592a60-7f0b-4365-afa5-9495ddc4294f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:05.272128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693c6aa-e535-453f-8163-34753f0e9016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:05.273094 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693c6aa-e535-453f-8163-34753f0e9016 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:05.273574 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693c6aa-e535-453f-8163-34753f0e9016 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:05.274041 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693c6aa-e535-453f-8163-34753f0e9016 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:05.274889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693c6aa-e535-453f-8163-34753f0e9016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:05.275387 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693c6aa-e535-453f-8163-34753f0e9016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:05.276890 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693c6aa-e535-453f-8163-34753f0e9016 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:05.289642 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 180/351] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:05.295712 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a04a71-5aac-4ce5-8c6d-9f5885787856 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:05.296092 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a04a71-5aac-4ce5-8c6d-9f5885787856 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:05.296470 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a04a71-5aac-4ce5-8c6d-9f5885787856 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:05.298206 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 181/352] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:05.298998 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a04a71-5aac-4ce5-8c6d-9f5885787856 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:05.366904 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71592a60-7f0b-4365-afa5-9495ddc4294f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:05.377145 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:05.392820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:05.412376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c1546-0310-48bd-beb4-576ffaadd079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:05.413000 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c1546-0310-48bd-beb4-576ffaadd079 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:05.413282 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c1546-0310-48bd-beb4-576ffaadd079 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:05.413553 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c1546-0310-48bd-beb4-576ffaadd079 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:05.414210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c1546-0310-48bd-beb4-576ffaadd079 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:05.415671 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c1546-0310-48bd-beb4-576ffaadd079 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:05.421594 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a04a71-5aac-4ce5-8c6d-9f5885787856 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:05.438724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 172/353] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:12:05 2022] POST /identity/v3/users => generated 246 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:05.440506 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27ec88-81a2-4f0e-8b06-b0294bee0425 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:05.440790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27ec88-81a2-4f0e-8b06-b0294bee0425 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:05.441063 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27ec88-81a2-4f0e-8b06-b0294bee0425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:05.465640 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bb27ec88-81a2-4f0e-8b06-b0294bee0425 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:05.467208 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bb27ec88-81a2-4f0e-8b06-b0294bee0425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:05.470246 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4572d9-6101-451b-a40e-f312d3c98dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:05.472078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4572d9-6101-451b-a40e-f312d3c98dda None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:05.472370 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4572d9-6101-451b-a40e-f312d3c98dda None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:05.477287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4572d9-6101-451b-a40e-f312d3c98dda None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:05.477287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4572d9-6101-451b-a40e-f312d3c98dda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:05.477287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4572d9-6101-451b-a40e-f312d3c98dda None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:05.503442 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 182/354] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:12:05 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:05.504354 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4572d9-6101-451b-a40e-f312d3c98dda None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:05.577049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 173/355] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:05.646653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4572d9-6101-451b-a40e-f312d3c98dda None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:05.686855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cfd2c-6785-4b34-860f-58a47d3136aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:05.687509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cfd2c-6785-4b34-860f-58a47d3136aa None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:05.687793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cfd2c-6785-4b34-860f-58a47d3136aa None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:05.688103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cfd2c-6785-4b34-860f-58a47d3136aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:05.690316 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:05.703190 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cfd2c-6785-4b34-860f-58a47d3136aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:05.704841 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cfd2c-6785-4b34-860f-58a47d3136aa None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:05.721284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b16cfd2c-6785-4b34-860f-58a47d3136aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:05.721284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:05.721284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:05.721284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:05.721284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:05.721284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:05.721284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:05.721284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:05.721284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:05.721284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:05.721284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:05.721284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:05.721284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:05.721284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:05.721284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:05.721284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:05.722235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:05.723040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:05.723040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:05.723040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:05.723040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 183/356] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:05.728837 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27ec88-81a2-4f0e-8b06-b0294bee0425 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:05.830061 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:05.837637 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27ec88-81a2-4f0e-8b06-b0294bee0425 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:05.877076 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76066bb1-b260-42d4-8f20-874549f5b4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:05.877308 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cfd2c-6785-4b34-860f-58a47d3136aa None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:05.877691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76066bb1-b260-42d4-8f20-874549f5b4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:05.877965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76066bb1-b260-42d4-8f20-874549f5b4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:05.878289 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76066bb1-b260-42d4-8f20-874549f5b4b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:05.878936 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76066bb1-b260-42d4-8f20-874549f5b4b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:05.879237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76066bb1-b260-42d4-8f20-874549f5b4b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:05.880637 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76066bb1-b260-42d4-8f20-874549f5b4b6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:05.896349 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 174/357] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:05.902130 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76066bb1-b260-42d4-8f20-874549f5b4b6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:06.029720 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cfd2c-6785-4b34-860f-58a47d3136aa None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:06.070068 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76066bb1-b260-42d4-8f20-874549f5b4b6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:06.073631 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e9cbc-458c-4a73-85ce-33593c9f9d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:06.074709 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e9cbc-458c-4a73-85ce-33593c9f9d47 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:06.075125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e9cbc-458c-4a73-85ce-33593c9f9d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:06.075558 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e9cbc-458c-4a73-85ce-33593c9f9d47 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:06.076428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e9cbc-458c-4a73-85ce-33593c9f9d47 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:06.077969 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e9cbc-458c-4a73-85ce-33593c9f9d47 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:06.088668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.sql.core [None req-544e9cbc-458c-4a73-85ce-33593c9f9d47 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 17 10:12:06.088668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 17 10:12:06.088668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [parameters: {'id': 'aade94cb79154f95a7bcf22a0e589add', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 17 10:12:06.088668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 17 10:12:06.116794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-544e9cbc-458c-4a73-85ce-33593c9f9d47 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 17 10:12:06.116794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:06.116794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 10:12:06.116794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 10:12:06.116794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 10:12:06.116794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 10:12:06.116794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 10:12:06.116794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 10:12:06.116794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 10:12:06.116794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application conn.query(q) Oct 17 10:12:06.116794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 10:12:06.116794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 10:12:06.116794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 10:12:06.116794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result.read() Oct 17 10:12:06.116794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return ref.to_dict() Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 10:12:06.117870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application next(self.gen) Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application yield resource Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application next(self.gen) Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.session.rollback() Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.force_reraise() Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise self.value Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application session.commit() Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 17 10:12:06.118986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._prepare_impl() Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.session.flush() Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._flush(objects) Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application compat.raise_( Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application flush_context.execute() Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rec.execute(self) Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 10:12:06.120006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 17 10:12:06.120901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 10:12:06.120901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 17 10:12:06.120901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 17 10:12:06.120901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 17 10:12:06.120901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 10:12:06.120901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 10:12:06.120901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 10:12:06.120901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 17 10:12:06.120901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 10:12:06.120901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 17 10:12:06.120901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 10:12:06.120901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 17 10:12:06.120901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 10:12:06.120901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 10:12:06.120901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 10:12:06.120901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception Oct 17 10:12:06.121685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 10:12:06.121685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 10:12:06.121685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 10:12:06.121685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 10:12:06.121685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 10:12:06.121685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 10:12:06.121685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 10:12:06.121685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application conn.query(q) Oct 17 10:12:06.121685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 10:12:06.121685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 10:12:06.121685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 10:12:06.121685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result.read() Oct 17 10:12:06.121685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 10:12:06.121685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 10:12:06.121685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 10:12:06.121685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 10:12:06.122964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 10:12:06.122964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 10:12:06.122964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 10:12:06.122964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 10:12:06.122964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 17 10:12:06.122964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 17 10:12:06.122964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [parameters: {'id': 'aade94cb79154f95a7bcf22a0e589add', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 17 10:12:06.122964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 10:12:06.122964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:06.122964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:06.122964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:06.122964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:06.122964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:06.122964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:06.122964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:06.122964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:06.123785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:06.123785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:06.123785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:06.123785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:06.123785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:06.123785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:06.123785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 17 10:12:06.123785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 17 10:12:06.123785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:06.123785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:06.123785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 17 10:12:06.123785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 17 10:12:06.123785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 17 10:12:06.123785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 17 10:12:06.123785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 17 10:12:06.123785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:06.133489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 184/358] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Oct 17 10:12:05 2022] POST /identity/v3/roles => generated 144 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:06.141855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e9cbc-458c-4a73-85ce-33593c9f9d47 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:06.149208 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805fcfe-7f52-4891-a13e-539a2fe8677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:06.149828 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805fcfe-7f52-4891-a13e-539a2fe8677c None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:06.150109 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805fcfe-7f52-4891-a13e-539a2fe8677c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:06.150384 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805fcfe-7f52-4891-a13e-539a2fe8677c None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:06.151039 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805fcfe-7f52-4891-a13e-539a2fe8677c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:06.156496 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805fcfe-7f52-4891-a13e-539a2fe8677c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:06.196556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 175/359] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:12:05 2022] POST /identity/v3/users => generated 249 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:06.227812 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:06.291530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e9cbc-458c-4a73-85ce-33593c9f9d47 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:06.338910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1670953-35a0-4e22-857b-59e039377704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:06.339564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1670953-35a0-4e22-857b-59e039377704 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:06.339844 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1670953-35a0-4e22-857b-59e039377704 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:06.340151 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1670953-35a0-4e22-857b-59e039377704 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:06.352851 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1670953-35a0-4e22-857b-59e039377704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:06.358829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a1670953-35a0-4e22-857b-59e039377704 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:12:06.358829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:06.358829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:06.358829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:06.358829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:06.358829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:06.358829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:06.358829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:06.358829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:06.358829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:06.358829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:06.358829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:06.358829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:06.358829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:06.358829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:06.358829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:06.359743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:06.359743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:06.359743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:06.359743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:06.359743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:06.359743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:06.359743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:06.359743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:06.359743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:06.359743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:06.359743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:06.359743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:06.359743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:06.359743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:06.359743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:06.359743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:06.360552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:06.360552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:06.360552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:06.360552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:06.360552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:06.360552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:06.360552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:06.360552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:06.360552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:06.360552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:06.360552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 10:12:06.360552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:06.360552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 185/360] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 17 10:12:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:06.365908 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805fcfe-7f52-4891-a13e-539a2fe8677c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:06.392013 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:06.513432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805fcfe-7f52-4891-a13e-539a2fe8677c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:06.553901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdbfc2-5fb7-4173-9ab8-ea2d681a0c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:06.554571 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdbfc2-5fb7-4173-9ab8-ea2d681a0c69 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:06.554853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdbfc2-5fb7-4173-9ab8-ea2d681a0c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:06.555124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdbfc2-5fb7-4173-9ab8-ea2d681a0c69 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:06.555797 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdbfc2-5fb7-4173-9ab8-ea2d681a0c69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:06.556163 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdbfc2-5fb7-4173-9ab8-ea2d681a0c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:06.557538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdbfc2-5fb7-4173-9ab8-ea2d681a0c69 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:06.566331 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 176/361] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:07.840851 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed0574-98a0-482d-86ca-16015766f49a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:07.842382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed0574-98a0-482d-86ca-16015766f49a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:07.842880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed0574-98a0-482d-86ca-16015766f49a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:07.844731 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 186/362] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:07.850192 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32966c-ec59-4ac4-96bf-ca1783c342d6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:07.851026 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32966c-ec59-4ac4-96bf-ca1783c342d6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:07.851492 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32966c-ec59-4ac4-96bf-ca1783c342d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:07.875446 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7c32966c-ec59-4ac4-96bf-ca1783c342d6 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:07.876985 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7c32966c-ec59-4ac4-96bf-ca1783c342d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:07.962882 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 177/363] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:08.245775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9171c-3d95-4270-9330-f762e6ce9e58 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:08.246131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9171c-3d95-4270-9330-f762e6ce9e58 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:08.246332 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9171c-3d95-4270-9330-f762e6ce9e58 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:08.248576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 187/364] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:08.253889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090b327-6f94-4c09-a4a6-60917fe14353 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:08.254182 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090b327-6f94-4c09-a4a6-60917fe14353 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:08.254456 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090b327-6f94-4c09-a4a6-60917fe14353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:08.260829 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:08.273957 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0de1d-9c7c-48b4-a919-0acfc764eb69 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:08.274580 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0de1d-9c7c-48b4-a919-0acfc764eb69 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:08.274823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1090b327-6f94-4c09-a4a6-60917fe14353 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:08.275279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0de1d-9c7c-48b4-a919-0acfc764eb69 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:08.276041 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1090b327-6f94-4c09-a4a6-60917fe14353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:08.277410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 188/365] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:12:08.282591 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8148f4-effa-4e87-b673-160bb4abe5fe None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:08.283127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8148f4-effa-4e87-b673-160bb4abe5fe None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:08.283603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8148f4-effa-4e87-b673-160bb4abe5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:08.302520 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2d8148f4-effa-4e87-b673-160bb4abe5fe None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:08.304223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2d8148f4-effa-4e87-b673-160bb4abe5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:08.373438 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 178/366] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:08.374664 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090b327-6f94-4c09-a4a6-60917fe14353 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:08.411990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 189/367] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:12:08.501438 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090b327-6f94-4c09-a4a6-60917fe14353 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:08.541287 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:08.547603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd699c-c11b-407f-a579-1dd4fc2c3942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:08.548252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd699c-c11b-407f-a579-1dd4fc2c3942 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:08.548582 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd699c-c11b-407f-a579-1dd4fc2c3942 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:08.548902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd699c-c11b-407f-a579-1dd4fc2c3942 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:08.564688 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd699c-c11b-407f-a579-1dd4fc2c3942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:08.570513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f3cd699c-c11b-407f-a579-1dd4fc2c3942 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:08.570513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:08.570513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:08.570513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:08.570513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:08.570513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:08.570513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:08.570513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:08.570513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:08.570513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:08.570513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:08.570513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:08.570513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:08.570513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:08.570513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:08.570513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:08.571381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:08.571381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:08.571381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:08.571381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:08.571381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:08.571381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:08.571381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:08.571381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:08.571381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:08.571381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:08.571381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:08.571381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:08.571381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:08.571381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:08.571381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:08.571381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:08.572199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:08.572199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:08.572199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:08.572199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:08.572199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:08.572199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:08.572199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:08.572199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:08.572199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:08.572199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:08.572199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:08.572199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:08.572199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 179/368] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 17 10:12:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:08.577688 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8148f4-effa-4e87-b673-160bb4abe5fe None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:08.634545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:08.710938 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8148f4-effa-4e87-b673-160bb4abe5fe None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:08.755868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd699c-c11b-407f-a579-1dd4fc2c3942 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:08.758692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58246b-3a64-4178-a82f-6f2fd5789e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:08.759310 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58246b-3a64-4178-a82f-6f2fd5789e6b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:08.759586 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58246b-3a64-4178-a82f-6f2fd5789e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:08.759851 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58246b-3a64-4178-a82f-6f2fd5789e6b None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:08.760558 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58246b-3a64-4178-a82f-6f2fd5789e6b None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:08.760856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58246b-3a64-4178-a82f-6f2fd5789e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:08.762233 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58246b-3a64-4178-a82f-6f2fd5789e6b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:08.776418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 190/369] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 17 10:12:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:08.778122 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58246b-3a64-4178-a82f-6f2fd5789e6b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:08.892905 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58246b-3a64-4178-a82f-6f2fd5789e6b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:08.894396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:08.899671 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd699c-c11b-407f-a579-1dd4fc2c3942 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:08.930237 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e3980-71ef-4bae-9925-e56d05ea5d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:08.930881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e3980-71ef-4bae-9925-e56d05ea5d7a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:08.931159 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e3980-71ef-4bae-9925-e56d05ea5d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:08.931431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e3980-71ef-4bae-9925-e56d05ea5d7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:08.944434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a164cc-52ea-4e81-91eb-ade2e93989ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:08.944736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e3980-71ef-4bae-9925-e56d05ea5d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:08.945074 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a164cc-52ea-4e81-91eb-ade2e93989ae None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:08.945348 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a164cc-52ea-4e81-91eb-ade2e93989ae None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:08.945616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a164cc-52ea-4e81-91eb-ade2e93989ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:08.946209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e3980-71ef-4bae-9925-e56d05ea5d7a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:08.957053 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a164cc-52ea-4e81-91eb-ade2e93989ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:08.962529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d5a164cc-52ea-4e81-91eb-ade2e93989ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:08.962529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:08.962529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:08.962529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:08.962529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:08.962529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:08.962529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:08.962529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:08.962529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:08.962529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:08.962529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:08.962529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:08.962529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:08.962529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:08.962529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:08.962529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:08.963458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:08.963458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:08.963458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:08.963458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:08.963458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:08.963458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:08.963458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:08.963458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:08.963458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:08.963458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:08.963458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:08.963458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:08.963458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:08.963458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:08.963458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:08.963458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:08.964267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:08.964267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:08.964267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:08.964267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:08.964267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:08.964267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:08.964267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:08.964267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:08.964267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:08.964267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:08.964267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:08.964267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:08.964866 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 180/370] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 17 10:12:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:08.969801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a164cc-52ea-4e81-91eb-ade2e93989ae None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:08.973837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-6e2e3980-71ef-4bae-9925-e56d05ea5d7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:08.973837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:08.973837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:08.973837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:08.973837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:08.973837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:08.973837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:08.973837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:08.973837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:08.973837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:08.973837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:08.973837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:08.973837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:08.973837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:08.973837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:08.973837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:08.974828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:08.975670 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:08.975670 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:08.975670 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:08.978232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 191/371] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:08.979202 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e3980-71ef-4bae-9925-e56d05ea5d7a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:09.038729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:09.100047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a164cc-52ea-4e81-91eb-ade2e93989ae None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:09.116167 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e3980-71ef-4bae-9925-e56d05ea5d7a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:09.144354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a7cc3-33c7-43ea-ba0e-131c56a7cddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:09.145567 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a7cc3-33c7-43ea-ba0e-131c56a7cddc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:09.146059 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a7cc3-33c7-43ea-ba0e-131c56a7cddc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:09.146552 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a7cc3-33c7-43ea-ba0e-131c56a7cddc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:09.159151 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6dcea-8012-4d7f-9704-0bfc12bc4c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:09.159958 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6dcea-8012-4d7f-9704-0bfc12bc4c63 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:09.160332 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6dcea-8012-4d7f-9704-0bfc12bc4c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:09.160669 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6dcea-8012-4d7f-9704-0bfc12bc4c63 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:09.161470 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6dcea-8012-4d7f-9704-0bfc12bc4c63 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:09.161817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6dcea-8012-4d7f-9704-0bfc12bc4c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:09.162484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a7cc3-33c7-43ea-ba0e-131c56a7cddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:09.163360 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6dcea-8012-4d7f-9704-0bfc12bc4c63 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:09.168940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-af8a7cc3-33c7-43ea-ba0e-131c56a7cddc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:09.168940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:09.168940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:09.168940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:09.168940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:09.168940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:09.168940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:09.168940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:09.168940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:09.168940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:09.168940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:09.168940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:09.168940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:09.168940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:09.168940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:09.168940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:09.169927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:09.169927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:09.169927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:09.169927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:09.169927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:09.169927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:09.169927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:09.169927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:09.169927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:09.169927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:09.169927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:09.169927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:09.169927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:09.169927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:09.169927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:09.169927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:09.170729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:09.170729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:09.170729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:09.170729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:09.170729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:09.170729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:09.170729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:09.170729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:09.170729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:09.170729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:09.170729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:09.170729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:09.173463 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 181/372] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 17 10:12:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:09.174138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a7cc3-33c7-43ea-ba0e-131c56a7cddc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:09.182449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 192/373] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 17 10:12:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:09.182449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6dcea-8012-4d7f-9704-0bfc12bc4c63 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:09.200444 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:09.285507 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6dcea-8012-4d7f-9704-0bfc12bc4c63 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:09.299970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a7cc3-33c7-43ea-ba0e-131c56a7cddc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:09.314575 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:09.323178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5ed6e-937b-488a-b114-1a6f8074ba52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:09.323789 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5ed6e-937b-488a-b114-1a6f8074ba52 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:09.324101 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5ed6e-937b-488a-b114-1a6f8074ba52 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:09.324374 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5ed6e-937b-488a-b114-1a6f8074ba52 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:09.325035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5ed6e-937b-488a-b114-1a6f8074ba52 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:09.325405 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5ed6e-937b-488a-b114-1a6f8074ba52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:09.327340 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5ed6e-937b-488a-b114-1a6f8074ba52 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:09.339979 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 193/374] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 17 10:12:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:09.339979 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5ed6e-937b-488a-b114-1a6f8074ba52 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:09.340946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4be96-5ecc-4ddd-b709-90bfef67aea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:09.341596 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4be96-5ecc-4ddd-b709-90bfef67aea0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:09.341872 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4be96-5ecc-4ddd-b709-90bfef67aea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:09.342139 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4be96-5ecc-4ddd-b709-90bfef67aea0 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:09.342786 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4be96-5ecc-4ddd-b709-90bfef67aea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:09.343090 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4be96-5ecc-4ddd-b709-90bfef67aea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:09.344490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4be96-5ecc-4ddd-b709-90bfef67aea0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:09.356897 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 182/375] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:09.358268 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff53e41-5f63-4728-a986-a765b5283484 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:09.358559 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff53e41-5f63-4728-a986-a765b5283484 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:09.358836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff53e41-5f63-4728-a986-a765b5283484 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:09.360376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 183/376] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:09.365427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff53e41-5f63-4728-a986-a765b5283484 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:09.430655 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:09.455591 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5ed6e-937b-488a-b114-1a6f8074ba52 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:09.473154 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff53e41-5f63-4728-a986-a765b5283484 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:09.492283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dba4c8-299f-4753-b1a6-a261ea52a0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:09.492961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dba4c8-299f-4753-b1a6-a261ea52a0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:09.493238 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dba4c8-299f-4753-b1a6-a261ea52a0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:09.493508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dba4c8-299f-4753-b1a6-a261ea52a0b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:09.504325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dba4c8-299f-4753-b1a6-a261ea52a0b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:09.505766 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dba4c8-299f-4753-b1a6-a261ea52a0b4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:09.507750 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af3245-771f-48dc-a2e3-06f8a11b2afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:09.508403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af3245-771f-48dc-a2e3-06f8a11b2afb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:09.508678 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af3245-771f-48dc-a2e3-06f8a11b2afb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:09.508948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af3245-771f-48dc-a2e3-06f8a11b2afb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:09.518824 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af3245-771f-48dc-a2e3-06f8a11b2afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:09.519305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-00dba4c8-299f-4753-b1a6-a261ea52a0b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:09.519305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:09.519305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:09.519305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:09.519305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:09.519305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:09.519305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:09.519305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:09.519305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:09.519305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:09.519305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:09.519305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:09.519305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:09.519305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:09.519305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:09.519305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:09.520204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:09.521130 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:09.521130 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:09.521130 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:09.521290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af3245-771f-48dc-a2e3-06f8a11b2afb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:09.521356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 194/377] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:09.521356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dba4c8-299f-4753-b1a6-a261ea52a0b4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:09.539239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-03af3245-771f-48dc-a2e3-06f8a11b2afb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:09.539239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:09.539239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:09.539239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:09.539239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:09.539239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:09.539239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:09.539239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:09.539239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:09.539239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:09.539239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:09.539239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:09.539239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:09.539239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:09.539239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:09.539239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:09.540290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:09.541162 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:09.541162 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:09.541162 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:09.541162 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 184/378] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:09.545798 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337b2c5-0c29-4aae-a0ca-d0553bfe1bba None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:09.546086 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337b2c5-0c29-4aae-a0ca-d0553bfe1bba None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:09.546363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337b2c5-0c29-4aae-a0ca-d0553bfe1bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:09.564538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1337b2c5-0c29-4aae-a0ca-d0553bfe1bba None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:09.565669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1337b2c5-0c29-4aae-a0ca-d0553bfe1bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:09.582416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:09.623262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dba4c8-299f-4753-b1a6-a261ea52a0b4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:09.630433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 185/379] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:09.631477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8bfb7-d6b6-4c4d-a798-52198a9089fa None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:09.631757 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8bfb7-d6b6-4c4d-a798-52198a9089fa None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:09.632055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8bfb7-d6b6-4c4d-a798-52198a9089fa None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:09.635733 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 186/380] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:09.635733 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8bfb7-d6b6-4c4d-a798-52198a9089fa None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:09.655282 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:09.661304 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e1f61-eb65-4b3f-87c7-f9f4ccd3aff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:09.661955 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e1f61-eb65-4b3f-87c7-f9f4ccd3aff8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:09.662233 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e1f61-eb65-4b3f-87c7-f9f4ccd3aff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:09.662502 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e1f61-eb65-4b3f-87c7-f9f4ccd3aff8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:09.669939 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e1f61-eb65-4b3f-87c7-f9f4ccd3aff8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:09.671377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e1f61-eb65-4b3f-87c7-f9f4ccd3aff8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:09.683609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d40e1f61-eb65-4b3f-87c7-f9f4ccd3aff8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 17 10:12:09.683609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:09.683609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:09.683609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:09.683609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:09.683609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:09.683609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:09.683609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:09.683609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:09.683609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:09.683609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:09.683609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:09.683609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:09.683609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:09.683609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:09.683609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:09.684727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:09.685657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:09.685657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:09.685657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:09.685657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:09.685657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:09.685657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:09.685657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:09.685657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:09.685657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 17 10:12:09.685657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:09.685657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 195/381] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:12:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:09.685657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e1f61-eb65-4b3f-87c7-f9f4ccd3aff8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:09.754172 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8bfb7-d6b6-4c4d-a798-52198a9089fa None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:09.790702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36c62e-a5b1-41a0-b21b-ca91ff95b27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:09.791302 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36c62e-a5b1-41a0-b21b-ca91ff95b27e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:09.791573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36c62e-a5b1-41a0-b21b-ca91ff95b27e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:09.791843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36c62e-a5b1-41a0-b21b-ca91ff95b27e None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:09.792508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36c62e-a5b1-41a0-b21b-ca91ff95b27e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:09.792809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36c62e-a5b1-41a0-b21b-ca91ff95b27e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:09.794158 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36c62e-a5b1-41a0-b21b-ca91ff95b27e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:09.795490 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e1f61-eb65-4b3f-87c7-f9f4ccd3aff8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:09.811990 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 187/382] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:09.811990 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60777e8a-8133-45c6-a155-032a8df0ed2e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:09.811990 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60777e8a-8133-45c6-a155-032a8df0ed2e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:09.811990 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60777e8a-8133-45c6-a155-032a8df0ed2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:09.828110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-60777e8a-8133-45c6-a155-032a8df0ed2e None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:09.829219 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-60777e8a-8133-45c6-a155-032a8df0ed2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:09.834724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bc83a-fc51-4da0-a37c-25a52023cb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:09.835329 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bc83a-fc51-4da0-a37c-25a52023cb0c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:09.835608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bc83a-fc51-4da0-a37c-25a52023cb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:09.835879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bc83a-fc51-4da0-a37c-25a52023cb0c None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:09.836955 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9bc83a-fc51-4da0-a37c-25a52023cb0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:09.837261 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9bc83a-fc51-4da0-a37c-25a52023cb0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:09.838228 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:09.838990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9bc83a-fc51-4da0-a37c-25a52023cb0c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:09.852902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 196/383] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:09.858283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bc83a-fc51-4da0-a37c-25a52023cb0c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:09.902654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 188/384] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:09.904211 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60777e8a-8133-45c6-a155-032a8df0ed2e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:09.908513 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:09.960649 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bc83a-fc51-4da0-a37c-25a52023cb0c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:09.998022 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb8b96-2015-4835-ba09-dd7e4a87abbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:09.998627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb8b96-2015-4835-ba09-dd7e4a87abbb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:09.998903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb8b96-2015-4835-ba09-dd7e4a87abbb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:09.999171 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb8b96-2015-4835-ba09-dd7e4a87abbb None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:09.999887 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb8b96-2015-4835-ba09-dd7e4a87abbb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:10.000221 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb8b96-2015-4835-ba09-dd7e4a87abbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:10.001708 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb8b96-2015-4835-ba09-dd7e4a87abbb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:10.007063 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60777e8a-8133-45c6-a155-032a8df0ed2e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:10.041843 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 197/385] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Oct 17 10:12:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:10.042724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb8b96-2015-4835-ba09-dd7e4a87abbb None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:10.044190 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da1e53-e27e-431f-a2e6-196e919d0f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:10.044881 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da1e53-e27e-431f-a2e6-196e919d0f75 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:10.045165 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da1e53-e27e-431f-a2e6-196e919d0f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:10.045603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da1e53-e27e-431f-a2e6-196e919d0f75 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:10.054789 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da1e53-e27e-431f-a2e6-196e919d0f75 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:10.058957 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da1e53-e27e-431f-a2e6-196e919d0f75 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:10.075303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-38da1e53-e27e-431f-a2e6-196e919d0f75 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 10:12:10.075303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:10.075303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:10.075303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:10.075303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:10.075303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:10.075303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:10.075303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:10.075303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:10.075303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:10.075303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:10.075303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:10.075303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:10.075303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:10.075303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:10.075303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:10.076320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:10.077171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:10.077171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:10.077171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:10.077171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:10.077171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:10.077171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:10.077171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:10.077171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:10.077171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 10:12:10.077171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:10.077171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 189/386] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:12:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:10.077753 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da1e53-e27e-431f-a2e6-196e919d0f75 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:10.084976 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:10.152823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb8b96-2015-4835-ba09-dd7e4a87abbb None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:10.161910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:10.186865 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da1e53-e27e-431f-a2e6-196e919d0f75 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:10.187590 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f2d91-35d7-49cb-adc8-b06bd5315a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:10.188267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f2d91-35d7-49cb-adc8-b06bd5315a63 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:10.188549 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f2d91-35d7-49cb-adc8-b06bd5315a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:10.188829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f2d91-35d7-49cb-adc8-b06bd5315a63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:10.195780 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f2d91-35d7-49cb-adc8-b06bd5315a63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:10.197301 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f2d91-35d7-49cb-adc8-b06bd5315a63 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:10.209284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-876f2d91-35d7-49cb-adc8-b06bd5315a63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 10:12:10.209284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:10.209284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:10.209284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:10.209284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:10.209284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:10.209284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:10.209284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:10.209284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:10.209284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:10.209284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:10.209284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:10.209284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:10.209284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:10.209284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:10.209284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:10.210228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:10.211179 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:10.211179 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:10.211179 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:10.211179 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:10.211179 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:10.211179 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:10.211179 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:10.211179 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:10.211179 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 10:12:10.211179 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:10.214910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 198/387] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Oct 17 10:12:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:10.215671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f2d91-35d7-49cb-adc8-b06bd5315a63 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:10.220540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f095dc-dc26-4865-8cbf-c628c4ff1284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:10.221163 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f095dc-dc26-4865-8cbf-c628c4ff1284 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:10.221501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f095dc-dc26-4865-8cbf-c628c4ff1284 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:10.221778 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f095dc-dc26-4865-8cbf-c628c4ff1284 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:10.232669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f095dc-dc26-4865-8cbf-c628c4ff1284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:10.237902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-03f095dc-dc26-4865-8cbf-c628c4ff1284 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:10.237902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:10.237902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:10.237902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:10.237902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:10.237902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:10.237902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:10.237902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:10.237902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:10.237902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:10.237902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:10.237902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:10.237902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:10.237902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:10.237902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:10.237902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:10.238766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:10.238766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:10.238766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:10.238766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:10.238766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:10.238766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:10.238766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:10.238766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:10.238766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:10.238766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:10.238766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:10.238766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:10.238766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:10.238766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:10.238766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:10.238766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:10.239621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:10.239621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:10.239621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:10.239621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:10.239621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:10.239621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:10.239621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:10.239621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:10.239621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:10.239621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:10.239621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:10.239621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:10.239621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 190/388] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 17 10:12:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:10.240627 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f095dc-dc26-4865-8cbf-c628c4ff1284 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:10.301827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:10.313968 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f2d91-35d7-49cb-adc8-b06bd5315a63 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:10.339478 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f095dc-dc26-4865-8cbf-c628c4ff1284 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:10.346393 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7832f-a769-498f-9689-f2d2482a3824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:10.347010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7832f-a769-498f-9689-f2d2482a3824 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:10.347288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7832f-a769-498f-9689-f2d2482a3824 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:10.347560 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7832f-a769-498f-9689-f2d2482a3824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:10.359028 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7832f-a769-498f-9689-f2d2482a3824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:10.360221 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7832f-a769-498f-9689-f2d2482a3824 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:10.372248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7a414-17d4-419b-99bb-73747384255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:10.372893 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7a414-17d4-419b-99bb-73747384255f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:10.373171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7a414-17d4-419b-99bb-73747384255f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:10.373442 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7a414-17d4-419b-99bb-73747384255f None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:10.373864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9cb7832f-a769-498f-9689-f2d2482a3824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:10.373864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:10.373864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:10.373864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:10.373864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:10.373864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:10.373864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:10.373864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:10.373864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:10.373864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:10.373864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:10.373864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:10.373864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:10.373864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:10.373864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:10.373864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:10.374852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:10.380381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:10.380381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:10.380381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:10.380540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7a414-17d4-419b-99bb-73747384255f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:10.380540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7a414-17d4-419b-99bb-73747384255f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:10.380672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 199/389] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:10.380672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7832f-a769-498f-9689-f2d2482a3824 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:10.380783 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7a414-17d4-419b-99bb-73747384255f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:10.401764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:10.414463 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 191/390] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Oct 17 10:12:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:10.415295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7a414-17d4-419b-99bb-73747384255f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:10.479602 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7832f-a769-498f-9689-f2d2482a3824 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:10.514692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f407c1-78f0-4b5a-866a-c2b7dad6b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:10.515321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f407c1-78f0-4b5a-866a-c2b7dad6b679 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:10.515598 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f407c1-78f0-4b5a-866a-c2b7dad6b679 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:10.515871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f407c1-78f0-4b5a-866a-c2b7dad6b679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:10.517479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7a414-17d4-419b-99bb-73747384255f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:10.526102 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f407c1-78f0-4b5a-866a-c2b7dad6b679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:10.527548 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f407c1-78f0-4b5a-866a-c2b7dad6b679 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:10.539023 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:10.541385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e3f407c1-78f0-4b5a-866a-c2b7dad6b679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:10.541385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:10.541385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:10.541385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:10.541385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:10.541385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:10.541385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:10.541385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:10.541385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:10.541385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:10.541385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:10.541385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:10.541385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:10.541385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:10.541385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:10.541385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:10.542455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:10.543313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:10.543313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:10.543313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:10.543313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 200/391] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:10.543313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f407c1-78f0-4b5a-866a-c2b7dad6b679 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:10.555190 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3604fd-721f-43d4-97d4-660d116ea775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:10.555795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3604fd-721f-43d4-97d4-660d116ea775 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:10.556102 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3604fd-721f-43d4-97d4-660d116ea775 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:10.556422 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3604fd-721f-43d4-97d4-660d116ea775 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:10.557152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3604fd-721f-43d4-97d4-660d116ea775 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:10.557456 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3604fd-721f-43d4-97d4-660d116ea775 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:10.558892 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3604fd-721f-43d4-97d4-660d116ea775 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:10.577389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 192/392] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Oct 17 10:12:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:10.578173 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3604fd-721f-43d4-97d4-660d116ea775 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:10.618351 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:10.648818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f407c1-78f0-4b5a-866a-c2b7dad6b679 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:10.673747 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3604fd-721f-43d4-97d4-660d116ea775 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:10.681992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e674a-771c-4ada-80cd-72a621abc13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:10.682595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e674a-771c-4ada-80cd-72a621abc13c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:10.682876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e674a-771c-4ada-80cd-72a621abc13c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:10.683150 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e674a-771c-4ada-80cd-72a621abc13c None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:10.683818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e674a-771c-4ada-80cd-72a621abc13c None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:10.684151 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e674a-771c-4ada-80cd-72a621abc13c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:10.686061 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e674a-771c-4ada-80cd-72a621abc13c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:10.693703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 201/393] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 17 10:12:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:10.694482 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e674a-771c-4ada-80cd-72a621abc13c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:10.707431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa150b-516b-497b-924a-85556332835b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:10.708118 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa150b-516b-497b-924a-85556332835b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:10.708402 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa150b-516b-497b-924a-85556332835b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:10.708679 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa150b-516b-497b-924a-85556332835b None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:10.709322 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa150b-516b-497b-924a-85556332835b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:10.709635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa150b-516b-497b-924a-85556332835b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:10.711000 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa150b-516b-497b-924a-85556332835b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:10.723970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 193/394] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:10.723970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa150b-516b-497b-924a-85556332835b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:10.765350 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:10.796265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e674a-771c-4ada-80cd-72a621abc13c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:10.822097 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa150b-516b-497b-924a-85556332835b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:10.829305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6443f-193a-45fd-940c-b108de327c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:10.830006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6443f-193a-45fd-940c-b108de327c30 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:10.830360 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6443f-193a-45fd-940c-b108de327c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:10.830635 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6443f-193a-45fd-940c-b108de327c30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:10.832487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:10.841669 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6443f-193a-45fd-940c-b108de327c30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:10.843214 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6443f-193a-45fd-940c-b108de327c30 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:10.855414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94db16-0cd9-4590-b4d7-da6bbc3cbc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:10.856125 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94db16-0cd9-4590-b4d7-da6bbc3cbc7d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:10.856404 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94db16-0cd9-4590-b4d7-da6bbc3cbc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:10.856673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94db16-0cd9-4590-b4d7-da6bbc3cbc7d None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:10.857178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-bdd6443f-193a-45fd-940c-b108de327c30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:10.857178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:10.857178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:10.857178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:10.857178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:10.857178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:10.857178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:10.857178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:10.857178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:10.857178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:10.857178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:10.857178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:10.857178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:10.857178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:10.857178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:10.857178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:10.858173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:10.859025 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:10.859025 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:10.859025 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:10.859184 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94db16-0cd9-4590-b4d7-da6bbc3cbc7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:10.859184 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94db16-0cd9-4590-b4d7-da6bbc3cbc7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:10.859299 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 202/395] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:10.859369 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94db16-0cd9-4590-b4d7-da6bbc3cbc7d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:10.859442 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6443f-193a-45fd-940c-b108de327c30 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:10.874088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 194/396] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:10.874962 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94db16-0cd9-4590-b4d7-da6bbc3cbc7d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:10.960553 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6443f-193a-45fd-940c-b108de327c30 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:10.971804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:10.974782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94db16-0cd9-4590-b4d7-da6bbc3cbc7d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:10.994123 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e622638-e923-415b-82db-f258e0e98ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:10.994745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e622638-e923-415b-82db-f258e0e98ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:10.995023 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e622638-e923-415b-82db-f258e0e98ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:10.995295 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e622638-e923-415b-82db-f258e0e98ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:11.005414 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e622638-e923-415b-82db-f258e0e98ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:11.006870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e622638-e923-415b-82db-f258e0e98ab7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:11.007803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c6112-990b-46bc-97db-096403282781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:11.008447 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c6112-990b-46bc-97db-096403282781 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:11.008720 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c6112-990b-46bc-97db-096403282781 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:11.008986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c6112-990b-46bc-97db-096403282781 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:11.019145 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c6112-990b-46bc-97db-096403282781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:11.020624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c6112-990b-46bc-97db-096403282781 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:11.021228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9e622638-e923-415b-82db-f258e0e98ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:11.021228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:11.021228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:11.021228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:11.021228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:11.021228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:11.021228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:11.021228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:11.021228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:11.021228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:11.021228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:11.021228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:11.021228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:11.021228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:11.021228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:11.021228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:11.022281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:11.023097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:11.023097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:11.023097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:11.023097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 203/397] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:11.023097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e622638-e923-415b-82db-f258e0e98ab7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:11.037079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ea5c6112-990b-46bc-97db-096403282781 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:11.037079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:11.037079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:11.037079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:11.037079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:11.037079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:11.037079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:11.037079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:11.037079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:11.037079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:11.037079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:11.037079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:11.037079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:11.037079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:11.037079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:11.037079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:11.038143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:11.039006 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:11.039006 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:11.039006 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:11.039006 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 195/398] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:11.039709 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c6112-990b-46bc-97db-096403282781 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:11.063432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:11.123391 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e622638-e923-415b-82db-f258e0e98ab7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:11.143801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c6112-990b-46bc-97db-096403282781 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:11.156082 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95833dfe-5642-4c99-b9a6-811be2e72d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:11.156701 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95833dfe-5642-4c99-b9a6-811be2e72d63 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:11.156974 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95833dfe-5642-4c99-b9a6-811be2e72d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:11.157244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95833dfe-5642-4c99-b9a6-811be2e72d63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:11.163561 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95833dfe-5642-4c99-b9a6-811be2e72d63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:11.165042 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95833dfe-5642-4c99-b9a6-811be2e72d63 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:11.176323 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab55331-2660-4147-a008-e55df7c22ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:11.176915 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab55331-2660-4147-a008-e55df7c22ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:11.177080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-95833dfe-5642-4c99-b9a6-811be2e72d63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:11.177080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:11.177080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:11.177080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:11.177080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:11.177080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:11.177080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:11.177080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:11.177080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:11.177080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:11.177080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:11.177080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:11.177080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:11.177080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:11.177080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:11.178029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:11.178865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:11.178865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:11.178865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:11.178865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:11.178865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:11.178865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:11.178865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:11.178865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:11.179262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab55331-2660-4147-a008-e55df7c22ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:11.179262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab55331-2660-4147-a008-e55df7c22ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:11.179262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab55331-2660-4147-a008-e55df7c22ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:11.179435 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 204/399] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:11.179498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab55331-2660-4147-a008-e55df7c22ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:11.179568 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95833dfe-5642-4c99-b9a6-811be2e72d63 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:11.179721 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab55331-2660-4147-a008-e55df7c22ad6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:11.193945 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 196/400] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:11.194758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab55331-2660-4147-a008-e55df7c22ad6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:11.211973 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:11.275614 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:11.279984 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95833dfe-5642-4c99-b9a6-811be2e72d63 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:11.296389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab55331-2660-4147-a008-e55df7c22ad6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:11.313508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb275a5-1332-4387-ac02-549208420424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:11.314099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb275a5-1332-4387-ac02-549208420424 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:11.314379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb275a5-1332-4387-ac02-549208420424 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:11.314648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb275a5-1332-4387-ac02-549208420424 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:11.315286 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb275a5-1332-4387-ac02-549208420424 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:11.316738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb275a5-1332-4387-ac02-549208420424 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:11.328448 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9af95-a618-4441-9048-303ee7d1d804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:11.328997 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9af95-a618-4441-9048-303ee7d1d804 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:11.329431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9af95-a618-4441-9048-303ee7d1d804 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:11.329741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9af95-a618-4441-9048-303ee7d1d804 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:11.330522 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9af95-a618-4441-9048-303ee7d1d804 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:11.330836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9af95-a618-4441-9048-303ee7d1d804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:11.332371 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9af95-a618-4441-9048-303ee7d1d804 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:11.337342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 205/401] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:12:11 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:11.338299 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb275a5-1332-4387-ac02-549208420424 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:11.351216 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 197/402] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:11.352243 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9af95-a618-4441-9048-303ee7d1d804 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:11.437204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:11.470362 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9af95-a618-4441-9048-303ee7d1d804 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:11.473407 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb275a5-1332-4387-ac02-549208420424 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:11.510066 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b6e84-41df-427d-9ac7-edc633465e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:11.510696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b6e84-41df-427d-9ac7-edc633465e02 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:11.510980 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b6e84-41df-427d-9ac7-edc633465e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:11.511261 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b6e84-41df-427d-9ac7-edc633465e02 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:11.511441 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedac79a-1995-4124-a452-0ee870e00aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:11.511919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b6e84-41df-427d-9ac7-edc633465e02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:11.512668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac79a-1995-4124-a452-0ee870e00aea None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:11.512768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b6e84-41df-427d-9ac7-edc633465e02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:11.512836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac79a-1995-4124-a452-0ee870e00aea None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:11.512836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac79a-1995-4124-a452-0ee870e00aea None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:11.513317 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedac79a-1995-4124-a452-0ee870e00aea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:11.513623 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedac79a-1995-4124-a452-0ee870e00aea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:11.513717 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b6e84-41df-427d-9ac7-edc633465e02 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:11.515043 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedac79a-1995-4124-a452-0ee870e00aea None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:11.527512 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 206/403] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:11.528276 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b6e84-41df-427d-9ac7-edc633465e02 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:11.534826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 198/404] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:11.535673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedac79a-1995-4124-a452-0ee870e00aea None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:11.545130 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:11.641528 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b6e84-41df-427d-9ac7-edc633465e02 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:11.642316 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedac79a-1995-4124-a452-0ee870e00aea None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:11.671907 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:11.677119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b86c19-708f-4556-9aae-6bdf7d0ac357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:11.677750 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b86c19-708f-4556-9aae-6bdf7d0ac357 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:11.678031 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b86c19-708f-4556-9aae-6bdf7d0ac357 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:11.678195 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2085e1-7a83-4a79-a415-10f68e03165b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:11.678331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b86c19-708f-4556-9aae-6bdf7d0ac357 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:11.678811 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2085e1-7a83-4a79-a415-10f68e03165b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:11.679084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2085e1-7a83-4a79-a415-10f68e03165b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:11.679351 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2085e1-7a83-4a79-a415-10f68e03165b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:11.685666 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b86c19-708f-4556-9aae-6bdf7d0ac357 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:11.686605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2085e1-7a83-4a79-a415-10f68e03165b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:11.687104 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b86c19-708f-4556-9aae-6bdf7d0ac357 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:11.688119 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2085e1-7a83-4a79-a415-10f68e03165b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:11.698525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-13b86c19-708f-4556-9aae-6bdf7d0ac357 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:11.698525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:11.698525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:11.698525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:11.698525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:11.698525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:11.698525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:11.698525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:11.698525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:11.698525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:11.698525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:11.698525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:11.698525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:11.698525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:11.698525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:11.699377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:11.700319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:11.700319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:11.700319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:11.700319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:11.700319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:11.700319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:11.700319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:11.700319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:11.701251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-bb2085e1-7a83-4a79-a415-10f68e03165b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:11.701251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:11.701251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:11.701251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:11.701251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:11.701251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:11.701251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:11.701251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:11.701251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:11.701251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:11.701251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:11.701251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:11.701251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:11.701251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:11.701251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:11.701977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:11.707439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:11.707439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:11.707439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:11.707439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:11.707439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:11.707439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:11.707439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:11.707439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:11.707439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 199/405] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:11.707439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2085e1-7a83-4a79-a415-10f68e03165b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:11.708432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 207/406] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:11.708432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b86c19-708f-4556-9aae-6bdf7d0ac357 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:11.791791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:11.812210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2085e1-7a83-4a79-a415-10f68e03165b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:11.820072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b86c19-708f-4556-9aae-6bdf7d0ac357 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:11.848657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29010178-3adb-4c17-8f96-61a40d2b8b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:11.849276 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010178-3adb-4c17-8f96-61a40d2b8b51 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:11.849551 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010178-3adb-4c17-8f96-61a40d2b8b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:11.849816 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010178-3adb-4c17-8f96-61a40d2b8b51 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:11.857665 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29010178-3adb-4c17-8f96-61a40d2b8b51 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:11.859049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f2768-8668-4f13-a91d-6159d1ce0ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:11.859168 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29010178-3adb-4c17-8f96-61a40d2b8b51 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:11.859718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f2768-8668-4f13-a91d-6159d1ce0ccd None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:11.860028 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f2768-8668-4f13-a91d-6159d1ce0ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:11.860307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f2768-8668-4f13-a91d-6159d1ce0ccd None admin] PATH_INFO: `/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/2bd5d41f6a16403f990a4cd5922a2644/roles/365b9c4c3245430e872f4aa988da3beb` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:11.870502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-29010178-3adb-4c17-8f96-61a40d2b8b51 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 17 10:12:11.870502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:11.870502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:11.870502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:11.870502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:11.870502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:11.870502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:11.870502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:11.870502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:11.870502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:11.870502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:11.870502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:11.870502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:11.870502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:11.870502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:11.870502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:11.871398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:11.872385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:11.872385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:11.872385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:11.872385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:11.872385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:11.872385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:11.872385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:11.872385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:11.872385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 17 10:12:11.872385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:11.872385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 200/407] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 17 10:12:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:11.872970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29010178-3adb-4c17-8f96-61a40d2b8b51 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:11.879813 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f2768-8668-4f13-a91d-6159d1ce0ccd None admin] RBAC: Authorizing `identity:create_grant(project_id=07b2dd5de0274a6896d407b0ff22ff54, user_id=2bd5d41f6a16403f990a4cd5922a2644, role_id=365b9c4c3245430e872f4aa988da3beb)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:11.881766 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f2768-8668-4f13-a91d-6159d1ce0ccd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:11.896318 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 208/408] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:12:11 2022] PUT /identity/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/2bd5d41f6a16403f990a4cd5922a2644/roles/365b9c4c3245430e872f4aa988da3beb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:12:11.897132 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f2768-8668-4f13-a91d-6159d1ce0ccd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:11.945407 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:12.011651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29010178-3adb-4c17-8f96-61a40d2b8b51 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:12.048634 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f2768-8668-4f13-a91d-6159d1ce0ccd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:12.069609 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32372812-adc5-425d-8c5d-e2fc08a2a0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:12.070229 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32372812-adc5-425d-8c5d-e2fc08a2a0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:12.070513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32372812-adc5-425d-8c5d-e2fc08a2a0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:12.070786 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32372812-adc5-425d-8c5d-e2fc08a2a0d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:12.072027 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32372812-adc5-425d-8c5d-e2fc08a2a0d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:12.072504 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32372812-adc5-425d-8c5d-e2fc08a2a0d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:12.074103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32372812-adc5-425d-8c5d-e2fc08a2a0d0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:12.087347 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:12.088536 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 201/409] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:12.089363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32372812-adc5-425d-8c5d-e2fc08a2a0d0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:12.101919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61b2b5-3de0-4072-9a3b-c56d458e636c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:12.102541 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61b2b5-3de0-4072-9a3b-c56d458e636c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:12.102822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61b2b5-3de0-4072-9a3b-c56d458e636c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:12.103084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61b2b5-3de0-4072-9a3b-c56d458e636c None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:12.103788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61b2b5-3de0-4072-9a3b-c56d458e636c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:12.104128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61b2b5-3de0-4072-9a3b-c56d458e636c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:12.105833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61b2b5-3de0-4072-9a3b-c56d458e636c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:12.124997 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 209/410] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:12.126334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61b2b5-3de0-4072-9a3b-c56d458e636c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:12.215468 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32372812-adc5-425d-8c5d-e2fc08a2a0d0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:12.235033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:12.246943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61b2b5-3de0-4072-9a3b-c56d458e636c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:12.256862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe2566-7260-4f80-9577-4d9547b08c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:12.257599 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe2566-7260-4f80-9577-4d9547b08c93 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:12.257951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe2566-7260-4f80-9577-4d9547b08c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:12.258298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe2566-7260-4f80-9577-4d9547b08c93 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:12.259108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe2566-7260-4f80-9577-4d9547b08c93 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:12.259526 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe2566-7260-4f80-9577-4d9547b08c93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:12.261119 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe2566-7260-4f80-9577-4d9547b08c93 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:12.279810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 202/411] 10.222.0.13 () {56 vars in 1139 bytes} [Mon Oct 17 10:12:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:12.280872 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe2566-7260-4f80-9577-4d9547b08c93 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:12.284985 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca5a08-5e56-497c-8a4a-7fa3d380aa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:12.285723 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca5a08-5e56-497c-8a4a-7fa3d380aa04 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:12.286002 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca5a08-5e56-497c-8a4a-7fa3d380aa04 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:12.286268 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca5a08-5e56-497c-8a4a-7fa3d380aa04 None admin] PATH_INFO: `/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/6099c38837b44101a17470322916c82e/roles/365b9c4c3245430e872f4aa988da3beb` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:12.302618 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca5a08-5e56-497c-8a4a-7fa3d380aa04 None admin] RBAC: Authorizing `identity:create_grant(project_id=07b2dd5de0274a6896d407b0ff22ff54, user_id=6099c38837b44101a17470322916c82e, role_id=365b9c4c3245430e872f4aa988da3beb)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:12.304101 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca5a08-5e56-497c-8a4a-7fa3d380aa04 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:12.320623 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 210/412] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:12:12 2022] PUT /identity/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/6099c38837b44101a17470322916c82e/roles/365b9c4c3245430e872f4aa988da3beb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:12:12.321559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca5a08-5e56-497c-8a4a-7fa3d380aa04 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:12.368326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:12.452242 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe2566-7260-4f80-9577-4d9547b08c93 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:12.505039 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33533d3a-2181-4e32-b2ce-17ad67c0d48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:12.505628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33533d3a-2181-4e32-b2ce-17ad67c0d48e None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:12.505901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33533d3a-2181-4e32-b2ce-17ad67c0d48e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:12.506168 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33533d3a-2181-4e32-b2ce-17ad67c0d48e None admin] PATH_INFO: `/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/a80cc7ec3d2d49f88c81403f918a6900/roles/365b9c4c3245430e872f4aa988da3beb` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:12.520078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca5a08-5e56-497c-8a4a-7fa3d380aa04 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:12.539389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33533d3a-2181-4e32-b2ce-17ad67c0d48e None admin] RBAC: Authorizing `identity:create_grant(project_id=07b2dd5de0274a6896d407b0ff22ff54, user_id=a80cc7ec3d2d49f88c81403f918a6900, role_id=365b9c4c3245430e872f4aa988da3beb)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:12.540930 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33533d3a-2181-4e32-b2ce-17ad67c0d48e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:12.557993 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 203/413] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:12:12 2022] PUT /identity/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/a80cc7ec3d2d49f88c81403f918a6900/roles/365b9c4c3245430e872f4aa988da3beb => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:12:12.573080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77f1ac-231b-4952-b1b1-5c7d8278b033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:12.574057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77f1ac-231b-4952-b1b1-5c7d8278b033 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:12.574541 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77f1ac-231b-4952-b1b1-5c7d8278b033 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:12.575009 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77f1ac-231b-4952-b1b1-5c7d8278b033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:12.590069 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77f1ac-231b-4952-b1b1-5c7d8278b033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:12.591973 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77f1ac-231b-4952-b1b1-5c7d8278b033 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:12.609277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3f77f1ac-231b-4952-b1b1-5c7d8278b033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:12.609277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:12.609277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:12.609277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:12.609277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:12.609277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:12.609277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:12.609277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:12.609277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:12.609277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:12.609277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:12.609277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:12.609277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:12.609277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:12.609277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:12.609277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:12.610429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:12.611451 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:12.611451 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:12.611451 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:12.613310 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 211/414] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:12.619983 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33533d3a-2181-4e32-b2ce-17ad67c0d48e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:12.644761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:12.765306 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33533d3a-2181-4e32-b2ce-17ad67c0d48e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:12.803852 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d89eb9-741c-46e0-aec0-8b919bdf6dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:12.804702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d89eb9-741c-46e0-aec0-8b919bdf6dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:12.805074 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d89eb9-741c-46e0-aec0-8b919bdf6dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:12.805436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d89eb9-741c-46e0-aec0-8b919bdf6dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:12.806169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d89eb9-741c-46e0-aec0-8b919bdf6dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:12.806617 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d89eb9-741c-46e0-aec0-8b919bdf6dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:12.808092 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d89eb9-741c-46e0-aec0-8b919bdf6dd4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:12.819868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 204/415] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:12.824970 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77f1ac-231b-4952-b1b1-5c7d8278b033 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:12.921531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:12.945795 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77f1ac-231b-4952-b1b1-5c7d8278b033 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:12.990554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d5af3-f0ff-469b-a25c-fdfaae1b739b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:12.991333 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d5af3-f0ff-469b-a25c-fdfaae1b739b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:12.991709 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d5af3-f0ff-469b-a25c-fdfaae1b739b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:12.992118 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d5af3-f0ff-469b-a25c-fdfaae1b739b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:13.003134 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d5af3-f0ff-469b-a25c-fdfaae1b739b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:13.004800 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d5af3-f0ff-469b-a25c-fdfaae1b739b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:13.017515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f27d5af3-f0ff-469b-a25c-fdfaae1b739b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:13.017515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:13.017515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:13.017515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:13.017515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:13.017515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:13.017515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:13.017515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:13.017515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:13.017515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:13.017515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:13.017515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:13.017515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:13.017515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:13.017515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:13.018339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:13.019339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:13.019339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:13.019339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:13.019339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:13.019339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:13.019339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:13.019339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:13.019339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:13.019339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 212/416] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:13.024182 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d89eb9-741c-46e0-aec0-8b919bdf6dd4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:13.128121 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:13.150239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d89eb9-741c-46e0-aec0-8b919bdf6dd4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:13.194588 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988be61-430a-4962-82b6-7b101f3c801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:13.195255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988be61-430a-4962-82b6-7b101f3c801e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:13.195535 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988be61-430a-4962-82b6-7b101f3c801e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:13.195804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988be61-430a-4962-82b6-7b101f3c801e None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:13.196523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988be61-430a-4962-82b6-7b101f3c801e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:13.196825 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988be61-430a-4962-82b6-7b101f3c801e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:13.198288 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988be61-430a-4962-82b6-7b101f3c801e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:13.218601 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 205/417] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:13.224423 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d5af3-f0ff-469b-a25c-fdfaae1b739b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:13.335156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d5af3-f0ff-469b-a25c-fdfaae1b739b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:13.370080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b42e6-b668-4804-98a9-0bd5326d1237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:13.370738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b42e6-b668-4804-98a9-0bd5326d1237 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:13.371012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b42e6-b668-4804-98a9-0bd5326d1237 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:13.371283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b42e6-b668-4804-98a9-0bd5326d1237 None admin] PATH_INFO: `/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/98030e60807e44ec928488e904ca24c9/roles/365b9c4c3245430e872f4aa988da3beb` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:13.386118 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b42e6-b668-4804-98a9-0bd5326d1237 None admin] RBAC: Authorizing `identity:create_grant(project_id=07b2dd5de0274a6896d407b0ff22ff54, user_id=98030e60807e44ec928488e904ca24c9, role_id=365b9c4c3245430e872f4aa988da3beb)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:13.387639 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b42e6-b668-4804-98a9-0bd5326d1237 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:13.392416 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:13.402855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 213/418] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:12:13 2022] PUT /identity/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/98030e60807e44ec928488e904ca24c9/roles/365b9c4c3245430e872f4aa988da3beb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:12:13.715057 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc9ad-2d93-4955-bb0f-62d41073926f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:13.715430 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc9ad-2d93-4955-bb0f-62d41073926f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:13.715634 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc9ad-2d93-4955-bb0f-62d41073926f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:13.717747 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 206/419] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:13.723119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55061898-17f8-4a0b-937d-99afb7b9e3bf None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:13.723406 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55061898-17f8-4a0b-937d-99afb7b9e3bf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:13.723676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55061898-17f8-4a0b-937d-99afb7b9e3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:13.742664 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-55061898-17f8-4a0b-937d-99afb7b9e3bf None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:13.743852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-55061898-17f8-4a0b-937d-99afb7b9e3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:13.812613 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 214/420] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:14.083469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bc9ad-2d93-4955-bb0f-62d41073926f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:14.223900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bc9ad-2d93-4955-bb0f-62d41073926f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:14.266135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b796a2-9d10-480c-9e87-6b172e910620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:14.266763 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b796a2-9d10-480c-9e87-6b172e910620 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:14.267039 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b796a2-9d10-480c-9e87-6b172e910620 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:14.267310 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b796a2-9d10-480c-9e87-6b172e910620 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:14.275440 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:14.279324 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b796a2-9d10-480c-9e87-6b172e910620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:14.284843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-b3b796a2-9d10-480c-9e87-6b172e910620 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:14.284843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:14.284843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:14.284843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:14.284843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:14.284843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:14.284843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:14.284843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:14.284843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:14.284843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:14.284843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:14.284843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:14.284843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:14.284843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:14.284843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:14.284843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:14.285730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:14.285730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:14.285730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:14.285730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:14.285730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:14.285730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:14.285730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:14.285730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:14.285730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:14.285730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:14.285730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:14.285730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:14.285730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:14.285730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:14.285730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:14.285730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:14.286519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:14.286519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:14.286519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:14.286519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:14.286519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:14.286519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:14.286519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:14.286519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:14.286519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:14.286519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:14.286519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:14.286519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:14.286519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 207/421] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 17 10:12:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:14.293043 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55061898-17f8-4a0b-937d-99afb7b9e3bf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:14.426957 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55061898-17f8-4a0b-937d-99afb7b9e3bf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:14.456337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:14.461932 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec054eac-c2b7-4883-b1d3-af926301164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:14.462546 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054eac-c2b7-4883-b1d3-af926301164e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:14.462955 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054eac-c2b7-4883-b1d3-af926301164e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:14.463147 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054eac-c2b7-4883-b1d3-af926301164e None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:14.464018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec054eac-c2b7-4883-b1d3-af926301164e None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:14.464397 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec054eac-c2b7-4883-b1d3-af926301164e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:14.465909 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec054eac-c2b7-4883-b1d3-af926301164e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:14.475498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 215/422] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 17 10:12:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:14.481087 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b796a2-9d10-480c-9e87-6b172e910620 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:14.611061 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b796a2-9d10-480c-9e87-6b172e910620 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:14.651815 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51e51b-93e7-4113-b86d-d34930710e89 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:14.652157 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51e51b-93e7-4113-b86d-d34930710e89 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:14.652381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51e51b-93e7-4113-b86d-d34930710e89 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:14.655187 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 216/423] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:14.659183 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedd369-55e9-4607-acc8-d29c7a4caa8d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:14.659380 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e691d-4787-43fe-b812-1dd82afc7471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:14.659557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedd369-55e9-4607-acc8-d29c7a4caa8d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:14.659732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedd369-55e9-4607-acc8-d29c7a4caa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:14.659996 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e691d-4787-43fe-b812-1dd82afc7471 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:14.660280 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e691d-4787-43fe-b812-1dd82afc7471 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:14.660552 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e691d-4787-43fe-b812-1dd82afc7471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:14.679737 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e691d-4787-43fe-b812-1dd82afc7471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:14.681144 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e691d-4787-43fe-b812-1dd82afc7471 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:14.695174 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8bedd369-55e9-4607-acc8-d29c7a4caa8d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:14.696464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8bedd369-55e9-4607-acc8-d29c7a4caa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:14.707868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-658e691d-4787-43fe-b812-1dd82afc7471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:14.707868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:14.707868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:14.707868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:14.707868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:14.707868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:14.707868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:14.707868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:14.707868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:14.707868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:14.707868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:14.707868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:14.707868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:14.707868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:14.707868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:14.707868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:14.710341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:14.712494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:14.712494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:14.712494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:14.712494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 208/424] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:14.715647 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e691d-4787-43fe-b812-1dd82afc7471 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:14.812950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:14.846209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 217/425] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:12:14.862915 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38384907-89de-41b1-b08d-148d7c530d96 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:14.863257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38384907-89de-41b1-b08d-148d7c530d96 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:14.863465 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38384907-89de-41b1-b08d-148d7c530d96 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:14.865081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 218/426] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:12:14.866833 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e691d-4787-43fe-b812-1dd82afc7471 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:14.870342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e7390-ad5a-4cf7-8e64-7adb20683841 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:14.870624 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e7390-ad5a-4cf7-8e64-7adb20683841 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:14.870899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e7390-ad5a-4cf7-8e64-7adb20683841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:14.904261 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f21e7390-ad5a-4cf7-8e64-7adb20683841 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:14.905437 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f21e7390-ad5a-4cf7-8e64-7adb20683841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:14.913367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d1b8a-f404-4c4c-985b-12bd4b57ac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:14.913974 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d1b8a-f404-4c4c-985b-12bd4b57ac07 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:14.914252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d1b8a-f404-4c4c-985b-12bd4b57ac07 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:14.914521 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d1b8a-f404-4c4c-985b-12bd4b57ac07 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:14.915170 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d1b8a-f404-4c4c-985b-12bd4b57ac07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:14.915473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d1b8a-f404-4c4c-985b-12bd4b57ac07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:14.916942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d1b8a-f404-4c4c-985b-12bd4b57ac07 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:14.939750 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 209/427] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:14.945352 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d1b8a-f404-4c4c-985b-12bd4b57ac07 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:15.031363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 219/428] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:12:15.120772 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d1b8a-f404-4c4c-985b-12bd4b57ac07 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:15.156086 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:15.156381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e7390-ad5a-4cf7-8e64-7adb20683841 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:15.172296 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931ce1f-95c3-40e1-b58d-6f7f48e7afb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:15.173847 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931ce1f-95c3-40e1-b58d-6f7f48e7afb2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:15.174526 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931ce1f-95c3-40e1-b58d-6f7f48e7afb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:15.176063 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931ce1f-95c3-40e1-b58d-6f7f48e7afb2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:15.188907 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931ce1f-95c3-40e1-b58d-6f7f48e7afb2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:15.188907 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931ce1f-95c3-40e1-b58d-6f7f48e7afb2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:15.200911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-8931ce1f-95c3-40e1-b58d-6f7f48e7afb2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 17 10:12:15.200911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:15.200911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:15.200911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:15.200911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:15.200911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:15.200911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:15.200911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:15.200911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:15.200911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:15.200911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:15.200911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:15.200911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:15.200911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:15.200911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:15.200911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:15.202012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:15.203135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:15.203135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:15.203135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:15.203135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:15.203135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:15.203135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:15.203135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:15.203135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:15.203135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 17 10:12:15.203135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:15.208829 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 210/429] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:12:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:15.210827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931ce1f-95c3-40e1-b58d-6f7f48e7afb2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:15.259071 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:15.349739 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e7390-ad5a-4cf7-8e64-7adb20683841 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:15.386735 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931ce1f-95c3-40e1-b58d-6f7f48e7afb2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:15.417567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b33bf1-20dc-4300-bf84-a925c1873a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:15.418317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b33bf1-20dc-4300-bf84-a925c1873a91 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:15.418595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b33bf1-20dc-4300-bf84-a925c1873a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:15.418865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b33bf1-20dc-4300-bf84-a925c1873a91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:15.431427 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b33bf1-20dc-4300-bf84-a925c1873a91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:15.432373 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fef92-7af2-4227-94ae-d3540b96aea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:15.432972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fef92-7af2-4227-94ae-d3540b96aea3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:15.433248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fef92-7af2-4227-94ae-d3540b96aea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:15.433520 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fef92-7af2-4227-94ae-d3540b96aea3 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:15.434245 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fef92-7af2-4227-94ae-d3540b96aea3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:15.434552 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fef92-7af2-4227-94ae-d3540b96aea3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:15.436072 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fef92-7af2-4227-94ae-d3540b96aea3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:15.436443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c6b33bf1-20dc-4300-bf84-a925c1873a91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:15.436443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:15.436443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:15.436443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:15.436443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:15.436443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:15.436443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:15.436443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:15.436443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:15.436443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:15.436443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:15.436443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:15.436443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:15.436443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:15.436443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:15.436443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:15.437279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:15.437279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:15.437279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:15.437279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:15.437279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:15.437279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:15.437279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:15.437279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:15.437279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:15.437279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:15.437279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:15.437279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:15.437279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:15.437279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:15.437279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:15.437279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:15.438062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:15.438062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:15.438062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:15.438062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:15.438062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:15.438062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:15.438062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:15.438062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:15.438062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:15.438062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:15.438062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:15.438062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:15.438062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 220/430] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 17 10:12:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:15.438713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b33bf1-20dc-4300-bf84-a925c1873a91 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:15.459714 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 211/431] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Oct 17 10:12:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:15.460695 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fef92-7af2-4227-94ae-d3540b96aea3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:15.494663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:15.562642 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b33bf1-20dc-4300-bf84-a925c1873a91 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:15.566954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fef92-7af2-4227-94ae-d3540b96aea3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:15.573266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:15.601490 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740bbb1-34f8-436a-b339-1a7d51f3e8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:15.601810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcb867-cd90-4faa-89d2-a3cbaafe903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:15.602114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740bbb1-34f8-436a-b339-1a7d51f3e8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:15.602391 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740bbb1-34f8-436a-b339-1a7d51f3e8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:15.602484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcb867-cd90-4faa-89d2-a3cbaafe903c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:15.602676 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcb867-cd90-4faa-89d2-a3cbaafe903c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:15.602826 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740bbb1-34f8-436a-b339-1a7d51f3e8b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:15.602914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcb867-cd90-4faa-89d2-a3cbaafe903c None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:15.603579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcb867-cd90-4faa-89d2-a3cbaafe903c None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:15.603885 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcb867-cd90-4faa-89d2-a3cbaafe903c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:15.605532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcb867-cd90-4faa-89d2-a3cbaafe903c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:15.616049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740bbb1-34f8-436a-b339-1a7d51f3e8b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:15.616197 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 212/432] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 17 10:12:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:15.616197 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcb867-cd90-4faa-89d2-a3cbaafe903c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:15.618901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9740bbb1-34f8-436a-b339-1a7d51f3e8b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:15.618901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:15.618901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:15.618901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:15.618901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:15.618901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:15.618901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:15.618901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:15.618901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:15.618901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:15.618901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:15.618901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:15.618901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:15.618901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:15.618901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:15.618901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:15.619999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:15.619999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:15.619999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:15.619999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:15.619999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:15.619999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:15.619999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:15.619999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:15.619999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:15.619999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:15.619999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:15.619999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:15.619999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:15.619999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:15.619999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:15.619999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:15.621048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:15.621048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:15.621048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:15.621048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:15.621048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:15.621048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:15.621048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:15.621048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:15.621048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:15.621048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:15.621048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:15.621048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:15.624665 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 221/433] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 17 10:12:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:15.625878 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8e20f-9495-4b6d-b20c-b2e291ff55ce None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:15.626177 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8e20f-9495-4b6d-b20c-b2e291ff55ce None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:15.626436 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8e20f-9495-4b6d-b20c-b2e291ff55ce None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:15.628570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 222/434] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:15.629269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8e20f-9495-4b6d-b20c-b2e291ff55ce None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:15.718622 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:15.728458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcb867-cd90-4faa-89d2-a3cbaafe903c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:15.740089 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8e20f-9495-4b6d-b20c-b2e291ff55ce None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:15.764542 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83bf6d-cdd2-407f-b1e4-7e8197341f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:15.765169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83bf6d-cdd2-407f-b1e4-7e8197341f27 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:15.765443 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83bf6d-cdd2-407f-b1e4-7e8197341f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:15.765710 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83bf6d-cdd2-407f-b1e4-7e8197341f27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:15.776145 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df76ed-07d0-47f8-976c-ace304b862db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:15.776428 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83bf6d-cdd2-407f-b1e4-7e8197341f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:15.776771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df76ed-07d0-47f8-976c-ace304b862db None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:15.777051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df76ed-07d0-47f8-976c-ace304b862db None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:15.777322 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df76ed-07d0-47f8-976c-ace304b862db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:15.777880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83bf6d-cdd2-407f-b1e4-7e8197341f27 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:15.788672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df76ed-07d0-47f8-976c-ace304b862db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:15.790105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df76ed-07d0-47f8-976c-ace304b862db None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:15.792669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-5e83bf6d-cdd2-407f-b1e4-7e8197341f27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:15.792669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:15.792669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:15.792669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:15.792669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:15.792669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:15.792669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:15.792669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:15.792669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:15.792669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:15.792669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:15.792669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:15.792669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:15.792669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:15.792669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:15.792669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:15.793564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:15.794468 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:15.794468 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:15.794468 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:15.794468 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 213/435] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:15.794686 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83bf6d-cdd2-407f-b1e4-7e8197341f27 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:15.809156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-96df76ed-07d0-47f8-976c-ace304b862db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:15.809156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:15.809156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:15.809156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:15.809156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:15.809156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:15.809156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:15.809156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:15.809156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:15.809156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:15.809156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:15.809156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:15.809156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:15.809156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:15.809156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:15.809156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:15.810703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:15.816356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:15.816356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:15.816356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:15.816356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 223/436] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:15.816356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510f5da-d353-45fe-9bc4-f82acfcdb861 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:15.816356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510f5da-d353-45fe-9bc4-f82acfcdb861 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:15.816356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510f5da-d353-45fe-9bc4-f82acfcdb861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:15.833877 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f510f5da-d353-45fe-9bc4-f82acfcdb861 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:15.835060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f510f5da-d353-45fe-9bc4-f82acfcdb861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:15.850261 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:15.904468 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83bf6d-cdd2-407f-b1e4-7e8197341f27 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:15.905987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 224/437] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:15.907038 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510f5da-d353-45fe-9bc4-f82acfcdb861 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:15.956372 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83d4af-2a36-48d7-9efc-3be9b1a1cdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:15.957292 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83d4af-2a36-48d7-9efc-3be9b1a1cdb0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:15.957838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83d4af-2a36-48d7-9efc-3be9b1a1cdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:15.958341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83d4af-2a36-48d7-9efc-3be9b1a1cdb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:15.959206 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83d4af-2a36-48d7-9efc-3be9b1a1cdb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:15.959706 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83d4af-2a36-48d7-9efc-3be9b1a1cdb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:15.961317 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83d4af-2a36-48d7-9efc-3be9b1a1cdb0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:15.970969 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 214/438] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 17 10:12:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:15.972108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83d4af-2a36-48d7-9efc-3be9b1a1cdb0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:15.982564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:16.032546 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510f5da-d353-45fe-9bc4-f82acfcdb861 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:16.070357 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0aa7b-ee32-4382-b915-f0f5452959d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:16.070996 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0aa7b-ee32-4382-b915-f0f5452959d6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:16.071282 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0aa7b-ee32-4382-b915-f0f5452959d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:16.071556 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0aa7b-ee32-4382-b915-f0f5452959d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:16.072259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0aa7b-ee32-4382-b915-f0f5452959d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:16.072569 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0aa7b-ee32-4382-b915-f0f5452959d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:16.074065 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0aa7b-ee32-4382-b915-f0f5452959d6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:16.084468 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83d4af-2a36-48d7-9efc-3be9b1a1cdb0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:16.094909 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 225/439] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:16.095900 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0aa7b-ee32-4382-b915-f0f5452959d6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:16.109628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:16.124495 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59e620-beed-4155-85da-e4545d6aba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:16.125723 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59e620-beed-4155-85da-e4545d6aba79 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:16.126201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59e620-beed-4155-85da-e4545d6aba79 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:16.126670 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59e620-beed-4155-85da-e4545d6aba79 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:16.127631 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59e620-beed-4155-85da-e4545d6aba79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:16.128162 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59e620-beed-4155-85da-e4545d6aba79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:16.129897 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59e620-beed-4155-85da-e4545d6aba79 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:16.143368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 215/440] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:16.144573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59e620-beed-4155-85da-e4545d6aba79 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:16.206869 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0aa7b-ee32-4382-b915-f0f5452959d6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:16.214619 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:16.240132 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fb1db-7837-456e-b1fb-01d8ce09fe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:16.240693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fb1db-7837-456e-b1fb-01d8ce09fe8a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:16.240973 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fb1db-7837-456e-b1fb-01d8ce09fe8a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:16.241246 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fb1db-7837-456e-b1fb-01d8ce09fe8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:16.248049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59e620-beed-4155-85da-e4545d6aba79 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:16.251467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5fb1db-7837-456e-b1fb-01d8ce09fe8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:16.252947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5fb1db-7837-456e-b1fb-01d8ce09fe8a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:16.267431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ce5fb1db-7837-456e-b1fb-01d8ce09fe8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:16.267431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:16.267431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:16.267431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:16.267431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:16.267431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:16.267431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:16.267431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:16.267431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:16.267431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:16.267431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:16.267431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:16.267431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:16.267431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:16.267431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:16.267431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:16.268529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:16.269724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:16.269724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:16.269724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:16.269724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 226/441] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:16.269724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fb1db-7837-456e-b1fb-01d8ce09fe8a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:16.284204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6896fac-b12f-487d-904d-44dd201e9bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:16.284831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6896fac-b12f-487d-904d-44dd201e9bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:16.285112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6896fac-b12f-487d-904d-44dd201e9bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:16.285381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6896fac-b12f-487d-904d-44dd201e9bb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:16.291907 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6896fac-b12f-487d-904d-44dd201e9bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:16.293376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6896fac-b12f-487d-904d-44dd201e9bb8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:16.304256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a6896fac-b12f-487d-904d-44dd201e9bb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:16.304256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:16.304256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:16.304256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:16.304256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:16.304256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:16.304256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:16.304256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:16.304256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:16.304256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:16.304256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:16.304256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:16.304256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:16.304256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:16.304256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:16.305240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:16.306275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:16.306275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:16.306275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:16.306275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:16.306275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:16.306275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:16.306275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:16.306275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:16.306275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 216/442] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:16.306275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6896fac-b12f-487d-904d-44dd201e9bb8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:16.332685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:16.370973 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fb1db-7837-456e-b1fb-01d8ce09fe8a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:16.403425 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd19bf4-49cd-48a7-8394-4e3ca35f9cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:16.404418 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6896fac-b12f-487d-904d-44dd201e9bb8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:16.404618 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19bf4-49cd-48a7-8394-4e3ca35f9cca None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:16.404895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19bf4-49cd-48a7-8394-4e3ca35f9cca None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:16.405163 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19bf4-49cd-48a7-8394-4e3ca35f9cca None admin] PATH_INFO: `/v3/users/glance` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:16.412349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd19bf4-49cd-48a7-8394-4e3ca35f9cca None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:16.413777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd19bf4-49cd-48a7-8394-4e3ca35f9cca None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:16.424626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-dbd19bf4-49cd-48a7-8394-4e3ca35f9cca None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 17 10:12:16.424626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:16.424626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:16.424626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:16.424626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:16.424626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:16.424626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:16.424626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:16.424626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:16.424626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:16.424626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:16.424626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:16.424626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:16.424626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:16.424626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:16.424626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:16.425672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:16.426575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:16.426575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:16.426575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:16.426575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:16.426575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:16.426575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:16.426575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:16.426575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:16.426575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 17 10:12:16.426575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:16.426575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 227/443] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:12:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:16.427222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b4ef-f407-4b93-a394-5cd18c352d9a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:16.427433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b4ef-f407-4b93-a394-5cd18c352d9a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:16.427706 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b4ef-f407-4b93-a394-5cd18c352d9a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:16.428940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 228/444] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:16.430106 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46b4ef-f407-4b93-a394-5cd18c352d9a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:16.433352 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:16.444346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14982896-f387-4cd7-b05c-dbd20ce63944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:16.444964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14982896-f387-4cd7-b05c-dbd20ce63944 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:16.445236 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14982896-f387-4cd7-b05c-dbd20ce63944 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:16.445499 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14982896-f387-4cd7-b05c-dbd20ce63944 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:16.455846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14982896-f387-4cd7-b05c-dbd20ce63944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:16.461031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-14982896-f387-4cd7-b05c-dbd20ce63944 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:16.461031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:16.461031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:16.461031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:16.461031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:16.461031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:16.461031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:16.461031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:16.461031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:16.461031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:16.461031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:16.461031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:16.461031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:16.461031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:16.461031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:16.461031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:16.462094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:16.462094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:16.462094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:16.462094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:16.462094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:16.462094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:16.462094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:16.462094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:16.462094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:16.462094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:16.462094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:16.462094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:16.462094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:16.462094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:16.462094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:16.462094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:16.463124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:16.463124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:16.463124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:16.463124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:16.463124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:16.463124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:16.463124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:16.463124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:16.463124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:16.463124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:16.463124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:16.463124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:16.463124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 217/445] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 17 10:12:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:16.463124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14982896-f387-4cd7-b05c-dbd20ce63944 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:16.534653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46b4ef-f407-4b93-a394-5cd18c352d9a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:16.555519 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:16.561164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14982896-f387-4cd7-b05c-dbd20ce63944 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:16.568132 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269534a0-9760-41a0-aae2-7d03903ceb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:16.568723 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269534a0-9760-41a0-aae2-7d03903ceb39 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:16.568997 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269534a0-9760-41a0-aae2-7d03903ceb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:16.569262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269534a0-9760-41a0-aae2-7d03903ceb39 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:16.569896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269534a0-9760-41a0-aae2-7d03903ceb39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:16.570194 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269534a0-9760-41a0-aae2-7d03903ceb39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:16.571549 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269534a0-9760-41a0-aae2-7d03903ceb39 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:16.583322 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 229/446] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:16.584149 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269534a0-9760-41a0-aae2-7d03903ceb39 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:16.599687 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2442c-9e16-4697-9c2c-6adce74c303f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:16.600327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2442c-9e16-4697-9c2c-6adce74c303f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:16.600607 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2442c-9e16-4697-9c2c-6adce74c303f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:16.600875 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2442c-9e16-4697-9c2c-6adce74c303f None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:16.601564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2442c-9e16-4697-9c2c-6adce74c303f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:16.601869 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2442c-9e16-4697-9c2c-6adce74c303f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:16.603306 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2442c-9e16-4697-9c2c-6adce74c303f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:16.615350 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 218/447] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:16.616519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5678-ba57-457f-8585-9670a72345fb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:16.616802 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5678-ba57-457f-8585-9670a72345fb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:16.617069 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5678-ba57-457f-8585-9670a72345fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:16.634635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dadc5678-ba57-457f-8585-9670a72345fb None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:16.635839 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dadc5678-ba57-457f-8585-9670a72345fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:16.677264 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:16.680382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269534a0-9760-41a0-aae2-7d03903ceb39 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:16.703291 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 219/448] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:16.711887 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc5678-ba57-457f-8585-9670a72345fb None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:16.720905 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99000b-e490-43ee-affa-22ad17be3d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:16.721519 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99000b-e490-43ee-affa-22ad17be3d61 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:16.721920 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99000b-e490-43ee-affa-22ad17be3d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:16.722195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99000b-e490-43ee-affa-22ad17be3d61 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:16.722930 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99000b-e490-43ee-affa-22ad17be3d61 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:16.723237 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99000b-e490-43ee-affa-22ad17be3d61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:16.724721 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99000b-e490-43ee-affa-22ad17be3d61 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:16.744284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 230/449] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Oct 17 10:12:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:16.749264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99000b-e490-43ee-affa-22ad17be3d61 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:16.795601 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:16.810844 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc5678-ba57-457f-8585-9670a72345fb None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:16.848390 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5469b4-e81c-4f47-957d-0e68daede33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:16.849320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5469b4-e81c-4f47-957d-0e68daede33d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:16.849606 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5469b4-e81c-4f47-957d-0e68daede33d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:16.850150 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5469b4-e81c-4f47-957d-0e68daede33d None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:16.850819 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5469b4-e81c-4f47-957d-0e68daede33d None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:16.851125 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5469b4-e81c-4f47-957d-0e68daede33d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:16.852518 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5469b4-e81c-4f47-957d-0e68daede33d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:16.859319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99000b-e490-43ee-affa-22ad17be3d61 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:16.861838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 220/450] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 17 10:12:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:16.862677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5469b4-e81c-4f47-957d-0e68daede33d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:16.899315 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0ebbb-389c-401b-8984-e3a24bcffcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:16.900102 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0ebbb-389c-401b-8984-e3a24bcffcae None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:16.900451 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0ebbb-389c-401b-8984-e3a24bcffcae None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:16.900798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0ebbb-389c-401b-8984-e3a24bcffcae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:16.907781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0ebbb-389c-401b-8984-e3a24bcffcae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:16.908741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:16.909492 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0ebbb-389c-401b-8984-e3a24bcffcae None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:16.921736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-38c0ebbb-389c-401b-8984-e3a24bcffcae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 10:12:16.921736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:16.921736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:16.921736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:16.921736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:16.921736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:16.921736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:16.921736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:16.921736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:16.921736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:16.921736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:16.921736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:16.921736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:16.921736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:16.921736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:16.921736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:16.922628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:16.928288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:16.928288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:16.928288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:16.928288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:16.928288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:16.928288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:16.928288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:16.928288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:16.928288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 10:12:16.928288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:16.928288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 231/451] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:12:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:16.928288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0ebbb-389c-401b-8984-e3a24bcffcae None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:16.981364 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5469b4-e81c-4f47-957d-0e68daede33d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:17.015038 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff1d37-89ce-43af-adc9-5a37872a6469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:17.015686 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff1d37-89ce-43af-adc9-5a37872a6469 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:17.015988 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff1d37-89ce-43af-adc9-5a37872a6469 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:17.016264 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff1d37-89ce-43af-adc9-5a37872a6469 None admin] PATH_INFO: `/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/e2969c098a154afcba382c707122598d/roles/365b9c4c3245430e872f4aa988da3beb` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:17.021983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:17.025470 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0ebbb-389c-401b-8984-e3a24bcffcae None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:17.030744 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff1d37-89ce-43af-adc9-5a37872a6469 None admin] RBAC: Authorizing `identity:create_grant(project_id=07b2dd5de0274a6896d407b0ff22ff54, user_id=e2969c098a154afcba382c707122598d, role_id=365b9c4c3245430e872f4aa988da3beb)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:17.032238 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff1d37-89ce-43af-adc9-5a37872a6469 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:17.045412 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 221/452] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:12:16 2022] PUT /identity/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/e2969c098a154afcba382c707122598d/roles/365b9c4c3245430e872f4aa988da3beb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:12:17.049116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff1d37-89ce-43af-adc9-5a37872a6469 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:17.069447 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4ea81-d74b-492f-958d-1f24363dd34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:17.070060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4ea81-d74b-492f-958d-1f24363dd34a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:17.070549 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4ea81-d74b-492f-958d-1f24363dd34a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:17.070825 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4ea81-d74b-492f-958d-1f24363dd34a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:17.149060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4ea81-d74b-492f-958d-1f24363dd34a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:17.150584 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4ea81-d74b-492f-958d-1f24363dd34a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:17.153430 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:17.170508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff1d37-89ce-43af-adc9-5a37872a6469 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:17.211526 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3beb9d-2fd8-4746-9cf8-ffae362ad4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:17.212966 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3beb9d-2fd8-4746-9cf8-ffae362ad4dd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:17.213256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3beb9d-2fd8-4746-9cf8-ffae362ad4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:17.213534 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3beb9d-2fd8-4746-9cf8-ffae362ad4dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:17.227326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3beb9d-2fd8-4746-9cf8-ffae362ad4dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:17.229181 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3beb9d-2fd8-4746-9cf8-ffae362ad4dd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:17.244838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-6d3beb9d-2fd8-4746-9cf8-ffae362ad4dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:17.244838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:17.244838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:17.244838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:17.244838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:17.244838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:17.244838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:17.244838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:17.244838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:17.244838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:17.244838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:17.244838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:17.244838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:17.244838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:17.244838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:17.244838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:17.245751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:17.246576 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:17.246576 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:17.246576 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:17.246576 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 222/453] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:17.246779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3beb9d-2fd8-4746-9cf8-ffae362ad4dd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:17.264006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:17.273178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 232/454] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:12:17.274306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4ea81-d74b-492f-958d-1f24363dd34a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:17.359106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3beb9d-2fd8-4746-9cf8-ffae362ad4dd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:17.376959 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4ea81-d74b-492f-958d-1f24363dd34a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:17.393451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013c4dd-a700-41c9-8ad3-705bdcc12784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:17.394061 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013c4dd-a700-41c9-8ad3-705bdcc12784 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:17.394340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013c4dd-a700-41c9-8ad3-705bdcc12784 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:17.394616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013c4dd-a700-41c9-8ad3-705bdcc12784 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:17.395350 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013c4dd-a700-41c9-8ad3-705bdcc12784 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:17.395659 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013c4dd-a700-41c9-8ad3-705bdcc12784 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:17.397131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013c4dd-a700-41c9-8ad3-705bdcc12784 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:17.406964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:17.415880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346451f-6e17-4451-aa1f-7638a390ede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:17.421101 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346451f-6e17-4451-aa1f-7638a390ede4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:17.421227 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 223/455] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Oct 17 10:12:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:17.421302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346451f-6e17-4451-aa1f-7638a390ede4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:17.421302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346451f-6e17-4451-aa1f-7638a390ede4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:17.421449 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013c4dd-a700-41c9-8ad3-705bdcc12784 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:17.428534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346451f-6e17-4451-aa1f-7638a390ede4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:17.433459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4346451f-6e17-4451-aa1f-7638a390ede4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:17.433459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:17.433459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:17.433459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:17.433459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:17.433459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:17.433459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:17.433459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:17.433459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:17.433459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:17.433459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:17.433459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:17.433459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:17.433459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:17.433459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:17.433459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:17.434428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:17.434428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:17.434428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:17.434428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:17.434428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:17.434428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:17.434428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:17.434428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:17.434428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:17.434428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:17.434428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:17.434428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:17.434428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:17.434428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:17.434428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:17.434428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:17.435719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:17.435719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:17.435719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:17.435719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:17.435719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:17.435719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:17.435719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:17.435719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:17.435719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:17.435719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:17.435719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:17.435719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:17.435719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 233/456] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 17 10:12:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:17.436383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346451f-6e17-4451-aa1f-7638a390ede4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:17.496728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:17.529333 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013c4dd-a700-41c9-8ad3-705bdcc12784 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:17.543522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346451f-6e17-4451-aa1f-7638a390ede4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:17.565894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97712d-aba7-475d-bfef-f5604735ef2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:17.566499 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97712d-aba7-475d-bfef-f5604735ef2d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:17.566773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97712d-aba7-475d-bfef-f5604735ef2d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:17.567038 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97712d-aba7-475d-bfef-f5604735ef2d None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:17.567727 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97712d-aba7-475d-bfef-f5604735ef2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:17.568068 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97712d-aba7-475d-bfef-f5604735ef2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:17.569425 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97712d-aba7-475d-bfef-f5604735ef2d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:17.579313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf6e0c-bca6-4127-914e-ab7ab3745017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:17.580194 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf6e0c-bca6-4127-914e-ab7ab3745017 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:17.580651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf6e0c-bca6-4127-914e-ab7ab3745017 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:17.581005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 224/457] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:17.581005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97712d-aba7-475d-bfef-f5604735ef2d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:17.585669 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf6e0c-bca6-4127-914e-ab7ab3745017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:17.599752 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf6e0c-bca6-4127-914e-ab7ab3745017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:17.601273 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf6e0c-bca6-4127-914e-ab7ab3745017 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:17.617383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8fbf6e0c-bca6-4127-914e-ab7ab3745017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:17.617383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:17.617383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:17.617383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:17.617383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:17.617383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:17.617383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:17.617383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:17.617383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:17.617383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:17.617383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:17.617383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:17.617383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:17.617383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:17.617383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:17.617383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:17.618267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:17.619107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:17.619107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:17.619107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:17.619107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 234/458] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:17.619316 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf6e0c-bca6-4127-914e-ab7ab3745017 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:17.650549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:17.696555 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97712d-aba7-475d-bfef-f5604735ef2d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:17.720177 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf6e0c-bca6-4127-914e-ab7ab3745017 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:17.733327 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:17.736090 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46879cb-5206-4b82-b01a-71d5d6882c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:17.736699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46879cb-5206-4b82-b01a-71d5d6882c51 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:17.737145 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46879cb-5206-4b82-b01a-71d5d6882c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:17.737249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46879cb-5206-4b82-b01a-71d5d6882c51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:17.755046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acb488-a94b-45d6-a774-23b85e66215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:17.755652 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acb488-a94b-45d6-a774-23b85e66215e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:17.755956 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acb488-a94b-45d6-a774-23b85e66215e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:17.756225 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acb488-a94b-45d6-a774-23b85e66215e None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:17.756887 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acb488-a94b-45d6-a774-23b85e66215e None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:17.757189 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acb488-a94b-45d6-a774-23b85e66215e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:17.758556 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acb488-a94b-45d6-a774-23b85e66215e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:17.767030 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 235/459] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 17 10:12:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:17.767817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acb488-a94b-45d6-a774-23b85e66215e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:17.812714 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46879cb-5206-4b82-b01a-71d5d6882c51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:17.814474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46879cb-5206-4b82-b01a-71d5d6882c51 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:17.868625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acb488-a94b-45d6-a774-23b85e66215e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:17.874561 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:17.902060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5d474-1e2a-43d5-b174-dfd71e57d194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:17.902687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5d474-1e2a-43d5-b174-dfd71e57d194 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:17.902962 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5d474-1e2a-43d5-b174-dfd71e57d194 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:17.903231 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5d474-1e2a-43d5-b174-dfd71e57d194 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:17.910754 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5d474-1e2a-43d5-b174-dfd71e57d194 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:17.912219 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5d474-1e2a-43d5-b174-dfd71e57d194 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:17.921643 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 225/460] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:12:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:12:17.922830 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46879cb-5206-4b82-b01a-71d5d6882c51 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:17.924368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-dde5d474-1e2a-43d5-b174-dfd71e57d194 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 10:12:17.924368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:17.924368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:17.924368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:17.924368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:17.924368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:17.924368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:17.924368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:17.924368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:17.924368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:17.924368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:17.924368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:17.924368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:17.924368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:17.924368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:17.924368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:17.925264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:17.930992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:17.930992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:17.930992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:17.930992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:17.930992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:17.930992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:17.930992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:17.930992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:17.930992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 10:12:17.930992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:17.930992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 236/461] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Oct 17 10:12:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:17.930992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5d474-1e2a-43d5-b174-dfd71e57d194 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:17.966081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:18.027642 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46879cb-5206-4b82-b01a-71d5d6882c51 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:18.034231 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5d474-1e2a-43d5-b174-dfd71e57d194 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:18.070459 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ac980-48ee-403f-8a22-def2210c38fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:18.071341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ac980-48ee-403f-8a22-def2210c38fc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:18.071667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ac980-48ee-403f-8a22-def2210c38fc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:18.071895 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ac980-48ee-403f-8a22-def2210c38fc None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:18.072580 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ac980-48ee-403f-8a22-def2210c38fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:18.072889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ac980-48ee-403f-8a22-def2210c38fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:18.074245 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ac980-48ee-403f-8a22-def2210c38fc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:18.074589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a85b9-f7fb-49b6-a572-18d26a206fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:18.075219 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a85b9-f7fb-49b6-a572-18d26a206fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:18.076101 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a85b9-f7fb-49b6-a572-18d26a206fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:18.076381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a85b9-f7fb-49b6-a572-18d26a206fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:18.086936 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a85b9-f7fb-49b6-a572-18d26a206fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:18.088114 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 226/462] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:18.088730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ac980-48ee-403f-8a22-def2210c38fc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:18.092861 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a85b9-f7fb-49b6-a572-18d26a206fb4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:18.107262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-730a85b9-f7fb-49b6-a572-18d26a206fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:18.107262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:18.107262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:18.107262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:18.107262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:18.107262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:18.107262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:18.107262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:18.107262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:18.107262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:18.107262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:18.107262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:18.107262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:18.107262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:18.107262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:18.107262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:18.108165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:18.109018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:18.109018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:18.109018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:18.109018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 237/463] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:18.109225 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a85b9-f7fb-49b6-a572-18d26a206fb4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:18.113963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:18.202780 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:18.206459 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ac980-48ee-403f-8a22-def2210c38fc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:18.221876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a85b9-f7fb-49b6-a572-18d26a206fb4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:18.242570 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30f971-a114-45e0-a445-819f650b2bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:18.243190 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30f971-a114-45e0-a445-819f650b2bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:18.243467 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30f971-a114-45e0-a445-819f650b2bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:18.243734 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30f971-a114-45e0-a445-819f650b2bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:18.254897 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30f971-a114-45e0-a445-819f650b2bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:18.256368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30f971-a114-45e0-a445-819f650b2bb3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:18.258150 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0126595-b1f6-4a42-893b-7abba0946685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:18.258763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0126595-b1f6-4a42-893b-7abba0946685 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:18.259035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0126595-b1f6-4a42-893b-7abba0946685 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:18.259311 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0126595-b1f6-4a42-893b-7abba0946685 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:18.260081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0126595-b1f6-4a42-893b-7abba0946685 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:18.260390 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0126595-b1f6-4a42-893b-7abba0946685 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:18.261822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0126595-b1f6-4a42-893b-7abba0946685 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:18.270669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9c30f971-a114-45e0-a445-819f650b2bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:18.270669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:18.270669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:18.270669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:18.270669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:18.270669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:18.270669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:18.270669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:18.270669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:18.270669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:18.270669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:18.270669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:18.270669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:18.270669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:18.270669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:18.270669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:18.271528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:18.272398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:18.272398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:18.272398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:18.272398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 227/464] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:18.272615 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30f971-a114-45e0-a445-819f650b2bb3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:18.286761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 238/465] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Oct 17 10:12:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:18.286761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0126595-b1f6-4a42-893b-7abba0946685 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:18.351208 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:18.385250 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30f971-a114-45e0-a445-819f650b2bb3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:18.391022 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0126595-b1f6-4a42-893b-7abba0946685 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:18.420586 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c898ba1-71d7-4ca4-985d-25c308af5f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:18.421208 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c898ba1-71d7-4ca4-985d-25c308af5f18 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:18.421498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c898ba1-71d7-4ca4-985d-25c308af5f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:18.421752 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c898ba1-71d7-4ca4-985d-25c308af5f18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:18.426826 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f87214-cc25-4a4e-8d7b-b67271a58688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:18.427504 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87214-cc25-4a4e-8d7b-b67271a58688 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:18.427788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87214-cc25-4a4e-8d7b-b67271a58688 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:18.428112 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87214-cc25-4a4e-8d7b-b67271a58688 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:18.428662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c898ba1-71d7-4ca4-985d-25c308af5f18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:18.428769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f87214-cc25-4a4e-8d7b-b67271a58688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:18.429053 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f87214-cc25-4a4e-8d7b-b67271a58688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:18.430097 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c898ba1-71d7-4ca4-985d-25c308af5f18 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:18.430456 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f87214-cc25-4a4e-8d7b-b67271a58688 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:18.446162 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 239/466] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:18.446312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3c898ba1-71d7-4ca4-985d-25c308af5f18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:18.446312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:18.446312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:18.446312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:18.446312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:18.446312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:18.446312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:18.446312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:18.446312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:18.446312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:18.446312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:18.446312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:18.446312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:18.446312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:18.446312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:18.447088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:18.447900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:18.447900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:18.447900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:18.447900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:18.447900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:18.447900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:18.447900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:18.447900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:18.448342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f87214-cc25-4a4e-8d7b-b67271a58688 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:18.448417 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 228/467] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:18.448417 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c898ba1-71d7-4ca4-985d-25c308af5f18 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:18.454069 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:18.547915 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c898ba1-71d7-4ca4-985d-25c308af5f18 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:18.570325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f87214-cc25-4a4e-8d7b-b67271a58688 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:18.578037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:18.584087 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67faf2-1456-426b-afaf-c79e459f4d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:18.584683 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67faf2-1456-426b-afaf-c79e459f4d02 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:18.584961 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67faf2-1456-426b-afaf-c79e459f4d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:18.585230 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67faf2-1456-426b-afaf-c79e459f4d02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:18.612350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf31889-7852-40e1-9bc1-8f2cf9639ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:18.613284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf31889-7852-40e1-9bc1-8f2cf9639ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:18.613571 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf31889-7852-40e1-9bc1-8f2cf9639ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:18.614117 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf31889-7852-40e1-9bc1-8f2cf9639ce5 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:18.614772 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf31889-7852-40e1-9bc1-8f2cf9639ce5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:18.615233 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf31889-7852-40e1-9bc1-8f2cf9639ce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:18.617255 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf31889-7852-40e1-9bc1-8f2cf9639ce5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:18.631176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 240/468] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:18.632154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf31889-7852-40e1-9bc1-8f2cf9639ce5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:18.659947 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67faf2-1456-426b-afaf-c79e459f4d02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:18.661582 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67faf2-1456-426b-afaf-c79e459f4d02 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:18.697710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:18.741551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf31889-7852-40e1-9bc1-8f2cf9639ce5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:18.766001 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 229/469] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:12:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:12:18.767086 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67faf2-1456-426b-afaf-c79e459f4d02 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:18.781207 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d91ef-2120-46d9-8dbe-0b0eebc97831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:18.781847 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d91ef-2120-46d9-8dbe-0b0eebc97831 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:18.782129 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d91ef-2120-46d9-8dbe-0b0eebc97831 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:18.782404 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d91ef-2120-46d9-8dbe-0b0eebc97831 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:18.789733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d91ef-2120-46d9-8dbe-0b0eebc97831 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:18.791184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d91ef-2120-46d9-8dbe-0b0eebc97831 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:18.799795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:18.803260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-5d8d91ef-2120-46d9-8dbe-0b0eebc97831 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 17 10:12:18.803260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:18.803260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:18.803260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:18.803260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:18.803260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:18.803260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:18.803260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:18.803260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:18.803260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:18.803260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:18.803260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:18.803260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:18.803260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:18.803260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:18.803260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:18.804169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:18.805018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:18.805018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:18.805018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:18.805018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:18.805018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:18.805018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:18.805018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:18.805018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:18.805018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 17 10:12:18.805018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:18.805018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 241/470] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 17 10:12:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:18.806155 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d91ef-2120-46d9-8dbe-0b0eebc97831 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:18.890502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67faf2-1456-426b-afaf-c79e459f4d02 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:18.907956 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d91ef-2120-46d9-8dbe-0b0eebc97831 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:18.930714 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:18.930854 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989d83b-cca2-4ff5-a3bc-86e7760fcc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:18.931454 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989d83b-cca2-4ff5-a3bc-86e7760fcc85 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:18.931732 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989d83b-cca2-4ff5-a3bc-86e7760fcc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:18.932030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989d83b-cca2-4ff5-a3bc-86e7760fcc85 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:18.932719 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989d83b-cca2-4ff5-a3bc-86e7760fcc85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:18.933060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989d83b-cca2-4ff5-a3bc-86e7760fcc85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:18.934583 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989d83b-cca2-4ff5-a3bc-86e7760fcc85 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:18.943498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab4a30-b3bf-4369-a161-18a1e138c4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:18.944160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab4a30-b3bf-4369-a161-18a1e138c4bf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:18.944433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab4a30-b3bf-4369-a161-18a1e138c4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:18.944700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab4a30-b3bf-4369-a161-18a1e138c4bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:18.951870 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 230/471] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:18.951870 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989d83b-cca2-4ff5-a3bc-86e7760fcc85 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:18.956927 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab4a30-b3bf-4369-a161-18a1e138c4bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:18.958398 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab4a30-b3bf-4369-a161-18a1e138c4bf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:18.970907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-bbab4a30-b3bf-4369-a161-18a1e138c4bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:18.970907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:18.970907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:18.970907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:18.970907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:18.970907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:18.970907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:18.970907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:18.970907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:18.970907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:18.970907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:18.970907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:18.970907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:18.970907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:18.970907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:18.971761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:18.977284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:18.977284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:18.977284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:18.977284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:18.977284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:18.977284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:18.977284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:18.977284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:18.977284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 242/472] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:18.977284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab4a30-b3bf-4369-a161-18a1e138c4bf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:19.052111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:19.066497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989d83b-cca2-4ff5-a3bc-86e7760fcc85 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:19.088507 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab4a30-b3bf-4369-a161-18a1e138c4bf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:19.106212 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f04b0-9d0e-4bc7-9fa9-f1f6d7992c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:19.106943 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f04b0-9d0e-4bc7-9fa9-f1f6d7992c71 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:19.107421 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f04b0-9d0e-4bc7-9fa9-f1f6d7992c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:19.107526 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f04b0-9d0e-4bc7-9fa9-f1f6d7992c71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:19.120289 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f04b0-9d0e-4bc7-9fa9-f1f6d7992c71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:19.122779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f04b0-9d0e-4bc7-9fa9-f1f6d7992c71 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:19.126087 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47160f1b-53c5-4c75-9798-7958f63d8451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:19.126711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47160f1b-53c5-4c75-9798-7958f63d8451 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:19.126987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47160f1b-53c5-4c75-9798-7958f63d8451 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:19.127255 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47160f1b-53c5-4c75-9798-7958f63d8451 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:19.128053 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47160f1b-53c5-4c75-9798-7958f63d8451 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:19.128362 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47160f1b-53c5-4c75-9798-7958f63d8451 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:19.129863 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47160f1b-53c5-4c75-9798-7958f63d8451 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:19.138873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d44f04b0-9d0e-4bc7-9fa9-f1f6d7992c71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:19.138873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:19.138873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:19.138873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:19.138873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:19.138873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:19.138873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:19.138873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:19.138873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:19.138873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:19.138873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:19.138873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:19.138873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:19.138873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:19.138873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:19.138873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:19.139836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:19.140702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:19.140702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:19.140702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:19.140702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 231/473] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:19.140926 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f04b0-9d0e-4bc7-9fa9-f1f6d7992c71 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:19.154243 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 243/474] 10.222.0.13 () {56 vars in 1139 bytes} [Mon Oct 17 10:12:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:19.156047 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47160f1b-53c5-4c75-9798-7958f63d8451 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:19.203277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:19.246920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f04b0-9d0e-4bc7-9fa9-f1f6d7992c71 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:19.263587 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47160f1b-53c5-4c75-9798-7958f63d8451 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:19.280402 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91fef8-2d3a-479f-868f-fb05eb6415cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:19.280991 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91fef8-2d3a-479f-868f-fb05eb6415cc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:19.281265 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91fef8-2d3a-479f-868f-fb05eb6415cc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:19.281535 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91fef8-2d3a-479f-868f-fb05eb6415cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:19.282249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91fef8-2d3a-479f-868f-fb05eb6415cc None admin] RBAC: Adding query filter params (role.id=365b9c4c3245430e872f4aa988da3beb, scope.project.id=07b2dd5de0274a6896d407b0ff22ff54, user.id=2bd5d41f6a16403f990a4cd5922a2644) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:19.282555 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91fef8-2d3a-479f-868f-fb05eb6415cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:19.283992 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91fef8-2d3a-479f-868f-fb05eb6415cc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:19.289779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 232/475] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:12:19 2022] GET /identity/v3/role_assignments?user.id=2bd5d41f6a16403f990a4cd5922a2644&scope.project.id=07b2dd5de0274a6896d407b0ff22ff54&role.id=365b9c4c3245430e872f4aa988da3beb => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:19.290549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91fef8-2d3a-479f-868f-fb05eb6415cc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:19.299557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:19.304741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9370d4c-cd78-4e05-aecc-c3cda0f5ee61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:19.305560 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9370d4c-cd78-4e05-aecc-c3cda0f5ee61 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:19.305917 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9370d4c-cd78-4e05-aecc-c3cda0f5ee61 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:19.306265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9370d4c-cd78-4e05-aecc-c3cda0f5ee61 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:19.307073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9370d4c-cd78-4e05-aecc-c3cda0f5ee61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:19.307477 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9370d4c-cd78-4e05-aecc-c3cda0f5ee61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:19.309080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9370d4c-cd78-4e05-aecc-c3cda0f5ee61 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:19.327369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 244/476] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:19.327369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9370d4c-cd78-4e05-aecc-c3cda0f5ee61 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:19.413825 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91fef8-2d3a-479f-868f-fb05eb6415cc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:19.439706 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9370d4c-cd78-4e05-aecc-c3cda0f5ee61 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:19.442154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:19.451912 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e04aa8-cf44-46d9-9fca-7c855e23bdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:19.452563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e04aa8-cf44-46d9-9fca-7c855e23bdba None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:19.452840 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e04aa8-cf44-46d9-9fca-7c855e23bdba None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:19.453107 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e04aa8-cf44-46d9-9fca-7c855e23bdba None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:19.453749 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e04aa8-cf44-46d9-9fca-7c855e23bdba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:19.454053 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e04aa8-cf44-46d9-9fca-7c855e23bdba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:19.455464 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e04aa8-cf44-46d9-9fca-7c855e23bdba None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:19.469081 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 233/477] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:19.470483 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ce727-0d20-481c-b795-9b446e7ed348 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:19.470774 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ce727-0d20-481c-b795-9b446e7ed348 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:19.471048 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ce727-0d20-481c-b795-9b446e7ed348 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:19.472278 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 234/478] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:19.473068 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ce727-0d20-481c-b795-9b446e7ed348 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:19.485699 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e416536-db6d-4b8f-ba6e-f8c86c71c7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:19.486312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e416536-db6d-4b8f-ba6e-f8c86c71c7aa None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:19.486588 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e416536-db6d-4b8f-ba6e-f8c86c71c7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:19.486857 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e416536-db6d-4b8f-ba6e-f8c86c71c7aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:19.554396 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:19.560884 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e416536-db6d-4b8f-ba6e-f8c86c71c7aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:19.562561 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e416536-db6d-4b8f-ba6e-f8c86c71c7aa None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:19.599205 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ce727-0d20-481c-b795-9b446e7ed348 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:19.636933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbda427-decc-45d7-a03e-6fdd56d5d7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:19.637535 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbda427-decc-45d7-a03e-6fdd56d5d7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:19.637838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbda427-decc-45d7-a03e-6fdd56d5d7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:19.638199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbda427-decc-45d7-a03e-6fdd56d5d7e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:19.639064 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbda427-decc-45d7-a03e-6fdd56d5d7e9 None admin] RBAC: Adding query filter params (role.id=365b9c4c3245430e872f4aa988da3beb, scope.project.id=07b2dd5de0274a6896d407b0ff22ff54, user.id=6099c38837b44101a17470322916c82e) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:19.639376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbda427-decc-45d7-a03e-6fdd56d5d7e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:19.640861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbda427-decc-45d7-a03e-6fdd56d5d7e9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:19.656216 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 235/479] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:12:19 2022] GET /identity/v3/role_assignments?user.id=6099c38837b44101a17470322916c82e&scope.project.id=07b2dd5de0274a6896d407b0ff22ff54&role.id=365b9c4c3245430e872f4aa988da3beb => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:19.656216 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbda427-decc-45d7-a03e-6fdd56d5d7e9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:19.680074 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 245/480] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:12:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:12:19.681704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c5402-4cd1-4e03-ae97-9522a0950adf None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:19.682026 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c5402-4cd1-4e03-ae97-9522a0950adf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:19.682303 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c5402-4cd1-4e03-ae97-9522a0950adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:19.688923 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:19.703506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2a2c5402-4cd1-4e03-ae97-9522a0950adf None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:19.704879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2a2c5402-4cd1-4e03-ae97-9522a0950adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:19.789750 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbda427-decc-45d7-a03e-6fdd56d5d7e9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:19.810762 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 246/481] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:19.812011 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c5402-4cd1-4e03-ae97-9522a0950adf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:19.840278 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:19.850513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9adb1-513b-4432-aa75-26a81fd9f227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:19.851157 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9adb1-513b-4432-aa75-26a81fd9f227 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:19.851427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9adb1-513b-4432-aa75-26a81fd9f227 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:19.851694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9adb1-513b-4432-aa75-26a81fd9f227 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:19.869020 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9adb1-513b-4432-aa75-26a81fd9f227 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:19.870497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9adb1-513b-4432-aa75-26a81fd9f227 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:19.895754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-edc9adb1-513b-4432-aa75-26a81fd9f227 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:19.895754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:19.895754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:19.895754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:19.895754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:19.895754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:19.895754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:19.895754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:19.895754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:19.895754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:19.895754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:19.895754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:19.895754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:19.895754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:19.895754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:19.896831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:19.897663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:19.897663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:19.897663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:19.897663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:19.897663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:19.897663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:19.897663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:19.897663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:19.900964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 236/482] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:19.909152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9adb1-513b-4432-aa75-26a81fd9f227 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:19.937424 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c5402-4cd1-4e03-ae97-9522a0950adf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:19.978055 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:19.994968 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d32a9-29b8-40ad-bb26-b9fe570101b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:19.995612 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d32a9-29b8-40ad-bb26-b9fe570101b3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:19.995884 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d32a9-29b8-40ad-bb26-b9fe570101b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:19.996191 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d32a9-29b8-40ad-bb26-b9fe570101b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:20.016140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d32a9-29b8-40ad-bb26-b9fe570101b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:20.017892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d32a9-29b8-40ad-bb26-b9fe570101b3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:20.035966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ab8d32a9-29b8-40ad-bb26-b9fe570101b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:20.035966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:20.035966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:20.035966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:20.035966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:20.035966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:20.035966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:20.035966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:20.035966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:20.035966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:20.035966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:20.035966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:20.035966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:20.035966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:20.035966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:20.035966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:20.036892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:20.037803 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:20.037803 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:20.037803 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:20.037803 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 247/483] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:20.040337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d32a9-29b8-40ad-bb26-b9fe570101b3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:20.062272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9adb1-513b-4432-aa75-26a81fd9f227 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:20.099560 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820eb6e4-8a5b-47d8-80a6-3b50a4b57107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:20.100529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820eb6e4-8a5b-47d8-80a6-3b50a4b57107 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:20.101080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820eb6e4-8a5b-47d8-80a6-3b50a4b57107 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:20.101527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820eb6e4-8a5b-47d8-80a6-3b50a4b57107 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:20.102351 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820eb6e4-8a5b-47d8-80a6-3b50a4b57107 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:20.102819 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820eb6e4-8a5b-47d8-80a6-3b50a4b57107 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:20.104544 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820eb6e4-8a5b-47d8-80a6-3b50a4b57107 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:20.136991 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 237/484] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:20.140897 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820eb6e4-8a5b-47d8-80a6-3b50a4b57107 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:20.215720 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:20.235889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d32a9-29b8-40ad-bb26-b9fe570101b3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:20.272334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a93d8-210d-49b0-9544-c2e11d110d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:20.272940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a93d8-210d-49b0-9544-c2e11d110d7c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:20.273214 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a93d8-210d-49b0-9544-c2e11d110d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:20.273482 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a93d8-210d-49b0-9544-c2e11d110d7c None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:20.274196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a93d8-210d-49b0-9544-c2e11d110d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:20.274410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a93d8-210d-49b0-9544-c2e11d110d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:20.275766 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a93d8-210d-49b0-9544-c2e11d110d7c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:20.281626 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820eb6e4-8a5b-47d8-80a6-3b50a4b57107 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:20.293426 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 248/485] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:20.294368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a93d8-210d-49b0-9544-c2e11d110d7c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:20.322006 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f6a77-b0f3-496b-b5f9-27f992444743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:20.322906 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f6a77-b0f3-496b-b5f9-27f992444743 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:20.323386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f6a77-b0f3-496b-b5f9-27f992444743 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:20.323853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f6a77-b0f3-496b-b5f9-27f992444743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:20.324825 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f6a77-b0f3-496b-b5f9-27f992444743 None admin] RBAC: Adding query filter params (role.id=365b9c4c3245430e872f4aa988da3beb, scope.project.id=07b2dd5de0274a6896d407b0ff22ff54, user.id=a80cc7ec3d2d49f88c81403f918a6900) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:20.326054 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f6a77-b0f3-496b-b5f9-27f992444743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:20.328314 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f6a77-b0f3-496b-b5f9-27f992444743 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:20.334861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 238/486] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:12:20 2022] GET /identity/v3/role_assignments?user.id=a80cc7ec3d2d49f88c81403f918a6900&scope.project.id=07b2dd5de0274a6896d407b0ff22ff54&role.id=365b9c4c3245430e872f4aa988da3beb => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:20.335894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f6a77-b0f3-496b-b5f9-27f992444743 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:20.353297 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:20.461447 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a93d8-210d-49b0-9544-c2e11d110d7c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:20.472088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f6a77-b0f3-496b-b5f9-27f992444743 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:20.505866 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:20.509824 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa7a49-217e-48dc-958a-8d5f895e24a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:20.510645 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa7a49-217e-48dc-958a-8d5f895e24a2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:20.510935 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa7a49-217e-48dc-958a-8d5f895e24a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:20.511214 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa7a49-217e-48dc-958a-8d5f895e24a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:20.524507 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa7a49-217e-48dc-958a-8d5f895e24a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:20.530702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3ffa7a49-217e-48dc-958a-8d5f895e24a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:20.530702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:20.530702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:20.530702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:20.530702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:20.530702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:20.530702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:20.530702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:20.530702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:20.530702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:20.530702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:20.530702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:20.530702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:20.530702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:20.530702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:20.530702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:20.531648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:20.531648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:20.531648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:20.531648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:20.531648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:20.531648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:20.531648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:20.531648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:20.531648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:20.531648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:20.531648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:20.531648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:20.531648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:20.531648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:20.531648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:20.531648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:20.532472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:20.532472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:20.532472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:20.532472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:20.532472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:20.532472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:20.532472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:20.532472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:20.532472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:20.532472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:20.532472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:20.532472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:20.536364 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 249/487] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 17 10:12:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:20.537977 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa7a49-217e-48dc-958a-8d5f895e24a2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:20.573897 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deadc0b-fabb-453a-8d76-e7ad2e57be20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:20.574475 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deadc0b-fabb-453a-8d76-e7ad2e57be20 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:20.574753 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deadc0b-fabb-453a-8d76-e7ad2e57be20 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:20.575021 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deadc0b-fabb-453a-8d76-e7ad2e57be20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:20.593130 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deadc0b-fabb-453a-8d76-e7ad2e57be20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:20.595229 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deadc0b-fabb-453a-8d76-e7ad2e57be20 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:20.610484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-7deadc0b-fabb-453a-8d76-e7ad2e57be20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:20.610484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:20.610484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:20.610484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:20.610484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:20.610484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:20.610484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:20.610484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:20.610484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:20.610484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:20.610484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:20.610484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:20.610484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:20.610484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:20.610484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:20.611376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:20.612271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:20.612271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:20.612271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:20.612271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:20.612271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:20.612271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:20.612271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:20.612271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:20.612271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 239/488] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:20.623202 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deadc0b-fabb-453a-8d76-e7ad2e57be20 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:20.672879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa7a49-217e-48dc-958a-8d5f895e24a2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:20.675826 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:20.713667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41fddb-1b89-463f-9935-d759b529314f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:20.714666 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41fddb-1b89-463f-9935-d759b529314f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:20.715252 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41fddb-1b89-463f-9935-d759b529314f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:20.715738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41fddb-1b89-463f-9935-d759b529314f None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:20.716732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41fddb-1b89-463f-9935-d759b529314f None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:20.717258 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41fddb-1b89-463f-9935-d759b529314f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:20.719599 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41fddb-1b89-463f-9935-d759b529314f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:20.729280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 250/489] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 17 10:12:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:20.736597 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41fddb-1b89-463f-9935-d759b529314f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:20.737064 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deadc0b-fabb-453a-8d76-e7ad2e57be20 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:20.775455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0ed80-8b01-4cf5-9079-61c35c79cf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:20.776779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0ed80-8b01-4cf5-9079-61c35c79cf7f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:20.776779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0ed80-8b01-4cf5-9079-61c35c79cf7f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:20.776779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0ed80-8b01-4cf5-9079-61c35c79cf7f None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:20.777345 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0ed80-8b01-4cf5-9079-61c35c79cf7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:20.777650 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0ed80-8b01-4cf5-9079-61c35c79cf7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:20.779218 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0ed80-8b01-4cf5-9079-61c35c79cf7f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:20.792498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 240/490] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:20.798813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0ed80-8b01-4cf5-9079-61c35c79cf7f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:20.835507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:20.907654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0ed80-8b01-4cf5-9079-61c35c79cf7f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:20.919668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41fddb-1b89-463f-9935-d759b529314f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:20.962193 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eefe9d-392b-4024-8fef-0dc204e395e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:20.962822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eefe9d-392b-4024-8fef-0dc204e395e1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:20.963098 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eefe9d-392b-4024-8fef-0dc204e395e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:20.963366 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eefe9d-392b-4024-8fef-0dc204e395e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:20.975741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eefe9d-392b-4024-8fef-0dc204e395e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:20.977337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eefe9d-392b-4024-8fef-0dc204e395e1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:20.994775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f2eefe9d-392b-4024-8fef-0dc204e395e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:20.994775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:20.994775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:20.994775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:20.994775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:20.994775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:20.994775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:20.994775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:20.994775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:20.994775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:20.994775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:20.994775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:20.994775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:20.994775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:20.994775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:20.994775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:20.995713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:20.996591 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:20.996591 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:20.996591 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:20.996591 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 251/491] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:21.003589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eefe9d-392b-4024-8fef-0dc204e395e1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:21.016700 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eece6-af33-4304-8153-9dc286d3b4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:21.017316 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eece6-af33-4304-8153-9dc286d3b4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:21.017596 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eece6-af33-4304-8153-9dc286d3b4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:21.017868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eece6-af33-4304-8153-9dc286d3b4b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:21.018965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124eece6-af33-4304-8153-9dc286d3b4b1 None admin] RBAC: Adding query filter params (role.id=365b9c4c3245430e872f4aa988da3beb, scope.project.id=07b2dd5de0274a6896d407b0ff22ff54, user.id=98030e60807e44ec928488e904ca24c9) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:21.019280 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124eece6-af33-4304-8153-9dc286d3b4b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:21.020753 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124eece6-af33-4304-8153-9dc286d3b4b1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:21.036809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 241/492] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:12:20 2022] GET /identity/v3/role_assignments?user.id=98030e60807e44ec928488e904ca24c9&scope.project.id=07b2dd5de0274a6896d407b0ff22ff54&role.id=365b9c4c3245430e872f4aa988da3beb => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:21.050829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:21.200495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eefe9d-392b-4024-8fef-0dc204e395e1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:21.243586 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba545314-5541-4120-9d25-25ae1fd5ee30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:21.244236 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba545314-5541-4120-9d25-25ae1fd5ee30 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:21.244513 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba545314-5541-4120-9d25-25ae1fd5ee30 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:21.244785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba545314-5541-4120-9d25-25ae1fd5ee30 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:21.245447 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba545314-5541-4120-9d25-25ae1fd5ee30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:21.245745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba545314-5541-4120-9d25-25ae1fd5ee30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:21.247110 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba545314-5541-4120-9d25-25ae1fd5ee30 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:21.260972 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 252/493] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:21.266713 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eece6-af33-4304-8153-9dc286d3b4b1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:21.374810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:21.379761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eece6-af33-4304-8153-9dc286d3b4b1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:21.419860 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b5f65-fae2-4771-8072-df57dba03b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:21.420919 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b5f65-fae2-4771-8072-df57dba03b89 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:21.421400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b5f65-fae2-4771-8072-df57dba03b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:21.421888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b5f65-fae2-4771-8072-df57dba03b89 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:21.432968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b5f65-fae2-4771-8072-df57dba03b89 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:21.434754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b5f65-fae2-4771-8072-df57dba03b89 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:21.452358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f25b5f65-fae2-4771-8072-df57dba03b89 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 17 10:12:21.452358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:21.452358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:21.452358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:21.452358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:21.452358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:21.452358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:21.452358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:21.452358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:21.452358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:21.452358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:21.452358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:21.452358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:21.452358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:21.452358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:21.452358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:21.453270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:21.454169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:21.454169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:21.454169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:21.454169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:21.454169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:21.454169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:21.454169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:21.454169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:21.454169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 17 10:12:21.454169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:21.460781 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 242/494] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:12:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:21.463026 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba545314-5541-4120-9d25-25ae1fd5ee30 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:21.599488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:21.630518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba545314-5541-4120-9d25-25ae1fd5ee30 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:21.674422 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b81db-5209-45c6-8dec-c904312504cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:21.675038 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b81db-5209-45c6-8dec-c904312504cb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:21.675315 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b81db-5209-45c6-8dec-c904312504cb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:21.675646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b81db-5209-45c6-8dec-c904312504cb None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:21.676432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b81db-5209-45c6-8dec-c904312504cb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:21.676783 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b81db-5209-45c6-8dec-c904312504cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:21.678260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b81db-5209-45c6-8dec-c904312504cb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:21.702661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 253/495] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Oct 17 10:12:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:21.708610 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b5f65-fae2-4771-8072-df57dba03b89 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:21.831316 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b5f65-fae2-4771-8072-df57dba03b89 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:21.872696 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bf335-63f4-4981-bc38-c0b44ac79c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:21.873675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bf335-63f4-4981-bc38-c0b44ac79c7f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:21.874156 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bf335-63f4-4981-bc38-c0b44ac79c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:21.874625 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bf335-63f4-4981-bc38-c0b44ac79c7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:21.910577 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:21.919630 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4344727-2b6f-4400-9ff2-4c508d6e281e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:21.921051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4344727-2b6f-4400-9ff2-4c508d6e281e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:21.922459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4344727-2b6f-4400-9ff2-4c508d6e281e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:21.924386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 254/496] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:21.930651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69473c4b-eec6-474c-8105-fb71e87a12c6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:21.931203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69473c4b-eec6-474c-8105-fb71e87a12c6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:21.931673 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69473c4b-eec6-474c-8105-fb71e87a12c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:21.951849 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-69473c4b-eec6-474c-8105-fb71e87a12c6 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:21.953762 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-69473c4b-eec6-474c-8105-fb71e87a12c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:22.002046 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bf335-63f4-4981-bc38-c0b44ac79c7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:22.003538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bf335-63f4-4981-bc38-c0b44ac79c7f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:22.045613 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 255/497] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:12:22.159989 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 243/498] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:12:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 10:12:22.166023 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69473c4b-eec6-474c-8105-fb71e87a12c6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:22.224920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd44551-3cd1-41de-8bbb-5a4ce6488f06 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:22.225530 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd44551-3cd1-41de-8bbb-5a4ce6488f06 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:22.226020 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd44551-3cd1-41de-8bbb-5a4ce6488f06 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:22.228856 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 244/499] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:12:22.234102 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14c842-8ab1-4cc1-a211-fcec31f035ec None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:22.234610 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14c842-8ab1-4cc1-a211-fcec31f035ec None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:22.235083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14c842-8ab1-4cc1-a211-fcec31f035ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:22.254523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3d14c842-8ab1-4cc1-a211-fcec31f035ec None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:22.256279 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3d14c842-8ab1-4cc1-a211-fcec31f035ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:22.256404 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:22.293847 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69473c4b-eec6-474c-8105-fb71e87a12c6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:22.324348 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:22.359908 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 245/500] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:22.360754 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfa22d-0f4c-482f-b2be-feb5808aaba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:22.361474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfa22d-0f4c-482f-b2be-feb5808aaba2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:22.361822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfa22d-0f4c-482f-b2be-feb5808aaba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:22.362171 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfa22d-0f4c-482f-b2be-feb5808aaba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:22.383578 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfa22d-0f4c-482f-b2be-feb5808aaba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:22.385085 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfa22d-0f4c-482f-b2be-feb5808aaba2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:22.400440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-76bfa22d-0f4c-482f-b2be-feb5808aaba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:22.400440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:22.400440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:22.400440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:22.400440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:22.400440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:22.400440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:22.400440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:22.400440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:22.400440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:22.400440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:22.400440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:22.400440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:22.400440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:22.400440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:22.400440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:22.401363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:22.402646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:22.402646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:22.402646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:22.402646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 256/501] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:22.407442 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14c842-8ab1-4cc1-a211-fcec31f035ec None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:22.419923 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfa22d-0f4c-482f-b2be-feb5808aaba2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:22.544738 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14c842-8ab1-4cc1-a211-fcec31f035ec None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:22.615137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552aa686-ea1f-47db-b17c-3fbc8e32ecd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:22.615754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aa686-ea1f-47db-b17c-3fbc8e32ecd8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:22.616059 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aa686-ea1f-47db-b17c-3fbc8e32ecd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:22.616334 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aa686-ea1f-47db-b17c-3fbc8e32ecd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:22.616985 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552aa686-ea1f-47db-b17c-3fbc8e32ecd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:22.617294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552aa686-ea1f-47db-b17c-3fbc8e32ecd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:22.618663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552aa686-ea1f-47db-b17c-3fbc8e32ecd8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:22.634524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfa22d-0f4c-482f-b2be-feb5808aaba2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:22.648304 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 246/502] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:22.650310 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552aa686-ea1f-47db-b17c-3fbc8e32ecd8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:22.663049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:22.682911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df4a71-9a14-4ce7-a15c-80d11377a6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:22.683972 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df4a71-9a14-4ce7-a15c-80d11377a6df None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:22.684486 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df4a71-9a14-4ce7-a15c-80d11377a6df None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:22.685505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df4a71-9a14-4ce7-a15c-80d11377a6df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:22.696917 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df4a71-9a14-4ce7-a15c-80d11377a6df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:22.698654 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df4a71-9a14-4ce7-a15c-80d11377a6df None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:22.713947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b2df4a71-9a14-4ce7-a15c-80d11377a6df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:22.713947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:22.713947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:22.713947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:22.713947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:22.713947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:22.713947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:22.713947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:22.713947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:22.713947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:22.713947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:22.713947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:22.713947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:22.713947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:22.713947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:22.713947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:22.715349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:22.716797 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:22.716797 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:22.716797 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:22.718576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 257/503] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:22.719700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df4a71-9a14-4ce7-a15c-80d11377a6df None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:22.724274 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:22.770296 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552aa686-ea1f-47db-b17c-3fbc8e32ecd8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:22.808815 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef2c07-2ead-488d-a6a2-f346f70ccd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:22.809368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef2c07-2ead-488d-a6a2-f346f70ccd3a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:22.809678 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef2c07-2ead-488d-a6a2-f346f70ccd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:22.809960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef2c07-2ead-488d-a6a2-f346f70ccd3a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:22.810543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef2c07-2ead-488d-a6a2-f346f70ccd3a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:22.812033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef2c07-2ead-488d-a6a2-f346f70ccd3a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c2ef2c07-2ead-488d-a6a2-f346f70ccd3a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:22.824012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:22.825003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:22.825003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:22.825003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:22.825003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:22.825003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:22.825003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:22.825003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:22.825003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:22.825003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:22.825003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:22.825003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:22.825003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:22.825003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:22.825003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:22.825003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:22.825003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:22.831008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:22.831008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:22.831008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:22.831008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:22.831008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:22.831008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:22.831008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:22.831008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:22.831008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:22.831008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:22.831008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:22.831008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:22.831008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 10:12:22.831008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:22.831008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 247/504] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Oct 17 10:12:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:22.831840 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef2c07-2ead-488d-a6a2-f346f70ccd3a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:22.831909 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df4a71-9a14-4ce7-a15c-80d11377a6df None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:22.873166 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb8f7a-41b7-4a3f-8330-aff65bedd7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:22.874200 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb8f7a-41b7-4a3f-8330-aff65bedd7fd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:22.874724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb8f7a-41b7-4a3f-8330-aff65bedd7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:22.875226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb8f7a-41b7-4a3f-8330-aff65bedd7fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:22.883080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb8f7a-41b7-4a3f-8330-aff65bedd7fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:22.884890 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb8f7a-41b7-4a3f-8330-aff65bedd7fd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:22.898131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-1dcb8f7a-41b7-4a3f-8330-aff65bedd7fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:22.898131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:22.898131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:22.898131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:22.898131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:22.898131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:22.898131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:22.898131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:22.898131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:22.898131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:22.898131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:22.898131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:22.898131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:22.898131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:22.898131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:22.899014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:22.899880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:22.899880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:22.899880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:22.899880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:22.899880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:22.899880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:22.899880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:22.899880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:22.902579 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 258/505] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:22.903732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb8f7a-41b7-4a3f-8330-aff65bedd7fd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:22.951581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:22.985642 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef2c07-2ead-488d-a6a2-f346f70ccd3a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:23.021637 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:23.048223 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3350f34-ba16-4a43-92ff-f30da76fbf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:23.048223 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3350f34-ba16-4a43-92ff-f30da76fbf89 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:23.048223 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3350f34-ba16-4a43-92ff-f30da76fbf89 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:23.048223 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3350f34-ba16-4a43-92ff-f30da76fbf89 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:23.049617 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3350f34-ba16-4a43-92ff-f30da76fbf89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:23.051510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3350f34-ba16-4a43-92ff-f30da76fbf89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:23.052948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3350f34-ba16-4a43-92ff-f30da76fbf89 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:23.066869 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 248/506] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:23.067484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3350f34-ba16-4a43-92ff-f30da76fbf89 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:23.072111 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb8f7a-41b7-4a3f-8330-aff65bedd7fd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:23.110274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7be3d-cc1e-4505-b784-ad6bad192fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:23.111256 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7be3d-cc1e-4505-b784-ad6bad192fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:23.111689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7be3d-cc1e-4505-b784-ad6bad192fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:23.112157 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7be3d-cc1e-4505-b784-ad6bad192fe9 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:23.112952 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7be3d-cc1e-4505-b784-ad6bad192fe9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:23.113402 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7be3d-cc1e-4505-b784-ad6bad192fe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:23.114923 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7be3d-cc1e-4505-b784-ad6bad192fe9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:23.124645 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 259/507] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Oct 17 10:12:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:23.126227 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81529c67-bc04-4e06-910b-7f27fe90e28a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:23.126778 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81529c67-bc04-4e06-910b-7f27fe90e28a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:23.127198 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81529c67-bc04-4e06-910b-7f27fe90e28a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:23.129372 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 260/508] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:23.130409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81529c67-bc04-4e06-910b-7f27fe90e28a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:23.189787 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3350f34-ba16-4a43-92ff-f30da76fbf89 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:23.225966 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507414f-b35b-43ab-9051-779d3ac23c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:23.226866 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507414f-b35b-43ab-9051-779d3ac23c05 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:23.227144 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507414f-b35b-43ab-9051-779d3ac23c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:23.227591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507414f-b35b-43ab-9051-779d3ac23c05 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:23.228374 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507414f-b35b-43ab-9051-779d3ac23c05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:23.228685 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507414f-b35b-43ab-9051-779d3ac23c05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:23.230125 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507414f-b35b-43ab-9051-779d3ac23c05 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:23.249588 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:23.249782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 249/509] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:23.249782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507414f-b35b-43ab-9051-779d3ac23c05 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:23.257451 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81529c67-bc04-4e06-910b-7f27fe90e28a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:23.281462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:23.311063 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fdc8c9-9c73-439e-98e2-d622128f658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:23.311851 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdc8c9-9c73-439e-98e2-d622128f658c None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:23.312166 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdc8c9-9c73-439e-98e2-d622128f658c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:23.312607 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdc8c9-9c73-439e-98e2-d622128f658c None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:23.313611 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdc8c9-9c73-439e-98e2-d622128f658c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:23.315558 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdc8c9-9c73-439e-98e2-d622128f658c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:23.360078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 261/510] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:12:23 2022] POST /identity/v3/users => generated 254 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:23.360078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f5528-a10d-4733-8b54-05cd8a0e1921 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:23.360078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f5528-a10d-4733-8b54-05cd8a0e1921 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:23.360078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f5528-a10d-4733-8b54-05cd8a0e1921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:23.389037 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2a9f5528-a10d-4733-8b54-05cd8a0e1921 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:23.390594 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2a9f5528-a10d-4733-8b54-05cd8a0e1921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:23.394075 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507414f-b35b-43ab-9051-779d3ac23c05 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:23.455448 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211632e7-bd7a-4d58-b9d3-4a1d8c0b83f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:23.456350 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211632e7-bd7a-4d58-b9d3-4a1d8c0b83f3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:23.456727 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211632e7-bd7a-4d58-b9d3-4a1d8c0b83f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:23.457098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211632e7-bd7a-4d58-b9d3-4a1d8c0b83f3 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:23.457845 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211632e7-bd7a-4d58-b9d3-4a1d8c0b83f3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:23.458248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211632e7-bd7a-4d58-b9d3-4a1d8c0b83f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:23.459758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211632e7-bd7a-4d58-b9d3-4a1d8c0b83f3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:23.468814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 250/511] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Oct 17 10:12:23 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:23.469640 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211632e7-bd7a-4d58-b9d3-4a1d8c0b83f3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:23.496857 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 262/512] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:23.592894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:23.601743 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211632e7-bd7a-4d58-b9d3-4a1d8c0b83f3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:23.641446 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b9ea6-4ed3-4786-8bd4-2af4c8b2a4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:23.642066 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b9ea6-4ed3-4786-8bd4-2af4c8b2a4ac None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:23.642346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b9ea6-4ed3-4786-8bd4-2af4c8b2a4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:23.642618 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b9ea6-4ed3-4786-8bd4-2af4c8b2a4ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:23.643360 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b9ea6-4ed3-4786-8bd4-2af4c8b2a4ac None admin] RBAC: Adding query filter params (role.id=365b9c4c3245430e872f4aa988da3beb, scope.project.id=07b2dd5de0274a6896d407b0ff22ff54, user.id=e2969c098a154afcba382c707122598d) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:23.643672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b9ea6-4ed3-4786-8bd4-2af4c8b2a4ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:23.645205 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b9ea6-4ed3-4786-8bd4-2af4c8b2a4ac None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:23.652570 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 251/513] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:12:23 2022] GET /identity/v3/role_assignments?user.id=e2969c098a154afcba382c707122598d&scope.project.id=07b2dd5de0274a6896d407b0ff22ff54&role.id=365b9c4c3245430e872f4aa988da3beb => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:23.694662 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bbae3-ba99-4ab7-b0dc-26c820d76355 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:23.695192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bbae3-ba99-4ab7-b0dc-26c820d76355 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:23.695192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bbae3-ba99-4ab7-b0dc-26c820d76355 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:23.697053 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 263/514] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:23.702938 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701650e-2a93-4b71-9296-416d685206f3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:23.703250 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701650e-2a93-4b71-9296-416d685206f3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:23.703624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701650e-2a93-4b71-9296-416d685206f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:23.723726 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9701650e-2a93-4b71-9296-416d685206f3 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:23.725347 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9701650e-2a93-4b71-9296-416d685206f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:23.804378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 252/515] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:23.855041 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bbae3-ba99-4ab7-b0dc-26c820d76355 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:23.958196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:23.983919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bbae3-ba99-4ab7-b0dc-26c820d76355 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:24.025589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58421770-3853-407d-80d2-29b912cf1a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:24.026229 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58421770-3853-407d-80d2-29b912cf1a86 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:24.026509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58421770-3853-407d-80d2-29b912cf1a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:24.026780 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58421770-3853-407d-80d2-29b912cf1a86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:24.038504 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58421770-3853-407d-80d2-29b912cf1a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:24.043687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-58421770-3853-407d-80d2-29b912cf1a86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:12:24.043687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:24.043687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:24.043687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:24.043687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:24.043687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:24.043687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:24.043687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:24.043687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:24.043687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:24.043687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:24.043687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:24.043687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:24.043687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:24.043687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:24.043687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:24.044667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:24.044667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:24.044667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:24.044667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:24.044667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:24.044667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:24.044667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:24.044667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:24.044667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:24.044667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:24.044667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:24.044667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:24.044667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:24.044667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:24.044667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:24.044667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:24.045505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:24.045505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:24.045505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:24.045505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:24.045505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:24.045505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:24.045505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:24.045505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:24.045505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:24.045505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:24.045505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:12:24.045505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:24.048141 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 264/516] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:12:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:24.055497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701650e-2a93-4b71-9296-416d685206f3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:24.112357 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58421770-3853-407d-80d2-29b912cf1a86 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:24.168443 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:24.180071 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701650e-2a93-4b71-9296-416d685206f3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:24.216222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7264b-f4bf-49f7-82c6-b25b9ea94796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:24.216749 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7264b-f4bf-49f7-82c6-b25b9ea94796 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:24.217024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7264b-f4bf-49f7-82c6-b25b9ea94796 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:24.217294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7264b-f4bf-49f7-82c6-b25b9ea94796 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:24.218092 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7264b-f4bf-49f7-82c6-b25b9ea94796 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:24.218398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7264b-f4bf-49f7-82c6-b25b9ea94796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:24.219771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7264b-f4bf-49f7-82c6-b25b9ea94796 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:24.230666 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 253/517] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:12:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:24.235673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7264b-f4bf-49f7-82c6-b25b9ea94796 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:24.342608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58421770-3853-407d-80d2-29b912cf1a86 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:24.370385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7264b-f4bf-49f7-82c6-b25b9ea94796 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:24.404628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f46f45-68d5-481d-b5cf-bc8a348ff268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:24.405315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f46f45-68d5-481d-b5cf-bc8a348ff268 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:24.405603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f46f45-68d5-481d-b5cf-bc8a348ff268 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:24.405880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f46f45-68d5-481d-b5cf-bc8a348ff268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:24.416991 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f46f45-68d5-481d-b5cf-bc8a348ff268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:24.418215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f46f45-68d5-481d-b5cf-bc8a348ff268 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:24.433120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c4f46f45-68d5-481d-b5cf-bc8a348ff268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:24.433120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:24.433120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:24.433120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:24.433120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:24.433120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:24.433120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:24.433120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:24.433120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:24.433120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:24.433120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:24.433120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:24.433120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:24.433120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:24.433120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:24.433120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:24.434141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:24.435773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:24.435773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:24.435773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:24.435773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 254/518] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:24.437852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba704d6-d466-446c-af1f-e387d9f3865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:24.437852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba704d6-d466-446c-af1f-e387d9f3865e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:24.437852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba704d6-d466-446c-af1f-e387d9f3865e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:24.437852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba704d6-d466-446c-af1f-e387d9f3865e None admin] PATH_INFO: `/v3/services/network` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:24.438340 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba704d6-d466-446c-af1f-e387d9f3865e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:24.439575 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f46f45-68d5-481d-b5cf-bc8a348ff268 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:24.444240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:24.445067 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba704d6-d466-446c-af1f-e387d9f3865e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4ba704d6-d466-446c-af1f-e387d9f3865e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:24.478376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:24.479396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:24.479396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:24.479396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:24.479396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:24.479396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:24.479396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:24.479396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:24.479396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:24.479396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:24.479396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:24.479396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:24.479396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:24.479396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:24.479396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:24.479396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:24.479396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:24.480498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:24.480498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:24.480498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:24.480498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:24.480498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:24.480498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:24.480498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:24.480498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:24.480498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:24.480498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:24.480498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:24.480498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:24.480498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 10:12:24.480498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:24.488508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 265/519] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:24 2022] GET /identity/v3/services/network => generated 88 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:24.494414 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba704d6-d466-446c-af1f-e387d9f3865e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:24.509044 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:24.543851 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f46f45-68d5-481d-b5cf-bc8a348ff268 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:24.587038 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95944f37-66b7-4d08-bb01-5c455f8a679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:24.587641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95944f37-66b7-4d08-bb01-5c455f8a679d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:24.587921 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95944f37-66b7-4d08-bb01-5c455f8a679d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:24.588212 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95944f37-66b7-4d08-bb01-5c455f8a679d None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:24.588853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95944f37-66b7-4d08-bb01-5c455f8a679d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:24.589152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95944f37-66b7-4d08-bb01-5c455f8a679d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:24.590527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95944f37-66b7-4d08-bb01-5c455f8a679d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:24.603043 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 255/520] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:24.609164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95944f37-66b7-4d08-bb01-5c455f8a679d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:24.672446 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:24.710876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba704d6-d466-446c-af1f-e387d9f3865e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:24.712090 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95944f37-66b7-4d08-bb01-5c455f8a679d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:24.746579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0206b-5785-4096-a0d0-87d10247da46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:24.747624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0206b-5785-4096-a0d0-87d10247da46 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:24.747914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0206b-5785-4096-a0d0-87d10247da46 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:24.748277 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0206b-5785-4096-a0d0-87d10247da46 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:24.755712 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0206b-5785-4096-a0d0-87d10247da46 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:24.757182 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0206b-5785-4096-a0d0-87d10247da46 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:24.768501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-99d0206b-5785-4096-a0d0-87d10247da46 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 10:12:24.768501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:24.768501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:24.768501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:24.768501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:24.768501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:24.768501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:24.768501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:24.768501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:24.768501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:24.768501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:24.768501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:24.768501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:24.768501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:24.768501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:24.768501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:24.769433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:24.770730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:24.770730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:24.770730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:24.770730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:24.770730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:24.770730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:24.770730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:24.770730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:24.770730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 10:12:24.770730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:24.770730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 256/521] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Oct 17 10:12:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:24.775250 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0206b-5785-4096-a0d0-87d10247da46 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:24.785569 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499aacc2-9fe3-4b87-9745-73841056638b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:24.786198 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499aacc2-9fe3-4b87-9745-73841056638b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:24.786482 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499aacc2-9fe3-4b87-9745-73841056638b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:24.786752 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499aacc2-9fe3-4b87-9745-73841056638b None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:24.787395 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499aacc2-9fe3-4b87-9745-73841056638b None admin] RBAC: Adding query filter params (name=network) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:24.787701 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499aacc2-9fe3-4b87-9745-73841056638b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:24.789120 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499aacc2-9fe3-4b87-9745-73841056638b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:24.801957 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 266/522] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 17 10:12:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:24.808375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499aacc2-9fe3-4b87-9745-73841056638b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:24.882034 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0206b-5785-4096-a0d0-87d10247da46 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:24.889721 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:24.913794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:24.917316 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df4bbd-fed2-4e62-a949-fb81fee94652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:24.917846 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499aacc2-9fe3-4b87-9745-73841056638b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:24.918110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df4bbd-fed2-4e62-a949-fb81fee94652 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:24.918395 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df4bbd-fed2-4e62-a949-fb81fee94652 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:24.918727 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df4bbd-fed2-4e62-a949-fb81fee94652 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:24.920296 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df4bbd-fed2-4e62-a949-fb81fee94652 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:24.920622 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df4bbd-fed2-4e62-a949-fb81fee94652 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:24.922258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df4bbd-fed2-4e62-a949-fb81fee94652 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:24.940489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 257/523] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Oct 17 10:12:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:24.946720 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df4bbd-fed2-4e62-a949-fb81fee94652 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:24.958057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb96bc9-a726-4599-85ac-fb8858783272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:24.958668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb96bc9-a726-4599-85ac-fb8858783272 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:24.958955 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb96bc9-a726-4599-85ac-fb8858783272 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:24.959227 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb96bc9-a726-4599-85ac-fb8858783272 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:24.959858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb96bc9-a726-4599-85ac-fb8858783272 None admin] RBAC: Adding query filter params (type=network) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:24.960313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb96bc9-a726-4599-85ac-fb8858783272 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:24.961691 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb96bc9-a726-4599-85ac-fb8858783272 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:24.970022 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 267/524] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 17 10:12:24 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:25.080257 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df4bbd-fed2-4e62-a949-fb81fee94652 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:25.118081 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d38c7-b013-4057-8eb8-b73f308ff8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:25.118728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d38c7-b013-4057-8eb8-b73f308ff8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:25.119008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d38c7-b013-4057-8eb8-b73f308ff8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:25.119285 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d38c7-b013-4057-8eb8-b73f308ff8d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:25.131508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d38c7-b013-4057-8eb8-b73f308ff8d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:25.133020 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d38c7-b013-4057-8eb8-b73f308ff8d6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:25.156507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ae6d38c7-b013-4057-8eb8-b73f308ff8d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:25.156507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:25.156507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:25.156507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:25.156507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:25.156507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:25.156507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:25.156507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:25.156507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:25.156507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:25.156507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:25.156507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:25.156507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:25.156507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:25.156507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:25.156507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:25.157532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:25.159022 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:25.159022 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:25.159022 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:25.159022 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 258/525] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:25.163286 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb96bc9-a726-4599-85ac-fb8858783272 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:25.272802 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb96bc9-a726-4599-85ac-fb8858783272 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:25.302832 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:25.308472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1d677-0497-4833-9d50-3d5f15d655d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:25.309656 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1d677-0497-4833-9d50-3d5f15d655d9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:25.310234 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1d677-0497-4833-9d50-3d5f15d655d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:25.310945 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1d677-0497-4833-9d50-3d5f15d655d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:25.311824 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1d677-0497-4833-9d50-3d5f15d655d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:25.313342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1d677-0497-4833-9d50-3d5f15d655d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:25.314724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1d677-0497-4833-9d50-3d5f15d655d9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:25.327798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 268/526] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:25.333078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d38c7-b013-4057-8eb8-b73f308ff8d6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:25.384155 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:25.479732 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d38c7-b013-4057-8eb8-b73f308ff8d6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:25.522569 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb633e72-7a78-491a-ad87-ffd03bc502be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:25.523203 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb633e72-7a78-491a-ad87-ffd03bc502be None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:25.523484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb633e72-7a78-491a-ad87-ffd03bc502be None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:25.523753 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb633e72-7a78-491a-ad87-ffd03bc502be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:25.534583 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb633e72-7a78-491a-ad87-ffd03bc502be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:25.536037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb633e72-7a78-491a-ad87-ffd03bc502be None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:25.551044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-eb633e72-7a78-491a-ad87-ffd03bc502be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:25.551044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:25.551044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:25.551044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:25.551044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:25.551044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:25.551044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:25.551044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:25.551044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:25.551044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:25.551044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:25.551044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:25.551044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:25.551044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:25.551044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:25.552383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:25.553252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:25.553252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:25.553252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:25.553252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:25.553252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:25.553252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:25.553252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:25.553252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:25.553252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 259/527] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:25.560322 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1d677-0497-4833-9d50-3d5f15d655d9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:25.663706 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1d677-0497-4833-9d50-3d5f15d655d9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:25.699697 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c8426-8f25-45c3-9719-9f9370ecbce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:25.700501 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c8426-8f25-45c3-9719-9f9370ecbce9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:25.700803 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c8426-8f25-45c3-9719-9f9370ecbce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:25.701086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c8426-8f25-45c3-9719-9f9370ecbce9 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:25.701950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c8426-8f25-45c3-9719-9f9370ecbce9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:25.702268 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c8426-8f25-45c3-9719-9f9370ecbce9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:25.703781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c8426-8f25-45c3-9719-9f9370ecbce9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:25.717085 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 269/528] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:25.725228 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb633e72-7a78-491a-ad87-ffd03bc502be None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:25.838635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:25.850518 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb633e72-7a78-491a-ad87-ffd03bc502be None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:25.890875 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0f06c-c3d0-43b6-8664-5576b789f9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:25.891545 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0f06c-c3d0-43b6-8664-5576b789f9a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:25.891824 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0f06c-c3d0-43b6-8664-5576b789f9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:25.892189 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0f06c-c3d0-43b6-8664-5576b789f9a9 None admin] PATH_INFO: `/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/a80cc7ec3d2d49f88c81403f918a6900/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:25.894120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0f06c-c3d0-43b6-8664-5576b789f9a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=07b2dd5de0274a6896d407b0ff22ff54, user_id=a80cc7ec3d2d49f88c81403f918a6900, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:25.895684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0f06c-c3d0-43b6-8664-5576b789f9a9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:25.916492 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 260/529] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:12:25 2022] PUT /identity/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/a80cc7ec3d2d49f88c81403f918a6900/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:12:26.175859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6b3e1-e74d-47c3-9070-e273424a2c0f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:26.176518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6b3e1-e74d-47c3-9070-e273424a2c0f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:26.176998 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6b3e1-e74d-47c3-9070-e273424a2c0f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:26.178855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 270/530] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:26.184489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0618351-c18f-4fdd-b15d-3170a1ce9ebb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:26.185080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0618351-c18f-4fdd-b15d-3170a1ce9ebb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:26.185561 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0618351-c18f-4fdd-b15d-3170a1ce9ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:26.205624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f0618351-c18f-4fdd-b15d-3170a1ce9ebb None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:26.207145 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f0618351-c18f-4fdd-b15d-3170a1ce9ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:26.295342 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 261/531] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:26.385254 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a03c3-39b4-42ef-9401-09a4321b209a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:26.385908 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a03c3-39b4-42ef-9401-09a4321b209a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:26.386382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a03c3-39b4-42ef-9401-09a4321b209a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:26.388011 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 271/532] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:26.393494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89e973-f527-4c0f-9dd7-4f337cc99d20 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:26.394062 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89e973-f527-4c0f-9dd7-4f337cc99d20 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:26.394640 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89e973-f527-4c0f-9dd7-4f337cc99d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:26.413824 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bd89e973-f527-4c0f-9dd7-4f337cc99d20 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:26.415352 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bd89e973-f527-4c0f-9dd7-4f337cc99d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:26.506706 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 262/533] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:26.586915 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a03c3-39b4-42ef-9401-09a4321b209a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:26.622853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc45f08-9dee-4f32-a23e-2c1f9758ee5e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:26.623810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc45f08-9dee-4f32-a23e-2c1f9758ee5e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:26.624306 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc45f08-9dee-4f32-a23e-2c1f9758ee5e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:26.626123 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 263/534] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:12:26.633659 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739b819-56b2-49b4-bc78-2d57b6397409 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:26.634027 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739b819-56b2-49b4-bc78-2d57b6397409 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:26.634401 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739b819-56b2-49b4-bc78-2d57b6397409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:26.652330 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:26.672912 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4739b819-56b2-49b4-bc78-2d57b6397409 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:26.674113 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4739b819-56b2-49b4-bc78-2d57b6397409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:26.694490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:26.711667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a03c3-39b4-42ef-9401-09a4321b209a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:26.767230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42870a73-ae17-49dd-bf37-d7a9a98c1d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:26.767832 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42870a73-ae17-49dd-bf37-d7a9a98c1d9d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:26.768077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42870a73-ae17-49dd-bf37-d7a9a98c1d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:26.768355 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42870a73-ae17-49dd-bf37-d7a9a98c1d9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:26.784917 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 264/535] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 10:12:26.791508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42870a73-ae17-49dd-bf37-d7a9a98c1d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:26.797115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-42870a73-ae17-49dd-bf37-d7a9a98c1d9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:12:26.797115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:26.797115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:26.797115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:26.797115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:26.797115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:26.797115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:26.797115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:26.797115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:26.797115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:26.797115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:26.797115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:26.797115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:26.797115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:26.797115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:26.797115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:26.798035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:26.798035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:26.798035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:26.798035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:26.798035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:26.798035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:26.798035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:26.798035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:26.798035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:26.798035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:26.798035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:26.798035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:26.798035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:26.798035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:26.798035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:26.798035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:26.798859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:26.798859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:26.798859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:26.798859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:26.798859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:26.798859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:26.798859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:26.798859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:26.798859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:26.798859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:26.798859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:12:26.798859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:26.798859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 272/536] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:12:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:26.804039 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739b819-56b2-49b4-bc78-2d57b6397409 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:26.824285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42870a73-ae17-49dd-bf37-d7a9a98c1d9d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:26.992048 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739b819-56b2-49b4-bc78-2d57b6397409 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:26.995281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42870a73-ae17-49dd-bf37-d7a9a98c1d9d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:27.008982 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:27.050594 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709c9ca-466f-4988-9e04-2dd7f6193be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:27.051121 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709c9ca-466f-4988-9e04-2dd7f6193be7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:27.051398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709c9ca-466f-4988-9e04-2dd7f6193be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:27.051669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709c9ca-466f-4988-9e04-2dd7f6193be7 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:27.052371 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709c9ca-466f-4988-9e04-2dd7f6193be7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:27.052673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709c9ca-466f-4988-9e04-2dd7f6193be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:27.054039 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709c9ca-466f-4988-9e04-2dd7f6193be7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:27.057534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837317f1-055b-4b0e-b018-ab3f3a7884ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:27.058154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837317f1-055b-4b0e-b018-ab3f3a7884ed None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:27.058430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837317f1-055b-4b0e-b018-ab3f3a7884ed None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:27.058704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837317f1-055b-4b0e-b018-ab3f3a7884ed None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:27.059375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837317f1-055b-4b0e-b018-ab3f3a7884ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:27.061296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837317f1-055b-4b0e-b018-ab3f3a7884ed None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:27.074765 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 265/537] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:12:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:27.080851 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709c9ca-466f-4988-9e04-2dd7f6193be7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:27.092221 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:27.100458 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 273/538] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 17 10:12:26 2022] POST /identity/v3/services => generated 251 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:12:27.124979 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837317f1-055b-4b0e-b018-ab3f3a7884ed None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:27.251019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709c9ca-466f-4988-9e04-2dd7f6193be7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:27.301089 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837317f1-055b-4b0e-b018-ab3f3a7884ed None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:27.313123 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb4cc4-c4da-43ff-b386-54e51df0285d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:27.313768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb4cc4-c4da-43ff-b386-54e51df0285d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:27.314044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb4cc4-c4da-43ff-b386-54e51df0285d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:27.314316 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb4cc4-c4da-43ff-b386-54e51df0285d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:27.328613 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb4cc4-c4da-43ff-b386-54e51df0285d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:27.331287 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb4cc4-c4da-43ff-b386-54e51df0285d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:27.350115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-adfb4cc4-c4da-43ff-b386-54e51df0285d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:27.350115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:27.350115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:27.350115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:27.350115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:27.350115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:27.350115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:27.350115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:27.350115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:27.350115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:27.350115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:27.350115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:27.350115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:27.350115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:27.350115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:27.350115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:27.351084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:27.352025 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:27.352025 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:27.352025 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:27.355949 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 266/539] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:27.357056 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb4cc4-c4da-43ff-b386-54e51df0285d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:27.373655 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dea800-1fef-43cb-8b88-203dc1176672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:27.374302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea800-1fef-43cb-8b88-203dc1176672 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:27.374581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea800-1fef-43cb-8b88-203dc1176672 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:27.374857 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea800-1fef-43cb-8b88-203dc1176672 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:27.392603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dea800-1fef-43cb-8b88-203dc1176672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:27.400604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d3dea800-1fef-43cb-8b88-203dc1176672 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:27.400604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:27.400604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:27.400604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:27.400604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:27.400604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:27.400604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:27.400604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:27.400604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:27.400604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:27.400604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:27.400604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:27.400604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:27.400604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:27.400604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:27.400604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:27.401531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:27.401531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:27.401531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:27.401531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:27.401531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:27.401531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:27.401531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:27.401531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:27.401531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:27.401531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:27.401531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:27.401531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:27.401531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:27.401531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:27.401531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:27.401531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:27.402334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:27.402334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:27.402334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:27.402334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:27.402334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:27.402334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:27.402334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:27.402334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:27.402334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:27.402334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:27.402334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:27.402334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:27.405180 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 274/540] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 17 10:12:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:27.410964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dea800-1fef-43cb-8b88-203dc1176672 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:27.443493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:27.449053 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:27.482114 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb4cc4-c4da-43ff-b386-54e51df0285d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:27.524112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eda888-c22f-4995-9f00-3358701e5b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:27.524722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eda888-c22f-4995-9f00-3358701e5b8b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:27.525002 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eda888-c22f-4995-9f00-3358701e5b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:27.525276 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eda888-c22f-4995-9f00-3358701e5b8b None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:27.526037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eda888-c22f-4995-9f00-3358701e5b8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:27.526343 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eda888-c22f-4995-9f00-3358701e5b8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:27.527892 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eda888-c22f-4995-9f00-3358701e5b8b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:27.541306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dea800-1fef-43cb-8b88-203dc1176672 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:27.543419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 267/541] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:27.548857 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eda888-c22f-4995-9f00-3358701e5b8b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:27.585779 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a095f-6799-4476-a190-6214f92e0cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:27.586993 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a095f-6799-4476-a190-6214f92e0cfd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:27.587751 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a095f-6799-4476-a190-6214f92e0cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:27.588267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a095f-6799-4476-a190-6214f92e0cfd None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:27.589644 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a095f-6799-4476-a190-6214f92e0cfd None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:27.590201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a095f-6799-4476-a190-6214f92e0cfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:27.591965 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a095f-6799-4476-a190-6214f92e0cfd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:27.602881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 275/542] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 17 10:12:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:27.610249 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a095f-6799-4476-a190-6214f92e0cfd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:27.701074 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eda888-c22f-4995-9f00-3358701e5b8b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:27.718457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:27.744035 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646f27b-9bb2-4feb-b69e-7e62658cb246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:27.744673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646f27b-9bb2-4feb-b69e-7e62658cb246 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:27.744950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646f27b-9bb2-4feb-b69e-7e62658cb246 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:27.745222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646f27b-9bb2-4feb-b69e-7e62658cb246 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:27.754364 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646f27b-9bb2-4feb-b69e-7e62658cb246 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:27.756591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646f27b-9bb2-4feb-b69e-7e62658cb246 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:27.763673 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:27.772967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f646f27b-9bb2-4feb-b69e-7e62658cb246 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 17 10:12:27.772967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:27.772967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:27.772967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:27.772967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:27.772967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:27.772967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:27.772967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:27.772967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:27.772967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:27.772967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:27.772967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:27.772967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:27.772967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:27.772967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:27.772967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:27.773883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:27.774801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:27.774801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:27.774801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:27.774801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:27.774801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:27.774801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:27.774801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:27.774801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:27.774801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 17 10:12:27.774801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:27.774801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 268/543] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:12:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:27.775367 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a095f-6799-4476-a190-6214f92e0cfd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:27.775768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de39e6-ef77-418c-a89c-d693a486057b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:27.775768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de39e6-ef77-418c-a89c-d693a486057b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:27.781136 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de39e6-ef77-418c-a89c-d693a486057b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:27.782853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 269/544] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:27.783588 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de39e6-ef77-418c-a89c-d693a486057b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:27.814895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f94c8-9f31-489f-ab6c-da2eb7e4a3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:27.815525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f94c8-9f31-489f-ab6c-da2eb7e4a3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:27.815804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f94c8-9f31-489f-ab6c-da2eb7e4a3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:27.816192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f94c8-9f31-489f-ab6c-da2eb7e4a3d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:27.827284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f94c8-9f31-489f-ab6c-da2eb7e4a3d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:27.828814 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f94c8-9f31-489f-ab6c-da2eb7e4a3d6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:27.843988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ef0f94c8-9f31-489f-ab6c-da2eb7e4a3d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:27.843988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:27.843988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:27.843988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:27.843988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:27.843988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:27.843988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:27.843988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:27.843988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:27.843988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:27.843988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:27.843988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:27.843988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:27.843988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:27.843988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:27.843988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:27.846052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:27.848185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:27.848185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:27.848185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:27.848185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 276/545] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:27.848185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82707c34-b980-44f8-b612-d5bc7b3248a7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:27.848185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82707c34-b980-44f8-b612-d5bc7b3248a7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:27.848185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82707c34-b980-44f8-b612-d5bc7b3248a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:27.865382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-82707c34-b980-44f8-b612-d5bc7b3248a7 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:27.866555 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-82707c34-b980-44f8-b612-d5bc7b3248a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:27.912199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de39e6-ef77-418c-a89c-d693a486057b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:27.944044 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 277/546] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 10:12:27.944981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82707c34-b980-44f8-b612-d5bc7b3248a7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:27.955863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e792a-1f49-4307-afa1-d3a673eeca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:27.956556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e792a-1f49-4307-afa1-d3a673eeca86 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:27.956828 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e792a-1f49-4307-afa1-d3a673eeca86 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:27.957099 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e792a-1f49-4307-afa1-d3a673eeca86 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:27.958312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e792a-1f49-4307-afa1-d3a673eeca86 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:27.958681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e792a-1f49-4307-afa1-d3a673eeca86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:27.960210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e792a-1f49-4307-afa1-d3a673eeca86 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:27.982119 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 270/547] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Oct 17 10:12:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:27.987811 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e792a-1f49-4307-afa1-d3a673eeca86 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:28.026761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:28.101007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e792a-1f49-4307-afa1-d3a673eeca86 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:28.114416 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:28.140056 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3fb95-fa9e-4cf5-b289-3b6176a1864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:28.140689 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3fb95-fa9e-4cf5-b289-3b6176a1864c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:28.140969 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3fb95-fa9e-4cf5-b289-3b6176a1864c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:28.141241 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3fb95-fa9e-4cf5-b289-3b6176a1864c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:28.152401 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3fb95-fa9e-4cf5-b289-3b6176a1864c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:28.154108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3fb95-fa9e-4cf5-b289-3b6176a1864c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:28.167803 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82707c34-b980-44f8-b612-d5bc7b3248a7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:28.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-75e3fb95-fa9e-4cf5-b289-3b6176a1864c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:28.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:28.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:28.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:28.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:28.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:28.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:28.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:28.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:28.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:28.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:28.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:28.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:28.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:28.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:28.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:28.177388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:28.179472 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:28.179472 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:28.179472 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:28.185670 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 271/548] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:28.191401 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3fb95-fa9e-4cf5-b289-3b6176a1864c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:28.203897 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360ef75-a966-4698-abcc-c50ec66d1785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:28.204532 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360ef75-a966-4698-abcc-c50ec66d1785 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:28.204814 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360ef75-a966-4698-abcc-c50ec66d1785 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:28.205144 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360ef75-a966-4698-abcc-c50ec66d1785 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:28.205732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360ef75-a966-4698-abcc-c50ec66d1785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:28.206037 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360ef75-a966-4698-abcc-c50ec66d1785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:28.207469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360ef75-a966-4698-abcc-c50ec66d1785 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:28.219369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 278/549] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:28.224596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360ef75-a966-4698-abcc-c50ec66d1785 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:28.324551 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:28.331777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360ef75-a966-4698-abcc-c50ec66d1785 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:28.341593 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3fb95-fa9e-4cf5-b289-3b6176a1864c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:28.364490 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:28.372660 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe315e4-4bbc-4b95-8621-10dbaf40d850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:28.373373 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe315e4-4bbc-4b95-8621-10dbaf40d850 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:28.373722 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe315e4-4bbc-4b95-8621-10dbaf40d850 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:28.374062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe315e4-4bbc-4b95-8621-10dbaf40d850 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:28.378106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0327d1-5fde-42cc-b7be-9f001c18ce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:28.378708 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0327d1-5fde-42cc-b7be-9f001c18ce75 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:28.378986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0327d1-5fde-42cc-b7be-9f001c18ce75 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:28.379253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0327d1-5fde-42cc-b7be-9f001c18ce75 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:28.379901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0327d1-5fde-42cc-b7be-9f001c18ce75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:28.380249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0327d1-5fde-42cc-b7be-9f001c18ce75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:28.381618 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0327d1-5fde-42cc-b7be-9f001c18ce75 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:28.383042 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe315e4-4bbc-4b95-8621-10dbaf40d850 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:28.384675 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe315e4-4bbc-4b95-8621-10dbaf40d850 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:28.395098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 272/550] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:28.395896 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0327d1-5fde-42cc-b7be-9f001c18ce75 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:28.396991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-dbe315e4-4bbc-4b95-8621-10dbaf40d850 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 10:12:28.396991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:28.396991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:28.396991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:28.396991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:28.396991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:28.396991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:28.396991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:28.396991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:28.396991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:28.396991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:28.396991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:28.396991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:28.396991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:28.396991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:28.396991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:28.398798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:28.400432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:28.400432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:28.400432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:28.400432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:28.400432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:28.400432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:28.400432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:28.400432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:28.400432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 10:12:28.400432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:28.400432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 279/551] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Oct 17 10:12:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:28.407529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe315e4-4bbc-4b95-8621-10dbaf40d850 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:28.509786 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0327d1-5fde-42cc-b7be-9f001c18ce75 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:28.526840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe315e4-4bbc-4b95-8621-10dbaf40d850 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:28.550687 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5d882-7d17-448a-86e9-b2323747cab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:28.551291 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5d882-7d17-448a-86e9-b2323747cab7 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:28.551765 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5d882-7d17-448a-86e9-b2323747cab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:28.552245 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5d882-7d17-448a-86e9-b2323747cab7 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:28.553136 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5d882-7d17-448a-86e9-b2323747cab7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:28.554726 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5d882-7d17-448a-86e9-b2323747cab7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:28.565302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f36c8-dfb5-483e-82ba-8336c6acb10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:28.565991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f36c8-dfb5-483e-82ba-8336c6acb10c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:28.566343 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f36c8-dfb5-483e-82ba-8336c6acb10c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:28.566685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f36c8-dfb5-483e-82ba-8336c6acb10c None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:28.567628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f36c8-dfb5-483e-82ba-8336c6acb10c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:28.568062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f36c8-dfb5-483e-82ba-8336c6acb10c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:28.569649 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f36c8-dfb5-483e-82ba-8336c6acb10c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:28.574244 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 273/552] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 17 10:12:28 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:28.575901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5d882-7d17-448a-86e9-b2323747cab7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:28.580884 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:28.593625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 280/553] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Oct 17 10:12:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:28.605218 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f36c8-dfb5-483e-82ba-8336c6acb10c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:28.684399 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:28.706330 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5d882-7d17-448a-86e9-b2323747cab7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:28.743877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86066f-85cf-4474-b623-86e9dd249ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:28.744564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86066f-85cf-4474-b623-86e9dd249ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:28.744850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86066f-85cf-4474-b623-86e9dd249ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:28.745123 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86066f-85cf-4474-b623-86e9dd249ae5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:28.753900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86066f-85cf-4474-b623-86e9dd249ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:28.755378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86066f-85cf-4474-b623-86e9dd249ae5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:28.757389 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f36c8-dfb5-483e-82ba-8336c6acb10c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:28.767970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-6b86066f-85cf-4474-b623-86e9dd249ae5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:28.767970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:28.767970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:28.767970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:28.767970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:28.767970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:28.767970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:28.767970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:28.767970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:28.767970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:28.767970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:28.767970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:28.767970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:28.767970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:28.767970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:28.768960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:28.769877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:28.769877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:28.769877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:28.769877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:28.769877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:28.769877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:28.769877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:28.769877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:28.773918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 274/554] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:28.775325 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1124334-e681-4614-9f26-f4b84fc0c2d3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:28.775611 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1124334-e681-4614-9f26-f4b84fc0c2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:28.775886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1124334-e681-4614-9f26-f4b84fc0c2d3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:28.777553 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 275/555] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:28.783337 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1124334-e681-4614-9f26-f4b84fc0c2d3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:28.811725 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14ee87-92cf-4701-b5f7-38cf3f7415ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:28.812410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14ee87-92cf-4701-b5f7-38cf3f7415ed None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:28.812675 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14ee87-92cf-4701-b5f7-38cf3f7415ed None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:28.812945 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14ee87-92cf-4701-b5f7-38cf3f7415ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:28.824686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14ee87-92cf-4701-b5f7-38cf3f7415ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:28.826366 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14ee87-92cf-4701-b5f7-38cf3f7415ed None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:28.843250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9f14ee87-92cf-4701-b5f7-38cf3f7415ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:28.843250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:28.843250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:28.843250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:28.843250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:28.843250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:28.843250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:28.843250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:28.843250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:28.843250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:28.843250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:28.843250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:28.843250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:28.843250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:28.843250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:28.843250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:28.844307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:28.845201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:28.845201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:28.845201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:28.845201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 281/556] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:28.845624 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c1198-3983-4626-b23b-b82d70290754 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:28.845883 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c1198-3983-4626-b23b-b82d70290754 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:28.846149 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c1198-3983-4626-b23b-b82d70290754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:28.863410 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:28.868537 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-329c1198-3983-4626-b23b-b82d70290754 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:28.869798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-329c1198-3983-4626-b23b-b82d70290754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:28.912738 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1124334-e681-4614-9f26-f4b84fc0c2d3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:28.946548 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 282/557] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:28.947714 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c1198-3983-4626-b23b-b82d70290754 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:28.961118 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e00a8-e30f-4607-a67c-42d47de27cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:28.961734 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e00a8-e30f-4607-a67c-42d47de27cdc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:28.962010 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e00a8-e30f-4607-a67c-42d47de27cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:28.962281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e00a8-e30f-4607-a67c-42d47de27cdc None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:28.962976 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e00a8-e30f-4607-a67c-42d47de27cdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:28.963282 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e00a8-e30f-4607-a67c-42d47de27cdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:28.966706 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e00a8-e30f-4607-a67c-42d47de27cdc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:28.992931 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 276/558] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:29.000410 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e00a8-e30f-4607-a67c-42d47de27cdc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:29.010483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:29.112741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e00a8-e30f-4607-a67c-42d47de27cdc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:29.140322 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:29.160575 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3470a3-d311-4254-9064-3a5ef055d851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:29.161731 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3470a3-d311-4254-9064-3a5ef055d851 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:29.162009 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3470a3-d311-4254-9064-3a5ef055d851 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:29.162283 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3470a3-d311-4254-9064-3a5ef055d851 None admin] PATH_INFO: `/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/e2969c098a154afcba382c707122598d/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:29.165022 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3470a3-d311-4254-9064-3a5ef055d851 None admin] RBAC: Authorizing `identity:create_grant(project_id=07b2dd5de0274a6896d407b0ff22ff54, user_id=e2969c098a154afcba382c707122598d, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:29.166461 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3470a3-d311-4254-9064-3a5ef055d851 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:29.177432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c1198-3983-4626-b23b-b82d70290754 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:29.193098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 277/559] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:12:28 2022] PUT /identity/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/e2969c098a154afcba382c707122598d/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:12:29.237923 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b0d0b-1f5e-4cdd-8a53-5856e0b6b62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:29.238464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b0d0b-1f5e-4cdd-8a53-5856e0b6b62e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:29.238744 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b0d0b-1f5e-4cdd-8a53-5856e0b6b62e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:29.239020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b0d0b-1f5e-4cdd-8a53-5856e0b6b62e None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:29.239680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b0d0b-1f5e-4cdd-8a53-5856e0b6b62e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:29.240050 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b0d0b-1f5e-4cdd-8a53-5856e0b6b62e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:29.241505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b0d0b-1f5e-4cdd-8a53-5856e0b6b62e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:29.259153 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 283/560] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:29.264773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3470a3-d311-4254-9064-3a5ef055d851 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:29.374506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b0d0b-1f5e-4cdd-8a53-5856e0b6b62e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:29.399561 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3470a3-d311-4254-9064-3a5ef055d851 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:29.439267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456548aa-e4f7-4d5a-b5fb-47f9bc7164aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:29.439946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456548aa-e4f7-4d5a-b5fb-47f9bc7164aa None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:29.440235 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456548aa-e4f7-4d5a-b5fb-47f9bc7164aa None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:29.440508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456548aa-e4f7-4d5a-b5fb-47f9bc7164aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:29.449104 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456548aa-e4f7-4d5a-b5fb-47f9bc7164aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:29.450762 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456548aa-e4f7-4d5a-b5fb-47f9bc7164aa None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:29.462942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-456548aa-e4f7-4d5a-b5fb-47f9bc7164aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:29.462942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:29.462942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:29.462942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:29.462942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:29.462942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:29.462942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:29.462942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:29.462942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:29.462942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:29.462942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:29.462942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:29.462942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:29.462942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:29.462942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:29.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:29.464823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:29.464823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:29.464823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:29.464823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:29.464823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:29.464823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:29.464823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:29.464823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:29.464823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 278/561] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:29.470688 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456548aa-e4f7-4d5a-b5fb-47f9bc7164aa None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:29.508353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:29.524385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b0d0b-1f5e-4cdd-8a53-5856e0b6b62e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:29.553714 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:29.593701 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc2104-0693-4813-a360-cc75efd56f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:29.594339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2104-0693-4813-a360-cc75efd56f37 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:29.594617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2104-0693-4813-a360-cc75efd56f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:29.594889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2104-0693-4813-a360-cc75efd56f37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:29.618241 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc2104-0693-4813-a360-cc75efd56f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:29.629840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c7dc2104-0693-4813-a360-cc75efd56f37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:12:29.629840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:29.629840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:29.629840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:29.629840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:29.629840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:29.629840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:29.629840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:29.629840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:29.629840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:29.629840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:29.629840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:29.629840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:29.629840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:29.629840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:29.629840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:29.632073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:29.632073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:29.632073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:29.632073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:29.632073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:29.632073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:29.632073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:29.632073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:29.632073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:29.632073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:29.632073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:29.632073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:29.632073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:29.632073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:29.632073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:29.632073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:29.634223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:29.634223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:29.634223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:29.634223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:29.634223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:29.634223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:29.634223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:29.634223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:29.634223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:29.634223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:29.634223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:12:29.634223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:29.638686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 284/562] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:12:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:29.642525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc2104-0693-4813-a360-cc75efd56f37 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:29.672762 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456548aa-e4f7-4d5a-b5fb-47f9bc7164aa None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:29.745990 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61f8e3-aa26-4278-b7a6-5dcafd4115fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:29.746802 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61f8e3-aa26-4278-b7a6-5dcafd4115fa None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:29.746962 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61f8e3-aa26-4278-b7a6-5dcafd4115fa None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:29.747172 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61f8e3-aa26-4278-b7a6-5dcafd4115fa None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:29.747842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61f8e3-aa26-4278-b7a6-5dcafd4115fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:29.748165 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61f8e3-aa26-4278-b7a6-5dcafd4115fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:29.750445 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61f8e3-aa26-4278-b7a6-5dcafd4115fa None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:29.776815 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 279/563] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:29.783990 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61f8e3-aa26-4278-b7a6-5dcafd4115fa None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:29.811463 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc2104-0693-4813-a360-cc75efd56f37 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:29.872457 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641d323-0819-4143-b81e-3860a804cf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:29.873246 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641d323-0819-4143-b81e-3860a804cf50 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:29.873416 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641d323-0819-4143-b81e-3860a804cf50 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:29.873601 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641d323-0819-4143-b81e-3860a804cf50 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:29.874286 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641d323-0819-4143-b81e-3860a804cf50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:29.874577 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641d323-0819-4143-b81e-3860a804cf50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:29.875981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641d323-0819-4143-b81e-3860a804cf50 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:29.894789 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 285/564] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:12:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:29.901408 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641d323-0819-4143-b81e-3860a804cf50 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:29.932063 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:29.963790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:29.966915 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61f8e3-aa26-4278-b7a6-5dcafd4115fa None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:30.005935 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a9b1a-96b0-4d86-8ae7-4857b3cf57e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:30.006601 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a9b1a-96b0-4d86-8ae7-4857b3cf57e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:30.006882 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a9b1a-96b0-4d86-8ae7-4857b3cf57e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:30.007158 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a9b1a-96b0-4d86-8ae7-4857b3cf57e3 None admin] PATH_INFO: `/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/fe49f95fd5a446f7a57beb62d854d3a7/roles/365b9c4c3245430e872f4aa988da3beb` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:30.024107 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a9b1a-96b0-4d86-8ae7-4857b3cf57e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=07b2dd5de0274a6896d407b0ff22ff54, user_id=fe49f95fd5a446f7a57beb62d854d3a7, role_id=365b9c4c3245430e872f4aa988da3beb)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:30.025645 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a9b1a-96b0-4d86-8ae7-4857b3cf57e3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:30.048106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 280/565] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:12:29 2022] PUT /identity/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/fe49f95fd5a446f7a57beb62d854d3a7/roles/365b9c4c3245430e872f4aa988da3beb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:12:30.050930 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5d85e-eb61-4822-b169-4f530451e4ed None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:30.051796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5d85e-eb61-4822-b169-4f530451e4ed None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:30.055423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5d85e-eb61-4822-b169-4f530451e4ed None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:30.057244 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 281/566] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:30.063726 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d546a-2d7d-4179-b122-ed9331203e5b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:30.064591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d546a-2d7d-4179-b122-ed9331203e5b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:30.066432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d546a-2d7d-4179-b122-ed9331203e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:30.096197 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641d323-0819-4143-b81e-3860a804cf50 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:30.113557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a29d546a-2d7d-4179-b122-ed9331203e5b None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:30.114857 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a29d546a-2d7d-4179-b122-ed9331203e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:30.180970 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86593bfa-ae40-4d14-af8c-ce1ee393254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:30.181623 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86593bfa-ae40-4d14-af8c-ce1ee393254f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:30.181903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86593bfa-ae40-4d14-af8c-ce1ee393254f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:30.182176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86593bfa-ae40-4d14-af8c-ce1ee393254f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:30.210516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86593bfa-ae40-4d14-af8c-ce1ee393254f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:30.212064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86593bfa-ae40-4d14-af8c-ce1ee393254f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:30.235694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-86593bfa-ae40-4d14-af8c-ce1ee393254f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:30.235694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:30.235694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:30.235694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:30.235694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:30.235694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:30.235694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:30.235694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:30.235694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:30.235694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:30.235694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:30.235694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:30.235694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:30.235694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:30.235694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:30.235694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:30.236746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:30.237924 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:30.237924 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:30.237924 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:30.237924 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 286/567] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:30.245340 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86593bfa-ae40-4d14-af8c-ce1ee393254f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:30.260403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 282/568] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 10:12:30.320103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:30.357680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86593bfa-ae40-4d14-af8c-ce1ee393254f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:30.402671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222d79f-eee8-4ea1-9a3a-094ffadbbd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:30.403699 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222d79f-eee8-4ea1-9a3a-094ffadbbd00 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:30.404199 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222d79f-eee8-4ea1-9a3a-094ffadbbd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:30.404707 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222d79f-eee8-4ea1-9a3a-094ffadbbd00 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:30.405549 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222d79f-eee8-4ea1-9a3a-094ffadbbd00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:30.406047 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222d79f-eee8-4ea1-9a3a-094ffadbbd00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:30.407614 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222d79f-eee8-4ea1-9a3a-094ffadbbd00 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:30.423507 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 287/569] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:30.429459 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d546a-2d7d-4179-b122-ed9331203e5b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:30.519982 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:30.544977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d546a-2d7d-4179-b122-ed9331203e5b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:30.586553 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2a161-b691-431d-9fcf-8e8a3e11a29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:30.587528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2a161-b691-431d-9fcf-8e8a3e11a29d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:30.588048 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2a161-b691-431d-9fcf-8e8a3e11a29d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:30.588521 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2a161-b691-431d-9fcf-8e8a3e11a29d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:30.597773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2a161-b691-431d-9fcf-8e8a3e11a29d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:30.599230 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2a161-b691-431d-9fcf-8e8a3e11a29d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:30.616173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222d79f-eee8-4ea1-9a3a-094ffadbbd00 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:30.616681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-7df2a161-b691-431d-9fcf-8e8a3e11a29d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 10:12:30.616681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:30.616681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:30.616681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:30.616681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:30.616681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:30.616681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:30.616681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:30.616681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:30.616681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:30.616681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:30.616681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:30.616681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:30.616681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:30.616681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:30.616681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:30.617668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:30.618986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:30.618986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:30.618986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:30.618986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:30.618986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:30.618986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:30.618986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:30.618986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:30.618986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 10:12:30.618986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:30.618986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 283/570] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Oct 17 10:12:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:30.626641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2a161-b691-431d-9fcf-8e8a3e11a29d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:30.775423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2a161-b691-431d-9fcf-8e8a3e11a29d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:30.782122 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222d79f-eee8-4ea1-9a3a-094ffadbbd00 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:30.812519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464839e1-b28f-4b1d-a770-c8a4209ed559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:30.813584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464839e1-b28f-4b1d-a770-c8a4209ed559 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:30.814090 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464839e1-b28f-4b1d-a770-c8a4209ed559 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:30.814564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464839e1-b28f-4b1d-a770-c8a4209ed559 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:30.815478 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464839e1-b28f-4b1d-a770-c8a4209ed559 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:30.816009 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464839e1-b28f-4b1d-a770-c8a4209ed559 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:30.817640 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464839e1-b28f-4b1d-a770-c8a4209ed559 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:30.827679 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:30.838171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 284/571] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Oct 17 10:12:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:30.844492 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464839e1-b28f-4b1d-a770-c8a4209ed559 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:30.853439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:30.877549 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78f62d-ddbd-41b8-bc5c-4d960ba71837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:30.879487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78f62d-ddbd-41b8-bc5c-4d960ba71837 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:30.880102 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78f62d-ddbd-41b8-bc5c-4d960ba71837 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:30.881547 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78f62d-ddbd-41b8-bc5c-4d960ba71837 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:30.882306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78f62d-ddbd-41b8-bc5c-4d960ba71837 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:30.884506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78f62d-ddbd-41b8-bc5c-4d960ba71837 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ae78f62d-ddbd-41b8-bc5c-4d960ba71837 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:30.901535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:30.902764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:30.902764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:30.902764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:30.902764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:30.902764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:30.902764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:30.902764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:30.902764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:30.902764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:30.902764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:30.902764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:30.902764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:30.902764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:30.902764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:30.902764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:30.902764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:30.904375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:30.904375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:30.904375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:30.904375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:30.904375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:30.904375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:30.904375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:30.904375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:30.904375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:30.904375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:30.904375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:30.904375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:30.904375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 10:12:30.904375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:30.906788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 288/572] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Oct 17 10:12:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:30.912623 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78f62d-ddbd-41b8-bc5c-4d960ba71837 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:31.041967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464839e1-b28f-4b1d-a770-c8a4209ed559 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:31.112641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67940e1c-0d63-4404-b95d-317ccb3335f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:31.113162 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67940e1c-0d63-4404-b95d-317ccb3335f8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:31.113440 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67940e1c-0d63-4404-b95d-317ccb3335f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:31.113706 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67940e1c-0d63-4404-b95d-317ccb3335f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:31.116490 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78f62d-ddbd-41b8-bc5c-4d960ba71837 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:31.155858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080e770-bfe2-490c-b1cc-be79b0c57cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:31.156834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080e770-bfe2-490c-b1cc-be79b0c57cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:31.157357 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080e770-bfe2-490c-b1cc-be79b0c57cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:31.157832 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080e770-bfe2-490c-b1cc-be79b0c57cb1 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:31.158659 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080e770-bfe2-490c-b1cc-be79b0c57cb1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:31.159160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080e770-bfe2-490c-b1cc-be79b0c57cb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:31.160783 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080e770-bfe2-490c-b1cc-be79b0c57cb1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:31.171854 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 289/573] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Oct 17 10:12:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:31.171854 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5f5c0-5909-4ca5-8f55-124b8b7196c1 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:31.171854 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5f5c0-5909-4ca5-8f55-124b8b7196c1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:31.171854 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5f5c0-5909-4ca5-8f55-124b8b7196c1 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:31.171854 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 290/574] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:31.173742 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5f5c0-5909-4ca5-8f55-124b8b7196c1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:31.201460 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:31.207757 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67940e1c-0d63-4404-b95d-317ccb3335f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:31.209702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67940e1c-0d63-4404-b95d-317ccb3335f8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:31.247067 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:31.295701 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5f5c0-5909-4ca5-8f55-124b8b7196c1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:31.330640 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab149a-6265-4097-8ab3-12c32b2dca62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:31.331588 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab149a-6265-4097-8ab3-12c32b2dca62 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:31.332123 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab149a-6265-4097-8ab3-12c32b2dca62 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:31.332613 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab149a-6265-4097-8ab3-12c32b2dca62 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:31.333443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab149a-6265-4097-8ab3-12c32b2dca62 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:31.333771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 285/575] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:12:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 10:12:31.335073 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d1cfe-c059-4ff6-aa63-e31d7fd7b361 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:31.335359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d1cfe-c059-4ff6-aa63-e31d7fd7b361 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:31.335631 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d1cfe-c059-4ff6-aa63-e31d7fd7b361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:31.335876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab149a-6265-4097-8ab3-12c32b2dca62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:31.340949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab149a-6265-4097-8ab3-12c32b2dca62 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:31.348516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 291/576] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Oct 17 10:12:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:31.349334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab149a-6265-4097-8ab3-12c32b2dca62 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:31.361714 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-eb4d1cfe-c059-4ff6-aa63-e31d7fd7b361 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:31.363251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-eb4d1cfe-c059-4ff6-aa63-e31d7fd7b361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:31.452050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 286/577] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:31.453304 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d1cfe-c059-4ff6-aa63-e31d7fd7b361 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:31.502395 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab149a-6265-4097-8ab3-12c32b2dca62 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:31.504317 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:31.544638 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:31.586128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f769f78-86b9-4f28-bbc7-9d93a1243d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:31.586937 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f769f78-86b9-4f28-bbc7-9d93a1243d83 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:31.587356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f769f78-86b9-4f28-bbc7-9d93a1243d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:31.587702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f769f78-86b9-4f28-bbc7-9d93a1243d83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:31.590686 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d1cfe-c059-4ff6-aa63-e31d7fd7b361 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:31.614302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f769f78-86b9-4f28-bbc7-9d93a1243d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:31.615856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f769f78-86b9-4f28-bbc7-9d93a1243d83 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:31.632878 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9db089-36b5-4d77-8377-bc8bd5891743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:31.633606 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9db089-36b5-4d77-8377-bc8bd5891743 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:31.633955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9db089-36b5-4d77-8377-bc8bd5891743 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:31.634294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9db089-36b5-4d77-8377-bc8bd5891743 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:31.635061 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9db089-36b5-4d77-8377-bc8bd5891743 None admin] RBAC: Adding query filter params (interface=public, service_id=8fb9c04df9ce4815a848eb60c8301a0a, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:31.635436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9db089-36b5-4d77-8377-bc8bd5891743 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:31.636882 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9db089-36b5-4d77-8377-bc8bd5891743 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:31.639749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7f769f78-86b9-4f28-bbc7-9d93a1243d83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:31.639749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:31.639749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:31.639749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:31.639749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:31.639749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:31.639749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:31.639749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:31.639749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:31.639749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:31.639749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:31.639749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:31.639749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:31.639749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:31.639749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:31.639749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:31.640971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:31.642078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:31.642078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:31.642078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:31.644197 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 292/578] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:31.645590 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512b774-9a4c-47c5-be63-bfc1ac442b40 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:31.646045 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512b774-9a4c-47c5-be63-bfc1ac442b40 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:31.646452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512b774-9a4c-47c5-be63-bfc1ac442b40 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:31.652362 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 293/579] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:31.653810 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512b774-9a4c-47c5-be63-bfc1ac442b40 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:31.654951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 287/580] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Oct 17 10:12:31 2022] GET /identity/v3/endpoints?service_id=8fb9c04df9ce4815a848eb60c8301a0a&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:31.662033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5b85b-fbd0-4136-8132-1d277d4aa797 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:31.662419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5b85b-fbd0-4136-8132-1d277d4aa797 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:31.662768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5b85b-fbd0-4136-8132-1d277d4aa797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:31.683539 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-04e5b85b-fbd0-4136-8132-1d277d4aa797 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:31.685628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-04e5b85b-fbd0-4136-8132-1d277d4aa797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:31.771954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 288/581] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:31.771954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5b85b-fbd0-4136-8132-1d277d4aa797 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:31.803313 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:31.811199 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512b774-9a4c-47c5-be63-bfc1ac442b40 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:31.852983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afea1b-eeef-48a8-a921-895608e4eb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:31.853840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afea1b-eeef-48a8-a921-895608e4eb8f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:31.854169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afea1b-eeef-48a8-a921-895608e4eb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:31.854445 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afea1b-eeef-48a8-a921-895608e4eb8f None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:31.855090 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afea1b-eeef-48a8-a921-895608e4eb8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:31.855644 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afea1b-eeef-48a8-a921-895608e4eb8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:31.857423 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afea1b-eeef-48a8-a921-895608e4eb8f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:31.876021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 294/582] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:31.877090 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afea1b-eeef-48a8-a921-895608e4eb8f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:31.902792 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5b85b-fbd0-4136-8132-1d277d4aa797 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:31.909086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:31.941278 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800b933-b9f9-46ab-8a25-a64849e1e02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:31.941886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800b933-b9f9-46ab-8a25-a64849e1e02b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:31.942165 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800b933-b9f9-46ab-8a25-a64849e1e02b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:31.942493 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800b933-b9f9-46ab-8a25-a64849e1e02b None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:31.943105 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800b933-b9f9-46ab-8a25-a64849e1e02b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:31.944706 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800b933-b9f9-46ab-8a25-a64849e1e02b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:31.956267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 289/583] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 17 10:12:31 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:31.957272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800b933-b9f9-46ab-8a25-a64849e1e02b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:31.986675 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afea1b-eeef-48a8-a921-895608e4eb8f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:32.045136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb01e7d-17ae-410b-94c4-31496dde7a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:32.046101 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb01e7d-17ae-410b-94c4-31496dde7a0a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:32.046611 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb01e7d-17ae-410b-94c4-31496dde7a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:32.047058 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb01e7d-17ae-410b-94c4-31496dde7a0a None admin] PATH_INFO: `/v3/services/network` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:32.047837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb01e7d-17ae-410b-94c4-31496dde7a0a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:32.050003 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb01e7d-17ae-410b-94c4-31496dde7a0a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8eb01e7d-17ae-410b-94c4-31496dde7a0a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:32.073222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:32.074685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:32.074685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:32.074685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:32.074685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:32.074685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:32.074685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:32.074685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:32.074685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:32.074685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:32.074685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:32.074685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:32.074685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:32.074685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:32.074685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:32.074685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:32.074685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:32.081059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:32.081059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:32.081059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:32.081059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:32.081059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:32.081059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:32.081059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:32.081059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:32.081059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:32.081059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:32.081059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:32.081059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:32.081059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 10:12:32.081059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:32.081059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 295/584] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:31 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:32.083815 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb01e7d-17ae-410b-94c4-31496dde7a0a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:32.131477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:32.150715 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800b933-b9f9-46ab-8a25-a64849e1e02b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:32.192276 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:32.193786 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13463a8a-6f61-4058-b897-e7cc1af6b6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:32.194694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13463a8a-6f61-4058-b897-e7cc1af6b6da None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:32.195194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13463a8a-6f61-4058-b897-e7cc1af6b6da None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:32.195689 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13463a8a-6f61-4058-b897-e7cc1af6b6da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:32.200125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb01e7d-17ae-410b-94c4-31496dde7a0a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:32.205557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13463a8a-6f61-4058-b897-e7cc1af6b6da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:32.206231 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13463a8a-6f61-4058-b897-e7cc1af6b6da None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:32.221095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-13463a8a-6f61-4058-b897-e7cc1af6b6da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:32.221095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:32.221095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:32.221095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:32.221095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:32.221095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:32.221095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:32.221095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:32.221095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:32.221095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:32.221095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:32.221095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:32.221095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:32.221095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:32.221095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:32.222112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:32.223045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:32.223045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:32.223045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:32.223045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:32.223045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:32.223045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:32.223045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:32.223045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:32.223045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 290/585] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:32.224082 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13463a8a-6f61-4058-b897-e7cc1af6b6da None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:32.244382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195aaac3-a0c1-4161-93d8-893c39036131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:32.245078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aaac3-a0c1-4161-93d8-893c39036131 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:32.245365 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aaac3-a0c1-4161-93d8-893c39036131 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:32.246081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aaac3-a0c1-4161-93d8-893c39036131 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:32.256653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195aaac3-a0c1-4161-93d8-893c39036131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:32.262169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-195aaac3-a0c1-4161-93d8-893c39036131 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:12:32.262169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:32.262169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:32.262169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:32.262169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:32.262169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:32.262169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:32.262169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:32.262169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:32.262169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:32.262169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:32.262169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:32.262169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:32.262169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:32.262169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:32.262169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:32.263213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:32.263213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:32.263213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:32.263213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:32.263213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:32.263213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:32.263213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:32.263213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:32.263213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:32.263213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:32.263213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:32.263213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:32.263213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:32.263213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:32.263213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:32.263213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:32.264076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:32.264076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:32.264076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:32.264076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:32.264076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:32.264076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:32.264076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:32.264076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:32.264076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:32.264076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:32.264076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:12:32.264076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:32.264076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 296/586] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:12:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:32.265035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195aaac3-a0c1-4161-93d8-893c39036131 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:32.345769 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13463a8a-6f61-4058-b897-e7cc1af6b6da None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:32.379156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195aaac3-a0c1-4161-93d8-893c39036131 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:32.386636 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37456062-6a41-40c7-9c02-0952fe4a50c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:32.387179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37456062-6a41-40c7-9c02-0952fe4a50c0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:32.387577 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37456062-6a41-40c7-9c02-0952fe4a50c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:32.387919 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37456062-6a41-40c7-9c02-0952fe4a50c0 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:32.388670 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37456062-6a41-40c7-9c02-0952fe4a50c0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:32.388984 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37456062-6a41-40c7-9c02-0952fe4a50c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:32.390528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37456062-6a41-40c7-9c02-0952fe4a50c0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:32.401867 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 291/587] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 17 10:12:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:32.403012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37456062-6a41-40c7-9c02-0952fe4a50c0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:32.418896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232ac7f-9e6b-49c8-a91d-3e7e0b33a94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:32.419579 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232ac7f-9e6b-49c8-a91d-3e7e0b33a94c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:32.419756 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:32.419914 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232ac7f-9e6b-49c8-a91d-3e7e0b33a94c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:32.420158 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232ac7f-9e6b-49c8-a91d-3e7e0b33a94c None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:32.420852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232ac7f-9e6b-49c8-a91d-3e7e0b33a94c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:32.421155 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232ac7f-9e6b-49c8-a91d-3e7e0b33a94c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:32.422577 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232ac7f-9e6b-49c8-a91d-3e7e0b33a94c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:32.437852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 297/588] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:32.438674 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232ac7f-9e6b-49c8-a91d-3e7e0b33a94c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:32.462838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:32.526291 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37456062-6a41-40c7-9c02-0952fe4a50c0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:32.560606 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7becc1-e70f-410b-b621-7a716f336ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:32.561215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7becc1-e70f-410b-b621-7a716f336ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:32.561493 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7becc1-e70f-410b-b621-7a716f336ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:32.561995 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7becc1-e70f-410b-b621-7a716f336ef5 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:32.562421 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7becc1-e70f-410b-b621-7a716f336ef5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:32.562790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7becc1-e70f-410b-b621-7a716f336ef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:32.564312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7becc1-e70f-410b-b621-7a716f336ef5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:32.568219 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232ac7f-9e6b-49c8-a91d-3e7e0b33a94c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:32.578151 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 292/589] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:12:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:32.578151 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7becc1-e70f-410b-b621-7a716f336ef5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:32.602569 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c94656-eee9-459b-8fad-f69f019e683d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:32.603177 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c94656-eee9-459b-8fad-f69f019e683d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:32.603454 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c94656-eee9-459b-8fad-f69f019e683d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:32.603723 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c94656-eee9-459b-8fad-f69f019e683d None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:32.604378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c94656-eee9-459b-8fad-f69f019e683d None admin] RBAC: Adding query filter params (type=network) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:32.604678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c94656-eee9-459b-8fad-f69f019e683d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:32.606293 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c94656-eee9-459b-8fad-f69f019e683d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:32.615827 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 298/590] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 17 10:12:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:32.615827 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4e79e-0e2c-4530-af9c-940cd073f25b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:32.615827 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4e79e-0e2c-4530-af9c-940cd073f25b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:32.615827 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4e79e-0e2c-4530-af9c-940cd073f25b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:32.615827 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 299/591] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:32.615827 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4e79e-0e2c-4530-af9c-940cd073f25b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:32.663152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:32.695565 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7becc1-e70f-410b-b621-7a716f336ef5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:32.698412 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:32.721310 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4e79e-0e2c-4530-af9c-940cd073f25b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:32.734452 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55a54a-056d-4039-8566-4cd97e1be1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:32.735061 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55a54a-056d-4039-8566-4cd97e1be1ef None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:32.735342 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55a54a-056d-4039-8566-4cd97e1be1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:32.735617 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55a54a-056d-4039-8566-4cd97e1be1ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:32.736380 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55a54a-056d-4039-8566-4cd97e1be1ef None admin] RBAC: Adding query filter params (role.id=5e3dfffec8aa470fab9232cc439aec74, scope.project.id=07b2dd5de0274a6896d407b0ff22ff54, user.id=a80cc7ec3d2d49f88c81403f918a6900) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:32.736699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55a54a-056d-4039-8566-4cd97e1be1ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:32.738114 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55a54a-056d-4039-8566-4cd97e1be1ef None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:32.746336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 293/592] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:12:32 2022] GET /identity/v3/role_assignments?user.id=a80cc7ec3d2d49f88c81403f918a6900&scope.project.id=07b2dd5de0274a6896d407b0ff22ff54&role.id=5e3dfffec8aa470fab9232cc439aec74 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:32.747100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55a54a-056d-4039-8566-4cd97e1be1ef None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:32.789930 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e7c4d-a7cb-403a-a622-680f8ad158e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:32.790574 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e7c4d-a7cb-403a-a622-680f8ad158e1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:32.790851 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e7c4d-a7cb-403a-a622-680f8ad158e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:32.791120 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e7c4d-a7cb-403a-a622-680f8ad158e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:32.802929 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e7c4d-a7cb-403a-a622-680f8ad158e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:32.804572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e7c4d-a7cb-403a-a622-680f8ad158e1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:32.821828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4a0e7c4d-a7cb-403a-a622-680f8ad158e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:32.821828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:32.821828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:32.821828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:32.821828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:32.821828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:32.821828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:32.821828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:32.821828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:32.821828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:32.821828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:32.821828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:32.821828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:32.821828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:32.821828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:32.821828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:32.822834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:32.823708 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:32.823708 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:32.823708 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:32.823708 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 300/593] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:32.828881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5303861-5351-440c-ae5c-de2f926842ed None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:32.828881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5303861-5351-440c-ae5c-de2f926842ed None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:32.828881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5303861-5351-440c-ae5c-de2f926842ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:32.846451 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d5303861-5351-440c-ae5c-de2f926842ed None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:32.847677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d5303861-5351-440c-ae5c-de2f926842ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:32.899864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55a54a-056d-4039-8566-4cd97e1be1ef None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:32.930797 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 301/594] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:32.937986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5303861-5351-440c-ae5c-de2f926842ed None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:32.954416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2c602-4998-4df3-b7a7-ecec1697ae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:32.955025 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2c602-4998-4df3-b7a7-ecec1697ae31 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:32.955306 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2c602-4998-4df3-b7a7-ecec1697ae31 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:32.955581 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2c602-4998-4df3-b7a7-ecec1697ae31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:32.956611 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2c602-4998-4df3-b7a7-ecec1697ae31 None admin] RBAC: Adding query filter params (interface=public, service_id=9aa05a11c73d4948948b6add4f68c130, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:32.956922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2c602-4998-4df3-b7a7-ecec1697ae31 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:32.958546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2c602-4998-4df3-b7a7-ecec1697ae31 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:32.961536 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:32.966995 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 294/595] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Oct 17 10:12:32 2022] GET /identity/v3/endpoints?service_id=9aa05a11c73d4948948b6add4f68c130&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:32.973722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2c602-4998-4df3-b7a7-ecec1697ae31 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:33.013602 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:33.070240 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5303861-5351-440c-ae5c-de2f926842ed None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:33.099183 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2c602-4998-4df3-b7a7-ecec1697ae31 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:33.111265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ae785-8f4b-4ee3-a15c-fba15eee1ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:33.112279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ae785-8f4b-4ee3-a15c-fba15eee1ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:33.112774 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ae785-8f4b-4ee3-a15c-fba15eee1ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:33.113312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ae785-8f4b-4ee3-a15c-fba15eee1ed6 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:33.114165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ae785-8f4b-4ee3-a15c-fba15eee1ed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:33.114727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ae785-8f4b-4ee3-a15c-fba15eee1ed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:33.116540 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ae785-8f4b-4ee3-a15c-fba15eee1ed6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:33.129459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 302/596] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:33.135187 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ae785-8f4b-4ee3-a15c-fba15eee1ed6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:33.138554 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dba84-a982-4d6e-8c08-59cbe1f71cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:33.139958 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dba84-a982-4d6e-8c08-59cbe1f71cba None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:33.140251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dba84-a982-4d6e-8c08-59cbe1f71cba None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:33.140530 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dba84-a982-4d6e-8c08-59cbe1f71cba None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:33.141137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dba84-a982-4d6e-8c08-59cbe1f71cba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:33.142492 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dba84-a982-4d6e-8c08-59cbe1f71cba None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:33.151968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 295/597] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 17 10:12:32 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:33.228036 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dba84-a982-4d6e-8c08-59cbe1f71cba None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:33.251868 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ae785-8f4b-4ee3-a15c-fba15eee1ed6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:33.280308 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:33.298008 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3429f-2843-4ffc-9a37-16e4d10005d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:33.298824 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3429f-2843-4ffc-9a37-16e4d10005d1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:33.298953 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:33.299107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3429f-2843-4ffc-9a37-16e4d10005d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:33.299384 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3429f-2843-4ffc-9a37-16e4d10005d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:33.310244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3429f-2843-4ffc-9a37-16e4d10005d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:33.312405 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3429f-2843-4ffc-9a37-16e4d10005d1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:33.327551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-03a3429f-2843-4ffc-9a37-16e4d10005d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 17 10:12:33.327551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:33.327551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:33.327551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:33.327551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:33.327551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:33.327551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:33.327551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:33.327551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:33.327551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:33.327551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:33.327551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:33.327551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:33.327551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:33.327551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:33.327551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:33.328781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:33.329919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:33.329919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:33.329919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:33.329919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:33.329919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:33.329919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:33.329919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:33.329919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:33.329919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 17 10:12:33.329919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:33.329919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 303/598] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:12:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:33.334477 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3429f-2843-4ffc-9a37-16e4d10005d1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:33.339004 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dba84-a982-4d6e-8c08-59cbe1f71cba None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:33.416315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1a57f-3895-496f-bc1d-9ec4048ad364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:33.417024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1a57f-3895-496f-bc1d-9ec4048ad364 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:33.417307 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1a57f-3895-496f-bc1d-9ec4048ad364 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:33.417584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1a57f-3895-496f-bc1d-9ec4048ad364 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:33.447234 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1a57f-3895-496f-bc1d-9ec4048ad364 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:33.451781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3429f-2843-4ffc-9a37-16e4d10005d1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:33.454541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-aeb1a57f-3895-496f-bc1d-9ec4048ad364 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:33.454541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:33.454541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:33.454541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:33.454541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:33.454541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:33.454541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:33.454541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:33.454541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:33.454541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:33.454541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:33.454541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:33.454541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:33.454541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:33.454541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:33.454541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:33.456669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:33.456669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:33.456669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:33.456669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:33.456669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:33.456669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:33.456669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:33.456669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:33.456669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:33.456669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:33.456669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:33.456669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:33.456669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:33.456669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:33.456669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:33.456669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:33.457782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:33.457782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:33.457782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:33.457782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:33.457782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:33.457782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:33.457782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:33.457782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:33.457782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:33.457782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:33.457782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:12:33.457782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:33.457782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 296/599] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 17 10:12:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:33.461700 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1a57f-3895-496f-bc1d-9ec4048ad364 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:33.491314 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6efd89-1ebe-411b-8a38-2b4c52b1fe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:33.491852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6efd89-1ebe-411b-8a38-2b4c52b1fe3c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:33.492325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6efd89-1ebe-411b-8a38-2b4c52b1fe3c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:33.492601 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6efd89-1ebe-411b-8a38-2b4c52b1fe3c None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:33.493714 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6efd89-1ebe-411b-8a38-2b4c52b1fe3c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:33.494077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6efd89-1ebe-411b-8a38-2b4c52b1fe3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:33.495968 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6efd89-1ebe-411b-8a38-2b4c52b1fe3c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:33.523099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 304/600] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Oct 17 10:12:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:33.531514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6efd89-1ebe-411b-8a38-2b4c52b1fe3c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:33.603888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:33.630878 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1a57f-3895-496f-bc1d-9ec4048ad364 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:33.669594 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:33.682119 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fe2a3-43a2-43b7-9482-bce76c243956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:33.682772 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fe2a3-43a2-43b7-9482-bce76c243956 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:33.683051 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fe2a3-43a2-43b7-9482-bce76c243956 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:33.683376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fe2a3-43a2-43b7-9482-bce76c243956 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:33.684078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fe2a3-43a2-43b7-9482-bce76c243956 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:33.684383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fe2a3-43a2-43b7-9482-bce76c243956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:33.685931 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fe2a3-43a2-43b7-9482-bce76c243956 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:33.694790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 297/601] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 17 10:12:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:33.701409 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fe2a3-43a2-43b7-9482-bce76c243956 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:33.732603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6efd89-1ebe-411b-8a38-2b4c52b1fe3c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:33.791390 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860e1d9-3fd8-463e-9cae-2473302429d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:33.791938 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860e1d9-3fd8-463e-9cae-2473302429d4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:33.792221 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860e1d9-3fd8-463e-9cae-2473302429d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:33.792495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860e1d9-3fd8-463e-9cae-2473302429d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:33.829258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fe2a3-43a2-43b7-9482-bce76c243956 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:33.866744 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec28643-b42b-4d89-8e0b-be0e2dad5bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:33.867378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec28643-b42b-4d89-8e0b-be0e2dad5bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:33.867752 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec28643-b42b-4d89-8e0b-be0e2dad5bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:33.868065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec28643-b42b-4d89-8e0b-be0e2dad5bc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:33.880284 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec28643-b42b-4d89-8e0b-be0e2dad5bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:33.881805 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec28643-b42b-4d89-8e0b-be0e2dad5bc2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:33.897843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-1ec28643-b42b-4d89-8e0b-be0e2dad5bc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:33.897843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:33.897843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:33.897843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:33.897843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:33.897843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:33.897843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:33.897843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:33.897843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:33.897843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:33.897843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:33.897843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:33.897843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:33.897843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:33.897843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:33.897843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:33.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:33.905572 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:33.905572 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:33.905572 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:33.905572 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 298/602] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:33.909972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec28643-b42b-4d89-8e0b-be0e2dad5bc2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:33.912192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2860e1d9-3fd8-463e-9cae-2473302429d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:33.913889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2860e1d9-3fd8-463e-9cae-2473302429d4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:33.967548 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:33.982833 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:34.045896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 305/603] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:12:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 10:12:34.051237 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860e1d9-3fd8-463e-9cae-2473302429d4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:34.086322 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec28643-b42b-4d89-8e0b-be0e2dad5bc2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:34.123294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb36ea9-5cc8-4e18-bd2d-c56ffdeb9cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:34.124300 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb36ea9-5cc8-4e18-bd2d-c56ffdeb9cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:34.124801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb36ea9-5cc8-4e18-bd2d-c56ffdeb9cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:34.125269 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb36ea9-5cc8-4e18-bd2d-c56ffdeb9cf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:34.126121 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb36ea9-5cc8-4e18-bd2d-c56ffdeb9cf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:34.126619 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb36ea9-5cc8-4e18-bd2d-c56ffdeb9cf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:34.128286 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb36ea9-5cc8-4e18-bd2d-c56ffdeb9cf2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:34.140989 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 299/604] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:34.149085 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb36ea9-5cc8-4e18-bd2d-c56ffdeb9cf2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:34.250282 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860e1d9-3fd8-463e-9cae-2473302429d4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:34.297702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533be2a5-2012-4f39-8995-15aa8154906a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:34.298264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533be2a5-2012-4f39-8995-15aa8154906a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:34.298540 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533be2a5-2012-4f39-8995-15aa8154906a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:34.298809 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533be2a5-2012-4f39-8995-15aa8154906a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:34.307265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:34.312806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533be2a5-2012-4f39-8995-15aa8154906a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:34.314987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533be2a5-2012-4f39-8995-15aa8154906a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:34.317049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:34.321968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb36ea9-5cc8-4e18-bd2d-c56ffdeb9cf2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:34.337105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-533be2a5-2012-4f39-8995-15aa8154906a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:34.337105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:34.337105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:34.337105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:34.337105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:34.337105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:34.337105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:34.337105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:34.337105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:34.337105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:34.337105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:34.337105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:34.337105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:34.337105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:34.337105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:34.337105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:34.338572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:34.339649 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:34.339649 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:34.339649 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:34.340202 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 306/605] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:34.345378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cea01-ac39-48ed-baec-11d0261ee6b8 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:34.345378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cea01-ac39-48ed-baec-11d0261ee6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:34.345378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cea01-ac39-48ed-baec-11d0261ee6b8 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:34.348010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 307/606] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:34.349793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cea01-ac39-48ed-baec-11d0261ee6b8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:34.376483 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a15fe-7444-4a69-b97b-ef33a59cbe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:34.377262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a15fe-7444-4a69-b97b-ef33a59cbe0e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:34.377795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a15fe-7444-4a69-b97b-ef33a59cbe0e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:34.378169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a15fe-7444-4a69-b97b-ef33a59cbe0e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:34.387882 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a15fe-7444-4a69-b97b-ef33a59cbe0e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:34.389499 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a15fe-7444-4a69-b97b-ef33a59cbe0e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:34.402005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c89a15fe-7444-4a69-b97b-ef33a59cbe0e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 10:12:34.402005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:34.402005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:34.402005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:34.402005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:34.402005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:34.402005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:34.402005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:34.402005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:34.402005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:34.402005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:34.402005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:34.402005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:34.402005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:34.402005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:34.402005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:34.403133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:34.404431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:34.404431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:34.404431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:34.404431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:34.404431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:34.404431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:34.404431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:34.404431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:34.404431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 10:12:34.404431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:34.410631 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 300/607] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Oct 17 10:12:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:34.410631 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db122-45da-4c9a-93c9-73a9c9accf83 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:34.410631 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db122-45da-4c9a-93c9-73a9c9accf83 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:34.410631 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db122-45da-4c9a-93c9-73a9c9accf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:34.429086 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f01db122-45da-4c9a-93c9-73a9c9accf83 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:34.430367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f01db122-45da-4c9a-93c9-73a9c9accf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:34.459360 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cea01-ac39-48ed-baec-11d0261ee6b8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:34.495789 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f257645-7cd7-45b9-81db-4d282f0c1b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:34.496598 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f257645-7cd7-45b9-81db-4d282f0c1b41 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:34.496943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f257645-7cd7-45b9-81db-4d282f0c1b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:34.497348 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f257645-7cd7-45b9-81db-4d282f0c1b41 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:34.498065 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f257645-7cd7-45b9-81db-4d282f0c1b41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:34.498433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f257645-7cd7-45b9-81db-4d282f0c1b41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:34.499867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f257645-7cd7-45b9-81db-4d282f0c1b41 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:34.509008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 301/608] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:34.510247 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01db122-45da-4c9a-93c9-73a9c9accf83 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:34.513626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 308/609] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:34.527950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f257645-7cd7-45b9-81db-4d282f0c1b41 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:34.628115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:34.633084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:34.645878 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01db122-45da-4c9a-93c9-73a9c9accf83 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:34.682706 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807b60c-564f-42da-9bb3-bb7755c44ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:34.683465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807b60c-564f-42da-9bb3-bb7755c44ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:34.683748 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807b60c-564f-42da-9bb3-bb7755c44ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:34.684048 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807b60c-564f-42da-9bb3-bb7755c44ec2 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:34.685379 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807b60c-564f-42da-9bb3-bb7755c44ec2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:34.685765 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807b60c-564f-42da-9bb3-bb7755c44ec2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:34.687201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807b60c-564f-42da-9bb3-bb7755c44ec2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:34.690224 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f257645-7cd7-45b9-81db-4d282f0c1b41 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:34.724055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 302/610] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Oct 17 10:12:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:34.730573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807b60c-564f-42da-9bb3-bb7755c44ec2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:34.760352 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f6567-a012-4e56-951d-f303672cabf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:34.762323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f6567-a012-4e56-951d-f303672cabf2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:34.763272 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f6567-a012-4e56-951d-f303672cabf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:34.763566 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f6567-a012-4e56-951d-f303672cabf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:34.779887 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f6567-a012-4e56-951d-f303672cabf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:34.781722 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f6567-a012-4e56-951d-f303672cabf2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:34.798419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d37f6567-a012-4e56-951d-f303672cabf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:34.798419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:34.798419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:34.798419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:34.798419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:34.798419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:34.798419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:34.798419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:34.798419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:34.798419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:34.798419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:34.798419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:34.798419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:34.798419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:34.798419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:34.799296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:34.800184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:34.800184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:34.800184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:34.800184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:34.800184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:34.800184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:34.800184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:34.800184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:34.802660 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 309/611] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:34.803444 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f6567-a012-4e56-951d-f303672cabf2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:34.859738 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807b60c-564f-42da-9bb3-bb7755c44ec2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:34.899534 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2217a3e-71cd-4324-a7d5-67f1e9ea68ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:34.900530 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2217a3e-71cd-4324-a7d5-67f1e9ea68ba None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:34.901007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2217a3e-71cd-4324-a7d5-67f1e9ea68ba None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:34.901472 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2217a3e-71cd-4324-a7d5-67f1e9ea68ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:34.917920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:34.942613 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f6567-a012-4e56-951d-f303672cabf2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:34.973859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:34.978067 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2217a3e-71cd-4324-a7d5-67f1e9ea68ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:34.979877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2217a3e-71cd-4324-a7d5-67f1e9ea68ba None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:34.986992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a680a-9c41-487c-8dac-ac5cde6b7f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:34.987923 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a680a-9c41-487c-8dac-ac5cde6b7f05 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:34.988447 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a680a-9c41-487c-8dac-ac5cde6b7f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:34.988910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a680a-9c41-487c-8dac-ac5cde6b7f05 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:34.989690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a680a-9c41-487c-8dac-ac5cde6b7f05 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:34.991263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a680a-9c41-487c-8dac-ac5cde6b7f05 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4e0a680a-9c41-487c-8dac-ac5cde6b7f05 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:35.001119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:35.002133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:35.002133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:35.002133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:35.002133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:35.002133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:35.002133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:35.002133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:35.002133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:35.002133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:35.002133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:35.002133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:35.002133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:35.002133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:35.002133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:35.002133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:35.002133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:35.002961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:35.002961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:35.002961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:35.002961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:35.002961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:35.002961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:35.002961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:35.002961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:35.002961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:35.002961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:35.002961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:35.002961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:35.002961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 10:12:35.002961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:35.010590 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 310/612] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Oct 17 10:12:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:35.011679 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a680a-9c41-487c-8dac-ac5cde6b7f05 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:35.104506 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 303/613] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:12:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 17 10:12:35.105863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2217a3e-71cd-4324-a7d5-67f1e9ea68ba None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:35.138880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a680a-9c41-487c-8dac-ac5cde6b7f05 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:35.161606 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:35.186177 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ba805-6e93-4350-a877-8ee74e2d3e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:35.187407 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ba805-6e93-4350-a877-8ee74e2d3e4d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:35.187886 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ba805-6e93-4350-a877-8ee74e2d3e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:35.188617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ba805-6e93-4350-a877-8ee74e2d3e4d None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:35.190380 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ba805-6e93-4350-a877-8ee74e2d3e4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:35.190913 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ba805-6e93-4350-a877-8ee74e2d3e4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:35.192612 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ba805-6e93-4350-a877-8ee74e2d3e4d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:35.208931 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 311/614] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:35.210436 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ba805-6e93-4350-a877-8ee74e2d3e4d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:35.226942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2217a3e-71cd-4324-a7d5-67f1e9ea68ba None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:35.250825 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:35.272441 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf30c4-23b1-475e-8c0a-e333aaf59997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:35.273444 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf30c4-23b1-475e-8c0a-e333aaf59997 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:35.273902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf30c4-23b1-475e-8c0a-e333aaf59997 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:35.274391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf30c4-23b1-475e-8c0a-e333aaf59997 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:35.275197 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf30c4-23b1-475e-8c0a-e333aaf59997 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:35.275681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf30c4-23b1-475e-8c0a-e333aaf59997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:35.277881 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf30c4-23b1-475e-8c0a-e333aaf59997 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:35.288410 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 304/615] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Oct 17 10:12:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:35.289431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf30c4-23b1-475e-8c0a-e333aaf59997 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:35.336328 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ba805-6e93-4350-a877-8ee74e2d3e4d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:35.387187 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338df51-09d1-4977-8824-67cced3b037e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:35.388496 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338df51-09d1-4977-8824-67cced3b037e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:35.389510 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338df51-09d1-4977-8824-67cced3b037e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:35.390207 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338df51-09d1-4977-8824-67cced3b037e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:35.404407 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338df51-09d1-4977-8824-67cced3b037e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:35.405914 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338df51-09d1-4977-8824-67cced3b037e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:35.413581 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf30c4-23b1-475e-8c0a-e333aaf59997 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:35.422051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9338df51-09d1-4977-8824-67cced3b037e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:35.422051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:35.422051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:35.422051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:35.422051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:35.422051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:35.422051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:35.422051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:35.422051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:35.422051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:35.422051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:35.422051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:35.422051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:35.422051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:35.422051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:35.422051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:35.423209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:35.424426 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:35.424426 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:35.424426 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:35.425694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 312/616] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:35.426632 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338df51-09d1-4977-8824-67cced3b037e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:35.429217 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:35.457961 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ae562-ca1c-4fb4-985c-d05f3c208a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:35.458902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ae562-ca1c-4fb4-985c-d05f3c208a09 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:35.459354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ae562-ca1c-4fb4-985c-d05f3c208a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:35.459762 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ae562-ca1c-4fb4-985c-d05f3c208a09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:35.460654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ae562-ca1c-4fb4-985c-d05f3c208a09 None admin] RBAC: Adding query filter params (role.id=5e3dfffec8aa470fab9232cc439aec74, scope.project.id=07b2dd5de0274a6896d407b0ff22ff54, user.id=e2969c098a154afcba382c707122598d) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:35.461103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ae562-ca1c-4fb4-985c-d05f3c208a09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:35.463610 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ae562-ca1c-4fb4-985c-d05f3c208a09 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:35.470317 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 305/617] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:12:35 2022] GET /identity/v3/role_assignments?user.id=e2969c098a154afcba382c707122598d&scope.project.id=07b2dd5de0274a6896d407b0ff22ff54&role.id=5e3dfffec8aa470fab9232cc439aec74 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:35.471279 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ae562-ca1c-4fb4-985c-d05f3c208a09 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:35.530665 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:35.555135 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338df51-09d1-4977-8824-67cced3b037e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:35.595702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad3070-71fd-44b3-b6ff-ed2952b177a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:35.596529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad3070-71fd-44b3-b6ff-ed2952b177a1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:35.596929 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad3070-71fd-44b3-b6ff-ed2952b177a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:35.597308 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad3070-71fd-44b3-b6ff-ed2952b177a1 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:35.598091 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad3070-71fd-44b3-b6ff-ed2952b177a1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:35.598491 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad3070-71fd-44b3-b6ff-ed2952b177a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:35.600159 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad3070-71fd-44b3-b6ff-ed2952b177a1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:35.611069 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 313/618] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Oct 17 10:12:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:35.611069 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b764d7-b0fe-4d87-adee-a17939ffe1aa None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:35.611069 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b764d7-b0fe-4d87-adee-a17939ffe1aa None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:35.611069 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b764d7-b0fe-4d87-adee-a17939ffe1aa None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:35.611069 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 314/619] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:35.616129 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e1fb8-d427-407c-9ea7-783981cdc8ae None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:35.616515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e1fb8-d427-407c-9ea7-783981cdc8ae None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:35.616880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e1fb8-d427-407c-9ea7-783981cdc8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:35.620465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ae562-ca1c-4fb4-985c-d05f3c208a09 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:35.637317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-439e1fb8-d427-407c-9ea7-783981cdc8ae None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:35.638989 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-439e1fb8-d427-407c-9ea7-783981cdc8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:35.670527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e4948-d397-47a6-9cf0-ffb05aa3e20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:35.671529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e4948-d397-47a6-9cf0-ffb05aa3e20f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:35.671529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e4948-d397-47a6-9cf0-ffb05aa3e20f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:35.671718 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e4948-d397-47a6-9cf0-ffb05aa3e20f None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:35.672445 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e4948-d397-47a6-9cf0-ffb05aa3e20f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:35.672804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e4948-d397-47a6-9cf0-ffb05aa3e20f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:35.674348 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e4948-d397-47a6-9cf0-ffb05aa3e20f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:35.687501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 306/620] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:35.688409 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e4948-d397-47a6-9cf0-ffb05aa3e20f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:35.719856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 315/621] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:35.721273 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e1fb8-d427-407c-9ea7-783981cdc8ae None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:35.735289 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:35.874665 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e4948-d397-47a6-9cf0-ffb05aa3e20f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:35.876514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:35.902949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e1fb8-d427-407c-9ea7-783981cdc8ae None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:35.919879 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52e52f-96cc-48cc-851f-aecdbef10f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:35.920809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e52f-96cc-48cc-851f-aecdbef10f69 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:35.921086 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e52f-96cc-48cc-851f-aecdbef10f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:35.921393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e52f-96cc-48cc-851f-aecdbef10f69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:35.922664 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52e52f-96cc-48cc-851f-aecdbef10f69 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:35.924450 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52e52f-96cc-48cc-851f-aecdbef10f69 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:35.946050 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed4dac-35f4-43dd-883d-c8ede6d25190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:35.947030 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed4dac-35f4-43dd-883d-c8ede6d25190 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:35.947410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed4dac-35f4-43dd-883d-c8ede6d25190 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:35.947850 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed4dac-35f4-43dd-883d-c8ede6d25190 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:35.953684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 307/622] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:12:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:35.960525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213ee01-2e1c-45e0-9e6a-90577d3a8ab3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:35.960858 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213ee01-2e1c-45e0-9e6a-90577d3a8ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:35.961135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213ee01-2e1c-45e0-9e6a-90577d3a8ab3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:35.963402 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed4dac-35f4-43dd-883d-c8ede6d25190 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:35.964938 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 308/623] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:35.970637 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed4dac-35f4-43dd-883d-c8ede6d25190 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:35.973128 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f407f9a-f519-4c08-966b-cbd027dc29d7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:35.973414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f407f9a-f519-4c08-966b-cbd027dc29d7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:35.973687 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f407f9a-f519-4c08-966b-cbd027dc29d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:35.999103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-29ed4dac-35f4-43dd-883d-c8ede6d25190 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:35.999103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:35.999103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:35.999103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:35.999103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:35.999103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:35.999103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:35.999103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:35.999103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:35.999103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:35.999103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:35.999103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:35.999103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:35.999103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:35.999103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:36.000471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:36.001345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:36.001345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:36.001345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:36.001345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:36.001345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:36.001345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:36.001345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:36.001345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:36.001345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 316/624] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:36.008156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed4dac-35f4-43dd-883d-c8ede6d25190 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:36.015981 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6f407f9a-f519-4c08-966b-cbd027dc29d7 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:36.018661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6f407f9a-f519-4c08-966b-cbd027dc29d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:36.112520 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 309/625] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:36.113407 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f407f9a-f519-4c08-966b-cbd027dc29d7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:36.142991 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:36.186398 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed4dac-35f4-43dd-883d-c8ede6d25190 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:36.233625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec06768-d657-44ab-97fa-6cdb1267694f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:36.234505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec06768-d657-44ab-97fa-6cdb1267694f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:36.234785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec06768-d657-44ab-97fa-6cdb1267694f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:36.235058 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec06768-d657-44ab-97fa-6cdb1267694f None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:36.236044 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec06768-d657-44ab-97fa-6cdb1267694f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:36.236829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec06768-d657-44ab-97fa-6cdb1267694f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:36.238628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec06768-d657-44ab-97fa-6cdb1267694f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:36.250590 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:36.256018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 317/626] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:36.262285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec06768-d657-44ab-97fa-6cdb1267694f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:36.263335 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f407f9a-f519-4c08-966b-cbd027dc29d7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:36.310431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd64552-ebd3-451c-8da4-21c8be60bb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:36.311107 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd64552-ebd3-451c-8da4-21c8be60bb82 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:36.311385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd64552-ebd3-451c-8da4-21c8be60bb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:36.311652 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd64552-ebd3-451c-8da4-21c8be60bb82 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:36.312267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd64552-ebd3-451c-8da4-21c8be60bb82 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:36.313640 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd64552-ebd3-451c-8da4-21c8be60bb82 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:36.323597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-1bd64552-ebd3-451c-8da4-21c8be60bb82 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 10:12:36.323597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:36.323597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:36.323597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:36.323597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:36.323597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:36.323597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:36.323597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:36.323597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 10:12:36.323597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:36.323597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:36.323597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:36.323597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:36.323597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:36.323597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:36.323597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:36.324771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:36.325939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:36.325939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:36.325939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:36.325939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:36.325939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:36.325939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:36.325939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:36.325939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:36.325939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:36.325939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:36.325939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:36.325939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:36.325939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 10:12:36.325939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:36.325939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 310/627] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Oct 17 10:12:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:36.330896 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd64552-ebd3-451c-8da4-21c8be60bb82 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:36.390225 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec06768-d657-44ab-97fa-6cdb1267694f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:36.425198 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e191479-fda8-48f6-ab2d-f635c781b059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:36.425808 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e191479-fda8-48f6-ab2d-f635c781b059 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:36.426080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e191479-fda8-48f6-ab2d-f635c781b059 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:36.426348 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e191479-fda8-48f6-ab2d-f635c781b059 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:36.427071 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e191479-fda8-48f6-ab2d-f635c781b059 None admin] RBAC: Adding query filter params (role.id=365b9c4c3245430e872f4aa988da3beb, scope.project.id=07b2dd5de0274a6896d407b0ff22ff54, user.id=fe49f95fd5a446f7a57beb62d854d3a7) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:36.427369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e191479-fda8-48f6-ab2d-f635c781b059 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:36.428858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e191479-fda8-48f6-ab2d-f635c781b059 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:36.436847 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 318/628] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:12:36 2022] GET /identity/v3/role_assignments?user.id=fe49f95fd5a446f7a57beb62d854d3a7&scope.project.id=07b2dd5de0274a6896d407b0ff22ff54&role.id=365b9c4c3245430e872f4aa988da3beb => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:36.437585 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e191479-fda8-48f6-ab2d-f635c781b059 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:36.448315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:36.467049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd64552-ebd3-451c-8da4-21c8be60bb82 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:36.550873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dc97d-f08e-4883-a47a-4eaa4530a544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:36.551958 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dc97d-f08e-4883-a47a-4eaa4530a544 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:36.552465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dc97d-f08e-4883-a47a-4eaa4530a544 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:36.552937 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dc97d-f08e-4883-a47a-4eaa4530a544 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:36.553776 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dc97d-f08e-4883-a47a-4eaa4530a544 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:36.555890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dc97d-f08e-4883-a47a-4eaa4530a544 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:36.557776 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dc97d-f08e-4883-a47a-4eaa4530a544 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:36.568509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 311/629] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 17 10:12:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:36.570533 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dc97d-f08e-4883-a47a-4eaa4530a544 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:36.593588 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:36.656899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e191479-fda8-48f6-ab2d-f635c781b059 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:36.695480 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87cb64-c297-49ff-942c-d09ca6a4bec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:36.696195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87cb64-c297-49ff-942c-d09ca6a4bec9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:36.696481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87cb64-c297-49ff-942c-d09ca6a4bec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:36.696756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87cb64-c297-49ff-942c-d09ca6a4bec9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:36.697382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87cb64-c297-49ff-942c-d09ca6a4bec9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:36.698889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87cb64-c297-49ff-942c-d09ca6a4bec9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-fb87cb64-c297-49ff-942c-d09ca6a4bec9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:36.709269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:36.710300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:36.710300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:36.710300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:36.710300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:36.710300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:36.710300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:36.710300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:36.710300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:36.710300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:36.710300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:36.710300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:36.710300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:36.710300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:36.710300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:36.710300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:36.710300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:36.711449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:36.711449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:36.711449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:36.711449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:36.711449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:36.711449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:36.711449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:36.711449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:36.711449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:36.711449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:36.711449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:36.711449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:36.711449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 10:12:36.711449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:36.711449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 319/630] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:36 2022] GET /identity/v3/services/network => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:36.716591 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87cb64-c297-49ff-942c-d09ca6a4bec9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:36.725365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dc97d-f08e-4883-a47a-4eaa4530a544 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:36.761631 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a78e31-c5a8-4b76-8e67-58d5609f72b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:36.762373 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a78e31-c5a8-4b76-8e67-58d5609f72b9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:36.763355 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a78e31-c5a8-4b76-8e67-58d5609f72b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:36.763724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a78e31-c5a8-4b76-8e67-58d5609f72b9 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:36.764487 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a78e31-c5a8-4b76-8e67-58d5609f72b9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:36.764887 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a78e31-c5a8-4b76-8e67-58d5609f72b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:36.766360 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a78e31-c5a8-4b76-8e67-58d5609f72b9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:36.775958 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 312/631] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 17 10:12:36 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:36.842914 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87cb64-c297-49ff-942c-d09ca6a4bec9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:36.883709 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:36.893457 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbae6c8-8e1e-4e70-b60e-c50c7da12571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:36.894156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbae6c8-8e1e-4e70-b60e-c50c7da12571 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:36.894441 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbae6c8-8e1e-4e70-b60e-c50c7da12571 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:36.894716 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbae6c8-8e1e-4e70-b60e-c50c7da12571 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:36.895368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbae6c8-8e1e-4e70-b60e-c50c7da12571 None admin] RBAC: Adding query filter params (name=network) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:36.895671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbae6c8-8e1e-4e70-b60e-c50c7da12571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:36.897106 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbae6c8-8e1e-4e70-b60e-c50c7da12571 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:36.902812 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 320/632] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 17 10:12:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:36.909363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a78e31-c5a8-4b76-8e67-58d5609f72b9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:36.926509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:37.034720 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a78e31-c5a8-4b76-8e67-58d5609f72b9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:37.077641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683e0a9-f1cc-4c08-841d-e973ffb6ba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:37.078269 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e0a9-f1cc-4c08-841d-e973ffb6ba79 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:37.078554 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e0a9-f1cc-4c08-841d-e973ffb6ba79 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:37.078826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e0a9-f1cc-4c08-841d-e973ffb6ba79 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:37.079463 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683e0a9-f1cc-4c08-841d-e973ffb6ba79 None admin] RBAC: Adding query filter params (type=network) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:37.079766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683e0a9-f1cc-4c08-841d-e973ffb6ba79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:37.081185 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683e0a9-f1cc-4c08-841d-e973ffb6ba79 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:37.086975 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 313/633] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 17 10:12:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:37.092714 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbae6c8-8e1e-4e70-b60e-c50c7da12571 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:37.229121 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbae6c8-8e1e-4e70-b60e-c50c7da12571 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:37.269244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae1367-8010-4291-8b73-be49ebef5f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:37.269858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae1367-8010-4291-8b73-be49ebef5f21 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:37.270134 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae1367-8010-4291-8b73-be49ebef5f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:37.270403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae1367-8010-4291-8b73-be49ebef5f21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:37.271072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae1367-8010-4291-8b73-be49ebef5f21 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:37.272467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae1367-8010-4291-8b73-be49ebef5f21 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:37.299029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 321/634] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:12:37 2022] POST /identity/v3/endpoints => generated 337 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:38.078850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7ac9a-d66b-4adb-9a20-b0633c311743 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:38.079733 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7ac9a-d66b-4adb-9a20-b0633c311743 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:38.080235 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7ac9a-d66b-4adb-9a20-b0633c311743 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:38.082098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 314/635] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:38.087691 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f39aa9-cc00-4ce5-a8f8-0dcf9e1ed0bf None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:38.088262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f39aa9-cc00-4ce5-a8f8-0dcf9e1ed0bf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:38.088744 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f39aa9-cc00-4ce5-a8f8-0dcf9e1ed0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:38.108153 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f9f39aa9-cc00-4ce5-a8f8-0dcf9e1ed0bf None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:38.110096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f9f39aa9-cc00-4ce5-a8f8-0dcf9e1ed0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:38.156932 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:38.190306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 322/636] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:38.460545 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7ac9a-d66b-4adb-9a20-b0633c311743 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:38.536234 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:38.545883 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507636a-da9a-4390-bfd9-e0de0b591c2b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:38.546166 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507636a-da9a-4390-bfd9-e0de0b591c2b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:38.548034 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507636a-da9a-4390-bfd9-e0de0b591c2b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:38.548034 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 323/637] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:38.552889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeace5-9572-48f9-b8e1-6c2ac7010e9d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:38.553167 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeace5-9572-48f9-b8e1-6c2ac7010e9d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:38.553435 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeace5-9572-48f9-b8e1-6c2ac7010e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:38.571626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-01eeace5-9572-48f9-b8e1-6c2ac7010e9d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:38.572848 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-01eeace5-9572-48f9-b8e1-6c2ac7010e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:38.576383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7ac9a-d66b-4adb-9a20-b0633c311743 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:38.613668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf344a-f47b-4430-a87e-16ec0e8ba348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:38.614416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf344a-f47b-4430-a87e-16ec0e8ba348 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:38.614695 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf344a-f47b-4430-a87e-16ec0e8ba348 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:38.614964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf344a-f47b-4430-a87e-16ec0e8ba348 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:38.615545 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf344a-f47b-4430-a87e-16ec0e8ba348 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:38.616945 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf344a-f47b-4430-a87e-16ec0e8ba348 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ccbf344a-f47b-4430-a87e-16ec0e8ba348 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:38.627817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:38.628846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:38.628846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:38.628846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:38.628846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:38.628846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:38.628846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:38.628846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:38.628846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:38.628846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:38.628846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:38.628846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:38.628846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:38.628846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:38.628846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:38.628846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:38.628846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:38.629672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:38.629672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:38.629672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:38.629672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:38.629672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:38.629672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:38.629672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:38.629672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:38.629672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:38.629672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:38.629672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:38.629672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:38.629672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 10:12:38.629672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:38.629672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 315/638] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 17 10:12:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:38.635736 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf344a-f47b-4430-a87e-16ec0e8ba348 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:38.655135 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 324/639] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 10:12:38.750993 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf344a-f47b-4430-a87e-16ec0e8ba348 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:38.785113 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3ea31-a19f-447a-bbba-a1380281ed18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:38.786059 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3ea31-a19f-447a-bbba-a1380281ed18 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:38.786533 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3ea31-a19f-447a-bbba-a1380281ed18 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:38.787022 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3ea31-a19f-447a-bbba-a1380281ed18 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:38.787846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3ea31-a19f-447a-bbba-a1380281ed18 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:38.788391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3ea31-a19f-447a-bbba-a1380281ed18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:38.789947 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3ea31-a19f-447a-bbba-a1380281ed18 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:38.795735 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:38.796229 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 316/640] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 17 10:12:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:38.804985 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eeace5-9572-48f9-b8e1-6c2ac7010e9d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:38.911556 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eeace5-9572-48f9-b8e1-6c2ac7010e9d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:38.914992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:38.948636 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1b474-5da0-4093-80a6-881bc377cf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:38.949246 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1b474-5da0-4093-80a6-881bc377cf50 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:38.949519 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1b474-5da0-4093-80a6-881bc377cf50 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:38.949788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1b474-5da0-4093-80a6-881bc377cf50 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:38.951098 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1b474-5da0-4093-80a6-881bc377cf50 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:38.951402 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1b474-5da0-4093-80a6-881bc377cf50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:38.952798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1b474-5da0-4093-80a6-881bc377cf50 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:38.957871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 325/641] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 17 10:12:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:38.974080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3ea31-a19f-447a-bbba-a1380281ed18 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:39.005044 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1525c1-8b1b-42e0-93d3-841169126324 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:39.005044 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1525c1-8b1b-42e0-93d3-841169126324 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:39.005281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1525c1-8b1b-42e0-93d3-841169126324 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:39.006852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 326/642] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:39.012751 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d0eaf-d8f2-42ae-bfd9-4fb26647a595 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:39.013086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d0eaf-d8f2-42ae-bfd9-4fb26647a595 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:39.013309 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d0eaf-d8f2-42ae-bfd9-4fb26647a595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:39.033702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1a0d0eaf-d8f2-42ae-bfd9-4fb26647a595 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:39.034949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1a0d0eaf-d8f2-42ae-bfd9-4fb26647a595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:39.105348 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3ea31-a19f-447a-bbba-a1380281ed18 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:39.128160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 327/643] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 10:12:39.149853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70838259-e13b-4e15-9ca8-2dad844ce9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:39.150822 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70838259-e13b-4e15-9ca8-2dad844ce9af None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:39.151254 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70838259-e13b-4e15-9ca8-2dad844ce9af None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:39.151664 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70838259-e13b-4e15-9ca8-2dad844ce9af None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:39.152477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70838259-e13b-4e15-9ca8-2dad844ce9af None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:39.154486 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70838259-e13b-4e15-9ca8-2dad844ce9af None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-70838259-e13b-4e15-9ca8-2dad844ce9af None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:39.163742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:39.164918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:39.164918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:39.164918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:39.164918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:39.164918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:39.164918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:39.164918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:39.164918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:39.164918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:39.164918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:39.164918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:39.164918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:39.164918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:39.164918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:39.164918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:39.164918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:39.165954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:39.165954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:39.165954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:39.165954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:39.165954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:39.165954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:39.165954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:39.165954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:39.165954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:39.165954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:39.165954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:39.165954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:39.165954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 10:12:39.165954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:39.168250 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 317/644] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 17 10:12:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:39.174533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d0eaf-d8f2-42ae-bfd9-4fb26647a595 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:39.232551 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472542-7b60-44e8-bbc1-76c15f4486b7 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:39.233121 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472542-7b60-44e8-bbc1-76c15f4486b7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:39.233574 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472542-7b60-44e8-bbc1-76c15f4486b7 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:39.235342 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 318/645] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:12:39.240188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a0904-fca2-4ee7-a71f-7a35bb50b01b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:39.240700 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a0904-fca2-4ee7-a71f-7a35bb50b01b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:39.241190 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a0904-fca2-4ee7-a71f-7a35bb50b01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:39.260884 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-028a0904-fca2-4ee7-a71f-7a35bb50b01b None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:39.263087 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-028a0904-fca2-4ee7-a71f-7a35bb50b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:39.280664 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:39.286342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d0eaf-d8f2-42ae-bfd9-4fb26647a595 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:39.325574 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea50c70-e437-4896-86ad-dac823c35bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:39.326593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea50c70-e437-4896-86ad-dac823c35bcb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:39.327084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea50c70-e437-4896-86ad-dac823c35bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:39.327607 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea50c70-e437-4896-86ad-dac823c35bcb None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:39.328661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea50c70-e437-4896-86ad-dac823c35bcb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:39.329398 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea50c70-e437-4896-86ad-dac823c35bcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:39.331192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea50c70-e437-4896-86ad-dac823c35bcb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:39.336623 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 328/646] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 17 10:12:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:39.342076 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:39.343899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea50c70-e437-4896-86ad-dac823c35bcb None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:39.347614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 319/647] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 10:12:39.407137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a0904-fca2-4ee7-a71f-7a35bb50b01b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:39.449607 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea50c70-e437-4896-86ad-dac823c35bcb None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:39.486334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0eb78-51d1-4220-9227-36b7894ea821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:39.486938 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0eb78-51d1-4220-9227-36b7894ea821 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:39.487221 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0eb78-51d1-4220-9227-36b7894ea821 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:39.487499 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0eb78-51d1-4220-9227-36b7894ea821 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:39.488157 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0eb78-51d1-4220-9227-36b7894ea821 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:39.488459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0eb78-51d1-4220-9227-36b7894ea821 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:39.489824 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0eb78-51d1-4220-9227-36b7894ea821 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:39.499958 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 329/648] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 17 10:12:39 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:39.545612 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a0904-fca2-4ee7-a71f-7a35bb50b01b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:39.583499 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbd5ad-f1e0-454b-8a16-774dce0ac980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:39.584244 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbd5ad-f1e0-454b-8a16-774dce0ac980 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:39.584509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbd5ad-f1e0-454b-8a16-774dce0ac980 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:39.584781 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbd5ad-f1e0-454b-8a16-774dce0ac980 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:39.596915 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbd5ad-f1e0-454b-8a16-774dce0ac980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:39.601886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3cbbd5ad-f1e0-454b-8a16-774dce0ac980 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 10:12:39.601886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:39.601886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:39.601886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:39.601886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:39.601886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:39.601886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:39.601886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:39.601886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:39.601886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:39.601886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:39.601886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:39.601886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:39.601886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:39.601886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:39.601886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:39.602864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:39.602864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:39.602864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:39.602864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:39.602864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:39.602864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:39.602864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:39.602864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:39.602864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:39.602864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:39.602864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:39.602864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:39.602864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:39.602864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:39.602864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:39.602864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:39.603694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:39.603694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:39.603694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:39.603694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:39.603694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:39.603694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:39.603694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:39.603694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:39.603694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:39.603694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:39.603694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 10:12:39.603694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:39.603694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 320/649] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Oct 17 10:12:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:39.610047 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0eb78-51d1-4220-9227-36b7894ea821 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:39.640972 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:39.642217 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbd5ad-f1e0-454b-8a16-774dce0ac980 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:39.704200 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:39.729559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0eb78-51d1-4220-9227-36b7894ea821 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:39.760471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbd5ad-f1e0-454b-8a16-774dce0ac980 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:39.776192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1ba5b-b6ae-4fc1-acf9-a7015abcb847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:39.777039 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1ba5b-b6ae-4fc1-acf9-a7015abcb847 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:39.777527 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1ba5b-b6ae-4fc1-acf9-a7015abcb847 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:39.777998 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1ba5b-b6ae-4fc1-acf9-a7015abcb847 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:39.779351 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1ba5b-b6ae-4fc1-acf9-a7015abcb847 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:39.779840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1ba5b-b6ae-4fc1-acf9-a7015abcb847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:39.781412 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1ba5b-b6ae-4fc1-acf9-a7015abcb847 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:39.791168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 330/650] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Oct 17 10:12:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:39.798737 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1ba5b-b6ae-4fc1-acf9-a7015abcb847 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:39.801616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4e4fc-cb0f-490f-991f-1dee619dbc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:39.801616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e4fc-cb0f-490f-991f-1dee619dbc70 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:39.801616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e4fc-cb0f-490f-991f-1dee619dbc70 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:39.801616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e4fc-cb0f-490f-991f-1dee619dbc70 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:39.802275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4e4fc-cb0f-490f-991f-1dee619dbc70 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:39.804036 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4e4fc-cb0f-490f-991f-1dee619dbc70 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:39.823794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 321/651] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 17 10:12:39 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:12:39.920711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:39.937554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1ba5b-b6ae-4fc1-acf9-a7015abcb847 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:39.984173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5dc7a9-73da-4bb8-8772-e01770627c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:39.985212 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5dc7a9-73da-4bb8-8772-e01770627c3b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:39.985734 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5dc7a9-73da-4bb8-8772-e01770627c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:39.986213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5dc7a9-73da-4bb8-8772-e01770627c3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:39.999149 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5dc7a9-73da-4bb8-8772-e01770627c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:40.000964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5dc7a9-73da-4bb8-8772-e01770627c3b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:40.016533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ef5dc7a9-73da-4bb8-8772-e01770627c3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:40.016533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:40.016533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:40.016533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:40.016533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:40.016533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:40.016533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:40.016533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:40.016533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:40.016533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:40.016533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:40.016533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:40.016533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:40.016533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:40.016533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:40.016533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:40.017647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:40.018773 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:40.018773 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:40.018773 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:40.020188 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 331/652] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:40.026128 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4e4fc-cb0f-490f-991f-1dee619dbc70 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:40.136538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4e4fc-cb0f-490f-991f-1dee619dbc70 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:40.150822 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:40.173017 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709245d6-a731-46fa-85ba-bf71527cb340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:40.173635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709245d6-a731-46fa-85ba-bf71527cb340 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:40.173914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709245d6-a731-46fa-85ba-bf71527cb340 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:40.174186 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709245d6-a731-46fa-85ba-bf71527cb340 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:40.174835 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709245d6-a731-46fa-85ba-bf71527cb340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:40.175137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709245d6-a731-46fa-85ba-bf71527cb340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:40.176545 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709245d6-a731-46fa-85ba-bf71527cb340 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:40.189331 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 322/653] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:40.194452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5dc7a9-73da-4bb8-8772-e01770627c3b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:40.303961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5dc7a9-73da-4bb8-8772-e01770627c3b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:40.339355 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8bef0-fe34-4e3f-9f97-2e224619dc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:40.339911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8bef0-fe34-4e3f-9f97-2e224619dc68 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:40.340215 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8bef0-fe34-4e3f-9f97-2e224619dc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:40.340488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8bef0-fe34-4e3f-9f97-2e224619dc68 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:40.343772 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:40.350091 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8bef0-fe34-4e3f-9f97-2e224619dc68 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:40.351559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8bef0-fe34-4e3f-9f97-2e224619dc68 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:40.364687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-54b8bef0-fe34-4e3f-9f97-2e224619dc68 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 10:12:40.364687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:40.364687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:40.364687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:40.364687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:40.364687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:40.364687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:40.364687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:40.364687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:40.364687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:40.364687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:40.364687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:40.364687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:40.364687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:40.364687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:40.364687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:40.365641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:40.366562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:40.366562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:40.366562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:40.366562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:40.366562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:40.366562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:40.366562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:40.366562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:40.366562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 10:12:40.366562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:40.366562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 332/654] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Oct 17 10:12:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:40.373065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709245d6-a731-46fa-85ba-bf71527cb340 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:40.476390 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709245d6-a731-46fa-85ba-bf71527cb340 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:40.510928 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38d7e2-ce33-4715-b245-fa6cb5f2ded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:40.511533 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38d7e2-ce33-4715-b245-fa6cb5f2ded8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:40.511808 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38d7e2-ce33-4715-b245-fa6cb5f2ded8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:40.512113 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38d7e2-ce33-4715-b245-fa6cb5f2ded8 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:40.512869 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38d7e2-ce33-4715-b245-fa6cb5f2ded8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:40.513178 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38d7e2-ce33-4715-b245-fa6cb5f2ded8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:40.514621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38d7e2-ce33-4715-b245-fa6cb5f2ded8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:40.535644 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 323/655] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Oct 17 10:12:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:40.545007 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8bef0-fe34-4e3f-9f97-2e224619dc68 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:40.649974 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8bef0-fe34-4e3f-9f97-2e224619dc68 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:40.684236 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddbb5e-aca2-47e8-be4d-92ad697f0ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:40.685389 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddbb5e-aca2-47e8-be4d-92ad697f0ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:40.685668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddbb5e-aca2-47e8-be4d-92ad697f0ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:40.685943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddbb5e-aca2-47e8-be4d-92ad697f0ed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:40.696603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddbb5e-aca2-47e8-be4d-92ad697f0ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:40.698055 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddbb5e-aca2-47e8-be4d-92ad697f0ed5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:40.712782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f1ddbb5e-aca2-47e8-be4d-92ad697f0ed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:40.712782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:40.712782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:40.712782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:40.712782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:40.712782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:40.712782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:40.712782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:40.712782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:40.712782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:40.712782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:40.712782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:40.712782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:40.712782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:40.712782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:40.712782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:40.714950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:40.717558 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:40.717558 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:40.717558 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:40.717558 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 333/656] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:40.720281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38d7e2-ce33-4715-b245-fa6cb5f2ded8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:40.756345 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:40.824491 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38d7e2-ce33-4715-b245-fa6cb5f2ded8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:40.859728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64accd-c41a-446c-bd61-2fcbc407cd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:40.860363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64accd-c41a-446c-bd61-2fcbc407cd79 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:40.860641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64accd-c41a-446c-bd61-2fcbc407cd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:40.860912 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64accd-c41a-446c-bd61-2fcbc407cd79 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:40.861552 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64accd-c41a-446c-bd61-2fcbc407cd79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:40.861853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64accd-c41a-446c-bd61-2fcbc407cd79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:40.863227 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64accd-c41a-446c-bd61-2fcbc407cd79 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:40.875758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 324/657] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:40.880922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddbb5e-aca2-47e8-be4d-92ad697f0ed5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:40.931593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:40.987770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddbb5e-aca2-47e8-be4d-92ad697f0ed5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:41.022666 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df88514-33db-4277-a448-525cbf5211bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:41.023298 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df88514-33db-4277-a448-525cbf5211bc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:41.023584 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df88514-33db-4277-a448-525cbf5211bc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:41.023856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df88514-33db-4277-a448-525cbf5211bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:41.030808 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df88514-33db-4277-a448-525cbf5211bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:41.032293 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df88514-33db-4277-a448-525cbf5211bc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:41.045483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3df88514-33db-4277-a448-525cbf5211bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:41.045483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:41.045483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:41.045483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:41.045483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:41.045483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:41.045483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:41.045483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:41.045483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:41.045483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:41.045483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:41.045483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:41.045483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:41.045483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:41.045483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:41.047521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:41.049677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:41.049677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:41.049677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:41.049677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:41.049677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:41.049677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:41.049677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:41.049677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:41.049677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 334/658] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:41.052635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64accd-c41a-446c-bd61-2fcbc407cd79 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:41.152303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:41.162391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64accd-c41a-446c-bd61-2fcbc407cd79 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:41.197143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadef204-6861-4443-9c85-d27ab691b90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:41.197659 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef204-6861-4443-9c85-d27ab691b90a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:41.197984 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef204-6861-4443-9c85-d27ab691b90a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:41.198261 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef204-6861-4443-9c85-d27ab691b90a None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:41.198952 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadef204-6861-4443-9c85-d27ab691b90a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:41.199256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadef204-6861-4443-9c85-d27ab691b90a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:41.201312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadef204-6861-4443-9c85-d27ab691b90a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:41.207742 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8078dc-c97c-4192-b269-0dd83d722d9b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:41.208321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8078dc-c97c-4192-b269-0dd83d722d9b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:41.208321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8078dc-c97c-4192-b269-0dd83d722d9b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:41.209870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 335/659] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:41.214414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 325/660] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:41.214956 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05245dd5-1f25-4f4c-a951-131a1962f33a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:41.215247 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05245dd5-1f25-4f4c-a951-131a1962f33a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:41.215522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05245dd5-1f25-4f4c-a951-131a1962f33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:41.221288 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadef204-6861-4443-9c85-d27ab691b90a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:41.240399 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-05245dd5-1f25-4f4c-a951-131a1962f33a None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:41.242329 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-05245dd5-1f25-4f4c-a951-131a1962f33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:41.318841 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 336/661] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:41 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 10:12:41.343952 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadef204-6861-4443-9c85-d27ab691b90a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:41.378877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d59c6-1183-4c50-bf56-aad86e54c6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:41.379799 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d59c6-1183-4c50-bf56-aad86e54c6d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:41.380264 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d59c6-1183-4c50-bf56-aad86e54c6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:41.380679 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d59c6-1183-4c50-bf56-aad86e54c6d5 None admin] PATH_INFO: `/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/fe49f95fd5a446f7a57beb62d854d3a7/roles/8ab4fde39c414029a48964eac4e1c03c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:41.383094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d59c6-1183-4c50-bf56-aad86e54c6d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=07b2dd5de0274a6896d407b0ff22ff54, user_id=fe49f95fd5a446f7a57beb62d854d3a7, role_id=8ab4fde39c414029a48964eac4e1c03c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:41.384753 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d59c6-1183-4c50-bf56-aad86e54c6d5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:41.399882 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 326/662] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:12:41 2022] PUT /identity/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/fe49f95fd5a446f7a57beb62d854d3a7/roles/8ab4fde39c414029a48964eac4e1c03c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:12:41.594317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05245dd5-1f25-4f4c-a951-131a1962f33a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:41.635479 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:41.696169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05245dd5-1f25-4f4c-a951-131a1962f33a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:41.732521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54505a-e97b-4813-a03e-e79a51526d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:41.733289 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54505a-e97b-4813-a03e-e79a51526d62 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:41.733572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54505a-e97b-4813-a03e-e79a51526d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:41.733844 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54505a-e97b-4813-a03e-e79a51526d62 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:41.734498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54505a-e97b-4813-a03e-e79a51526d62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:41.735871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54505a-e97b-4813-a03e-e79a51526d62 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:41.760112 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 337/663] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 17 10:12:41 2022] POST /identity/v3/services => generated 241 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:41.900305 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad89c6a-99aa-4888-b2d3-892bb59f73e7 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:41.900990 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad89c6a-99aa-4888-b2d3-892bb59f73e7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:41.901531 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad89c6a-99aa-4888-b2d3-892bb59f73e7 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:41.904055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 327/664] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:41.910153 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580f732-7078-4ca7-9195-d4034d58f88c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:41.910778 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580f732-7078-4ca7-9195-d4034d58f88c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:41.911259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580f732-7078-4ca7-9195-d4034d58f88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:41.930777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9580f732-7078-4ca7-9195-d4034d58f88c None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:41.932378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9580f732-7078-4ca7-9195-d4034d58f88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:42.015323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 338/665] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:41 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:42.081509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81535d72-c274-463d-933e-529d94324ed8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:42.082008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81535d72-c274-463d-933e-529d94324ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:42.082454 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81535d72-c274-463d-933e-529d94324ed8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:42.084242 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 328/666] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:42.089522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3b328-078b-42dc-8309-86e6b4a16f24 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:42.090004 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3b328-078b-42dc-8309-86e6b4a16f24 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:42.090471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3b328-078b-42dc-8309-86e6b4a16f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:42.109545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-02f3b328-078b-42dc-8309-86e6b4a16f24 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:42.110977 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-02f3b328-078b-42dc-8309-86e6b4a16f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:42.129362 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:42.180009 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 339/667] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:42 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:42.299337 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81535d72-c274-463d-933e-529d94324ed8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:42.315742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:42.409795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81535d72-c274-463d-933e-529d94324ed8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:42.445091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ca346-a1bb-4f5f-8d9e-3af3ca9758a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:42.445623 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ca346-a1bb-4f5f-8d9e-3af3ca9758a1 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:42.445899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ca346-a1bb-4f5f-8d9e-3af3ca9758a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:42.446166 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ca346-a1bb-4f5f-8d9e-3af3ca9758a1 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:42.446809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ca346-a1bb-4f5f-8d9e-3af3ca9758a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:42.448305 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ca346-a1bb-4f5f-8d9e-3af3ca9758a1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:42.453461 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3b328-078b-42dc-8309-86e6b4a16f24 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:42.465510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 329/668] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 17 10:12:42 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:42.575793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3b328-078b-42dc-8309-86e6b4a16f24 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:42.622339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e084059-0053-4ffb-992e-70d6f98dc74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:42.623244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e084059-0053-4ffb-992e-70d6f98dc74b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:42.623672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e084059-0053-4ffb-992e-70d6f98dc74b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:42.624118 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e084059-0053-4ffb-992e-70d6f98dc74b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:42.624914 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e084059-0053-4ffb-992e-70d6f98dc74b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:42.626480 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e084059-0053-4ffb-992e-70d6f98dc74b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:42.636667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3e084059-0053-4ffb-992e-70d6f98dc74b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 10:12:42.636667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:42.636667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:42.636667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:42.636667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:42.636667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:42.636667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:42.636667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:42.636667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 10:12:42.636667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:42.636667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:42.636667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:42.636667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:42.636667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:42.636667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:42.636667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:42.638182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:42.639072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:42.639072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:42.639072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:42.639072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:42.639072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:42.639072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:42.639072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:42.639072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:42.639072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:42.639072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:42.639072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:42.639072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:42.639072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 10:12:42.639072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:42.643916 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 340/669] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Oct 17 10:12:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:42.644862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ca346-a1bb-4f5f-8d9e-3af3ca9758a1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:42.724778 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:42.761623 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ca346-a1bb-4f5f-8d9e-3af3ca9758a1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:42.797161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c097db6-e822-415f-8917-06fc29ac815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:42.798051 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c097db6-e822-415f-8917-06fc29ac815b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:42.798540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c097db6-e822-415f-8917-06fc29ac815b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:42.798992 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c097db6-e822-415f-8917-06fc29ac815b None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:42.799804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c097db6-e822-415f-8917-06fc29ac815b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:42.800308 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c097db6-e822-415f-8917-06fc29ac815b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:42.801851 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c097db6-e822-415f-8917-06fc29ac815b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:42.807317 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 330/670] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 17 10:12:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:42.813127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e084059-0053-4ffb-992e-70d6f98dc74b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:42.829901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:42.920699 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e084059-0053-4ffb-992e-70d6f98dc74b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:42.955827 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1bef5-6978-4d3a-9639-69c952959844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:42.956816 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1bef5-6978-4d3a-9639-69c952959844 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:42.957315 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1bef5-6978-4d3a-9639-69c952959844 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:42.957802 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1bef5-6978-4d3a-9639-69c952959844 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:42.958629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1bef5-6978-4d3a-9639-69c952959844 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:42.959129 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1bef5-6978-4d3a-9639-69c952959844 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:42.960714 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1bef5-6978-4d3a-9639-69c952959844 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:42.966922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 341/671] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 17 10:12:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:42.972913 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c097db6-e822-415f-8917-06fc29ac815b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:43.084339 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c097db6-e822-415f-8917-06fc29ac815b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:43.119274 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486c02c-722c-4072-8b56-ba52053c8ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:43.119885 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486c02c-722c-4072-8b56-ba52053c8ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:43.120197 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486c02c-722c-4072-8b56-ba52053c8ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:43.120473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486c02c-722c-4072-8b56-ba52053c8ad4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:43.121178 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486c02c-722c-4072-8b56-ba52053c8ad4 None admin] RBAC: Adding query filter params (interface=public, service_id=19ba3c293895445ab12dd106111306af, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:43.121489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486c02c-722c-4072-8b56-ba52053c8ad4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:43.123401 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486c02c-722c-4072-8b56-ba52053c8ad4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:43.125812 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:43.129350 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 331/672] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Oct 17 10:12:42 2022] GET /identity/v3/endpoints?service_id=19ba3c293895445ab12dd106111306af&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:43.134829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1bef5-6978-4d3a-9639-69c952959844 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:43.222503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:43.246312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1bef5-6978-4d3a-9639-69c952959844 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:43.286334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71b18f-7fd7-42eb-ad83-337889d197f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:43.287292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b18f-7fd7-42eb-ad83-337889d197f6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:43.287776 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b18f-7fd7-42eb-ad83-337889d197f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:43.288279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b18f-7fd7-42eb-ad83-337889d197f6 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:43.289127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71b18f-7fd7-42eb-ad83-337889d197f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:43.290706 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71b18f-7fd7-42eb-ad83-337889d197f6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:43.297998 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 342/673] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 17 10:12:43 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:12:43.628406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cf27e-89f8-4258-a60c-d96f6a4cb31b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:43.629556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cf27e-89f8-4258-a60c-d96f6a4cb31b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:43.630089 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cf27e-89f8-4258-a60c-d96f6a4cb31b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:43.631946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 332/674] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:43.638082 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b3d3e-62e4-47a4-828d-9b3e2b2d2361 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:43.638910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b3d3e-62e4-47a4-828d-9b3e2b2d2361 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:43.639392 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b3d3e-62e4-47a4-828d-9b3e2b2d2361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:43.658430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c28b3d3e-62e4-47a4-828d-9b3e2b2d2361 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:43.659988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c28b3d3e-62e4-47a4-828d-9b3e2b2d2361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:43.732213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 343/675] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:44.000570 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cf27e-89f8-4258-a60c-d96f6a4cb31b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:44.060808 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f3ad6-39fa-4965-be0c-0ee5244206a0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:44.061442 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f3ad6-39fa-4965-be0c-0ee5244206a0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:44.061989 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f3ad6-39fa-4965-be0c-0ee5244206a0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:44.064863 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 344/676] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:44.069408 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546dbcc-0ae9-448e-94d6-9dd1a0763733 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:44.069933 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546dbcc-0ae9-448e-94d6-9dd1a0763733 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:44.070427 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546dbcc-0ae9-448e-94d6-9dd1a0763733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:44.093814 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6546dbcc-0ae9-448e-94d6-9dd1a0763733 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:44.095328 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6546dbcc-0ae9-448e-94d6-9dd1a0763733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:44.109467 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cf27e-89f8-4258-a60c-d96f6a4cb31b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:44.146569 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8028072-7f64-4617-b68b-2a8fc1e22ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:44.147198 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8028072-7f64-4617-b68b-2a8fc1e22ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:44.147473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8028072-7f64-4617-b68b-2a8fc1e22ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:44.147825 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8028072-7f64-4617-b68b-2a8fc1e22ee6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:44.159129 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8028072-7f64-4617-b68b-2a8fc1e22ee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:12:44.165210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c8028072-7f64-4617-b68b-2a8fc1e22ee6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 10:12:44.165210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:44.165210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:44.165210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:44.165210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:44.165210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:44.165210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:44.165210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:44.165210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:44.165210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:44.165210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:44.165210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:44.165210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:12:44.165210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:12:44.165210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:12:44.165210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:12:44.166354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:12:44.166354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:12:44.166354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:12:44.166354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:12:44.166354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:44.166354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:44.166354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:44.166354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:44.166354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:44.166354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:44.166354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:44.166354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:44.166354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:44.166354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:44.166354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:44.166354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:44.167295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:44.167295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:44.167295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:44.167295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:44.167295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:12:44.167295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:12:44.167295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:12:44.167295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:12:44.167295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:12:44.167295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:12:44.167295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 10:12:44.167295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:44.174501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 333/678] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Oct 17 10:12:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:44.174625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 345/678] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 10:12:44.175692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546dbcc-0ae9-448e-94d6-9dd1a0763733 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:44.178181 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:44.282402 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546dbcc-0ae9-448e-94d6-9dd1a0763733 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:44.317304 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5561e-3e26-4218-9fc0-799498ab9e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:44.317922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5561e-3e26-4218-9fc0-799498ab9e75 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:44.318204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5561e-3e26-4218-9fc0-799498ab9e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:44.318480 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5561e-3e26-4218-9fc0-799498ab9e75 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:44.319152 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5561e-3e26-4218-9fc0-799498ab9e75 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:44.319457 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5561e-3e26-4218-9fc0-799498ab9e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:44.320971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5561e-3e26-4218-9fc0-799498ab9e75 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:44.329841 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 346/679] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Oct 17 10:12:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:44.335363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8028072-7f64-4617-b68b-2a8fc1e22ee6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:44.397160 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:44.447028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8028072-7f64-4617-b68b-2a8fc1e22ee6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:44.453610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5561e-3e26-4218-9fc0-799498ab9e75 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:44.483651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5e4a2-83e0-4f98-85fe-c846c31f0c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:44.484129 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5e4a2-83e0-4f98-85fe-c846c31f0c98 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:44.484411 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5e4a2-83e0-4f98-85fe-c846c31f0c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:44.484675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5e4a2-83e0-4f98-85fe-c846c31f0c98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:44.496368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5e4a2-83e0-4f98-85fe-c846c31f0c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:44.498268 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5e4a2-83e0-4f98-85fe-c846c31f0c98 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:44.513746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-64d5e4a2-83e0-4f98-85fe-c846c31f0c98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:44.513746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:44.513746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:44.513746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:44.513746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:44.513746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:44.513746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:44.513746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:44.513746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:44.513746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:44.513746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:44.513746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:44.513746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:44.513746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:44.513746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:44.513746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:44.514827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:44.515713 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:44.515713 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:44.515713 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:44.515713 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 334/680] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:44.521148 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5e4a2-83e0-4f98-85fe-c846c31f0c98 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:44.525751 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:44.567558 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5561e-3e26-4218-9fc0-799498ab9e75 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:44.607151 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a69da2-f733-4027-9672-67d804dccbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:44.608263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a69da2-f733-4027-9672-67d804dccbb6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:44.608926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a69da2-f733-4027-9672-67d804dccbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:44.609406 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a69da2-f733-4027-9672-67d804dccbb6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:44.610302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a69da2-f733-4027-9672-67d804dccbb6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:44.611982 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a69da2-f733-4027-9672-67d804dccbb6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-87a69da2-f733-4027-9672-67d804dccbb6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:44.622609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:44.623627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:44.623627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:44.623627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:44.623627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:44.623627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:44.623627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:44.623627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:44.623627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:44.623627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:44.623627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:44.623627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:44.623627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:44.623627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:44.623627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:44.623627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:44.623627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:44.624483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:44.624483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:44.624483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:44.624483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:44.624483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:44.624483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:44.624483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:44.624483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:44.624483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:44.624483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:44.624483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:44.624483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:44.624483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 10:12:44.624483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:44.632115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 347/681] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 17 10:12:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:44.633334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a69da2-f733-4027-9672-67d804dccbb6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:44.656139 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5e4a2-83e0-4f98-85fe-c846c31f0c98 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:44.673433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:44.700521 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b261b6a-2544-4ff2-94a6-04f7501576ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:44.701630 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b261b6a-2544-4ff2-94a6-04f7501576ef None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:44.701913 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b261b6a-2544-4ff2-94a6-04f7501576ef None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:44.702382 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b261b6a-2544-4ff2-94a6-04f7501576ef None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:44.703080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b261b6a-2544-4ff2-94a6-04f7501576ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:44.703385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b261b6a-2544-4ff2-94a6-04f7501576ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:44.705341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b261b6a-2544-4ff2-94a6-04f7501576ef None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:44.718802 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 335/682] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:44.720204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422b3b9-87ed-47ac-9dc6-a768399891bd None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:44.720485 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422b3b9-87ed-47ac-9dc6-a768399891bd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:44.720755 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422b3b9-87ed-47ac-9dc6-a768399891bd None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:44.722101 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 336/683] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:44.724105 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422b3b9-87ed-47ac-9dc6-a768399891bd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:44.752722 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a69da2-f733-4027-9672-67d804dccbb6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:44.780066 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:44.789257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844d012-a6b7-4388-bd72-9251ab5e4c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:44.789856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844d012-a6b7-4388-bd72-9251ab5e4c20 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:44.790128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844d012-a6b7-4388-bd72-9251ab5e4c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:44.790392 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844d012-a6b7-4388-bd72-9251ab5e4c20 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:44.791014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844d012-a6b7-4388-bd72-9251ab5e4c20 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:44.791313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844d012-a6b7-4388-bd72-9251ab5e4c20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:44.792693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844d012-a6b7-4388-bd72-9251ab5e4c20 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:44.802409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 348/684] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 17 10:12:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:44.802409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7b500-74ee-4561-a9f6-d9de1c4e11cb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:44.802409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7b500-74ee-4561-a9f6-d9de1c4e11cb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:44.802409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7b500-74ee-4561-a9f6-d9de1c4e11cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:44.817549 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3bb7b500-74ee-4561-a9f6-d9de1c4e11cb None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:44.818606 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3bb7b500-74ee-4561-a9f6-d9de1c4e11cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:44.832199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422b3b9-87ed-47ac-9dc6-a768399891bd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:44.867971 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88264c17-fe11-4676-81d2-eb3b3170dd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:44.868951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88264c17-fe11-4676-81d2-eb3b3170dd83 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:44.869241 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88264c17-fe11-4676-81d2-eb3b3170dd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:44.869521 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88264c17-fe11-4676-81d2-eb3b3170dd83 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:44.876654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88264c17-fe11-4676-81d2-eb3b3170dd83 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:44.878098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88264c17-fe11-4676-81d2-eb3b3170dd83 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:44.899954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-88264c17-fe11-4676-81d2-eb3b3170dd83 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 10:12:44.899954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:44.899954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:44.899954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:44.899954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:44.899954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:44.899954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:44.899954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:44.899954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:44.899954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:44.899954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:44.899954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:44.899954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:44.899954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:44.899954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:44.899954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:44.900954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:44.901905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:44.901905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:44.901905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:44.901905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:44.901905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:44.901905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:44.901905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:44.901905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:44.901905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 10:12:44.901905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:44.901905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 337/685] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Oct 17 10:12:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:44.901905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88264c17-fe11-4676-81d2-eb3b3170dd83 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:44.902578 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 349/686] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:44.902578 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7b500-74ee-4561-a9f6-d9de1c4e11cb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:44.930230 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:45.013285 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88264c17-fe11-4676-81d2-eb3b3170dd83 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:45.044745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7b500-74ee-4561-a9f6-d9de1c4e11cb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:45.054201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00256371-3eac-40a0-a2b9-1ee2580e8e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:45.055243 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00256371-3eac-40a0-a2b9-1ee2580e8e13 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:45.055519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00256371-3eac-40a0-a2b9-1ee2580e8e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:45.055788 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00256371-3eac-40a0-a2b9-1ee2580e8e13 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:45.059064 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00256371-3eac-40a0-a2b9-1ee2580e8e13 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:45.059064 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00256371-3eac-40a0-a2b9-1ee2580e8e13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:45.059064 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00256371-3eac-40a0-a2b9-1ee2580e8e13 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:45.067978 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 338/687] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 17 10:12:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:45.071048 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00256371-3eac-40a0-a2b9-1ee2580e8e13 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:45.074595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:45.091242 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921a68a-ae56-4ccd-8e92-0ae63ca97061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:45.091858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921a68a-ae56-4ccd-8e92-0ae63ca97061 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:45.092212 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921a68a-ae56-4ccd-8e92-0ae63ca97061 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:45.092488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921a68a-ae56-4ccd-8e92-0ae63ca97061 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:45.093223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921a68a-ae56-4ccd-8e92-0ae63ca97061 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:45.093532 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921a68a-ae56-4ccd-8e92-0ae63ca97061 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:45.095030 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921a68a-ae56-4ccd-8e92-0ae63ca97061 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:45.121493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 350/688] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Oct 17 10:12:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:45.122553 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921a68a-ae56-4ccd-8e92-0ae63ca97061 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:45.185011 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:45.193331 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00256371-3eac-40a0-a2b9-1ee2580e8e13 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:45.228196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921a68a-ae56-4ccd-8e92-0ae63ca97061 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:45.229155 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b3ecb-ee88-4f50-813c-894f0d6cde12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:45.229759 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b3ecb-ee88-4f50-813c-894f0d6cde12 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:45.230033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b3ecb-ee88-4f50-813c-894f0d6cde12 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:45.230297 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b3ecb-ee88-4f50-813c-894f0d6cde12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:45.231281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b3ecb-ee88-4f50-813c-894f0d6cde12 None admin] RBAC: Adding query filter params (interface=public, service_id=78b61c1c170746d8b0bc57051fa3d386, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:45.231586 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b3ecb-ee88-4f50-813c-894f0d6cde12 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:45.233044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b3ecb-ee88-4f50-813c-894f0d6cde12 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:45.238332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 339/689] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Oct 17 10:12:45 2022] GET /identity/v3/endpoints?service_id=78b61c1c170746d8b0bc57051fa3d386&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:45.238938 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b3ecb-ee88-4f50-813c-894f0d6cde12 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:45.268104 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a981b3-3dbc-43a0-9771-31e74a885154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:45.268709 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a981b3-3dbc-43a0-9771-31e74a885154 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:45.268979 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a981b3-3dbc-43a0-9771-31e74a885154 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:45.269318 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a981b3-3dbc-43a0-9771-31e74a885154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:45.323886 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:45.344517 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b3ecb-ee88-4f50-813c-894f0d6cde12 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:45.345131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a981b3-3dbc-43a0-9771-31e74a885154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:45.346594 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a981b3-3dbc-43a0-9771-31e74a885154 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:45.378862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d5116-3065-492f-a398-3872e6f4011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:45.379507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d5116-3065-492f-a398-3872e6f4011a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:45.379782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d5116-3065-492f-a398-3872e6f4011a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:45.380110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d5116-3065-492f-a398-3872e6f4011a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:45.380705 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d5116-3065-492f-a398-3872e6f4011a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:45.382110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d5116-3065-492f-a398-3872e6f4011a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9e1d5116-3065-492f-a398-3872e6f4011a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:45.392389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:45.393470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:45.393470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:45.393470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:45.393470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:45.393470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:45.393470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:45.393470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:45.393470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:45.393470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:45.393470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:45.393470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:45.393470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:45.393470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:45.393470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:45.393470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:45.393470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:45.394326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:45.394326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:45.394326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:45.394326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:45.394326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:45.394326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:45.394326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:45.394326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:45.394326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:45.394326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:45.394326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:45.394326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:45.394326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 10:12:45.394326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:45.394326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 340/690] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 17 10:12:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:45.395124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d5116-3065-492f-a398-3872e6f4011a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:45.423442 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:45.476026 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 351/691] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:12:45 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 10:12:45.476026 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a981b3-3dbc-43a0-9771-31e74a885154 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:45.508040 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d5116-3065-492f-a398-3872e6f4011a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:45.542284 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57cdb9-4448-438e-92bb-8398bb406433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:45.542885 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57cdb9-4448-438e-92bb-8398bb406433 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:45.543165 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57cdb9-4448-438e-92bb-8398bb406433 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:45.543436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57cdb9-4448-438e-92bb-8398bb406433 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:45.544105 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57cdb9-4448-438e-92bb-8398bb406433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:45.545467 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57cdb9-4448-438e-92bb-8398bb406433 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:45.551545 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 341/692] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 17 10:12:45 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:12:45.552356 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57cdb9-4448-438e-92bb-8398bb406433 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:45.560730 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:45.589886 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a981b3-3dbc-43a0-9771-31e74a885154 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:45.628900 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780b2fa-6e5c-4193-b4f8-ddf32f95fa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:45.629821 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780b2fa-6e5c-4193-b4f8-ddf32f95fa36 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:45.630242 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780b2fa-6e5c-4193-b4f8-ddf32f95fa36 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:45.630651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780b2fa-6e5c-4193-b4f8-ddf32f95fa36 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:45.631434 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780b2fa-6e5c-4193-b4f8-ddf32f95fa36 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:45.631880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780b2fa-6e5c-4193-b4f8-ddf32f95fa36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:45.633648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780b2fa-6e5c-4193-b4f8-ddf32f95fa36 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:45.639600 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 352/693] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 17 10:12:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:45.641125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04c30f-d649-40e2-b1bb-2ec6f040fd35 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:45.641562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04c30f-d649-40e2-b1bb-2ec6f040fd35 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:45.641975 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04c30f-d649-40e2-b1bb-2ec6f040fd35 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:45.643464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 353/694] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:45.645242 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04c30f-d649-40e2-b1bb-2ec6f040fd35 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:45.665472 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:45.679749 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57cdb9-4448-438e-92bb-8398bb406433 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:45.720828 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dab183-9d44-4d3e-8a86-d9999a7a7380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:45.721772 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dab183-9d44-4d3e-8a86-d9999a7a7380 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:45.722224 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dab183-9d44-4d3e-8a86-d9999a7a7380 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:45.722536 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dab183-9d44-4d3e-8a86-d9999a7a7380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:45.734785 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dab183-9d44-4d3e-8a86-d9999a7a7380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:45.736268 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dab183-9d44-4d3e-8a86-d9999a7a7380 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:45.751662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-36dab183-9d44-4d3e-8a86-d9999a7a7380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:45.751662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:45.751662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:45.751662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:45.751662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:45.751662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:45.751662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:45.751662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:45.751662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:45.751662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:45.751662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:45.751662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:45.751662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:12:45.751662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:12:45.751662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:12:45.751662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:45.752677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:12:45.753596 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:12:45.753596 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:12:45.753596 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:45.753596 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 342/695] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:45.753918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8d04f-125e-45d9-94cb-dda93fbcac8a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:45.754199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8d04f-125e-45d9-94cb-dda93fbcac8a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:45.754470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8d04f-125e-45d9-94cb-dda93fbcac8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:45.765704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04c30f-d649-40e2-b1bb-2ec6f040fd35 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:45.772519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4ef8d04f-125e-45d9-94cb-dda93fbcac8a None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:45.773717 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4ef8d04f-125e-45d9-94cb-dda93fbcac8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:45.803228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dc466-6bfd-404c-a0b9-37a6216fca5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:45.803840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dc466-6bfd-404c-a0b9-37a6216fca5e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:45.804171 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dc466-6bfd-404c-a0b9-37a6216fca5e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:45.804450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dc466-6bfd-404c-a0b9-37a6216fca5e None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:45.805083 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dc466-6bfd-404c-a0b9-37a6216fca5e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:45.805393 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dc466-6bfd-404c-a0b9-37a6216fca5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:45.806755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dc466-6bfd-404c-a0b9-37a6216fca5e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:45.811643 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 354/696] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 17 10:12:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:45.817252 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dc466-6bfd-404c-a0b9-37a6216fca5e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:45.827977 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:45.845515 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 343/697] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:45.846791 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8d04f-125e-45d9-94cb-dda93fbcac8a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:45.919303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:45.953403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dc466-6bfd-404c-a0b9-37a6216fca5e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:45.953918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8d04f-125e-45d9-94cb-dda93fbcac8a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:45.990720 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6730f-6060-415d-a2bb-49c25dc1001d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:45.991398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6730f-6060-415d-a2bb-49c25dc1001d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:45.991680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6730f-6060-415d-a2bb-49c25dc1001d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:45.992053 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6730f-6060-415d-a2bb-49c25dc1001d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:45.992782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6730f-6060-415d-a2bb-49c25dc1001d None admin] RBAC: Adding query filter params (interface=public, service_id=f6313a7eecbd4350865baabca5f1a087, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:45.993092 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6730f-6060-415d-a2bb-49c25dc1001d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:45.994230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045b3ff-ff09-4be7-abd4-96633c157b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:45.994497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6730f-6060-415d-a2bb-49c25dc1001d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:45.995289 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045b3ff-ff09-4be7-abd4-96633c157b05 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:45.995758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045b3ff-ff09-4be7-abd4-96633c157b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:45.996263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045b3ff-ff09-4be7-abd4-96633c157b05 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:45.997211 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045b3ff-ff09-4be7-abd4-96633c157b05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:45.997706 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045b3ff-ff09-4be7-abd4-96633c157b05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:45.999252 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045b3ff-ff09-4be7-abd4-96633c157b05 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:46.000197 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 344/698] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Oct 17 10:12:45 2022] GET /identity/v3/endpoints?service_id=f6313a7eecbd4350865baabca5f1a087&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:46.011223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 355/699] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:46.016125 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6730f-6060-415d-a2bb-49c25dc1001d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:46.020788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045b3ff-ff09-4be7-abd4-96633c157b05 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:46.115901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:46.133823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6730f-6060-415d-a2bb-49c25dc1001d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:46.154330 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045b3ff-ff09-4be7-abd4-96633c157b05 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:46.171239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931de09-6ee8-4dd9-be6f-7784605b895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:46.172172 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931de09-6ee8-4dd9-be6f-7784605b895c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:46.172624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931de09-6ee8-4dd9-be6f-7784605b895c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:46.173068 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931de09-6ee8-4dd9-be6f-7784605b895c None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:46.173836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931de09-6ee8-4dd9-be6f-7784605b895c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:46.175472 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931de09-6ee8-4dd9-be6f-7784605b895c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:46.176794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:46.183355 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 345/700] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 17 10:12:46 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:12:46.184775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931de09-6ee8-4dd9-be6f-7784605b895c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:46.191301 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9d13c-8c23-4662-9c39-bba196a3b769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:46.192328 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9d13c-8c23-4662-9c39-bba196a3b769 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:46.192754 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9d13c-8c23-4662-9c39-bba196a3b769 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:46.193234 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9d13c-8c23-4662-9c39-bba196a3b769 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:46.204885 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9d13c-8c23-4662-9c39-bba196a3b769 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:46.207298 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9d13c-8c23-4662-9c39-bba196a3b769 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:46.222522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-67a9d13c-8c23-4662-9c39-bba196a3b769 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:46.222522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:46.222522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:46.222522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:46.222522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:46.222522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:46.222522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:46.222522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:46.222522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:46.222522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:46.222522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:46.222522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:46.222522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:46.222522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:46.222522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:46.223710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:46.224822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:46.224822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:46.224822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:46.224822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:46.224822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:46.224822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:46.224822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:46.224822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:46.226367 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 356/701] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:46.232717 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9d13c-8c23-4662-9c39-bba196a3b769 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:46.328299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931de09-6ee8-4dd9-be6f-7784605b895c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:46.371037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff315f21-a974-4c8e-b99c-f301037ff8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:46.372137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff315f21-a974-4c8e-b99c-f301037ff8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:46.372950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff315f21-a974-4c8e-b99c-f301037ff8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:46.373495 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff315f21-a974-4c8e-b99c-f301037ff8d0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:46.374370 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff315f21-a974-4c8e-b99c-f301037ff8d0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:46.375889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff315f21-a974-4c8e-b99c-f301037ff8d0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:46.376049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9d13c-8c23-4662-9c39-bba196a3b769 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:46.386161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ff315f21-a974-4c8e-b99c-f301037ff8d0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 10:12:46.386161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:46.386161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:46.386161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:46.386161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:46.386161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:46.386161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:46.386161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:46.386161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 10:12:46.386161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:46.386161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:46.386161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:46.386161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:46.386161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:46.386161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:46.386161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:46.387328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:46.388795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:46.388795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:46.388795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:46.388795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:46.388795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:46.388795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:46.388795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:46.388795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:46.388795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:46.388795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:46.388795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:46.388795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:46.388795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 10:12:46.388795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:46.389521 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 346/702] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Oct 17 10:12:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:46.394774 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff315f21-a974-4c8e-b99c-f301037ff8d0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:46.417353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:46.431761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c93882-f5ae-427e-819a-712b71aaed24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:46.433012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c93882-f5ae-427e-819a-712b71aaed24 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:46.433793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c93882-f5ae-427e-819a-712b71aaed24 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:46.434744 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c93882-f5ae-427e-819a-712b71aaed24 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:46.435996 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c93882-f5ae-427e-819a-712b71aaed24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:46.436762 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c93882-f5ae-427e-819a-712b71aaed24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:46.439120 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c93882-f5ae-427e-819a-712b71aaed24 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:46.457812 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 357/703] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:12:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:46.464305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c93882-f5ae-427e-819a-712b71aaed24 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:46.473798 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:46.519169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff315f21-a974-4c8e-b99c-f301037ff8d0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:46.555000 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddfe56-4fb6-4d53-9e73-45a24207413c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:46.555601 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddfe56-4fb6-4d53-9e73-45a24207413c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:46.555874 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddfe56-4fb6-4d53-9e73-45a24207413c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:46.556183 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddfe56-4fb6-4d53-9e73-45a24207413c None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:46.556910 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddfe56-4fb6-4d53-9e73-45a24207413c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:46.557234 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddfe56-4fb6-4d53-9e73-45a24207413c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:46.558772 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddfe56-4fb6-4d53-9e73-45a24207413c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:46.564755 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 347/704] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 17 10:12:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:46.570105 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddfe56-4fb6-4d53-9e73-45a24207413c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:46.592670 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c93882-f5ae-427e-819a-712b71aaed24 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:46.628324 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb68ac9-a4e3-4f9a-acd7-4a090ff3c6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:46.628830 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb68ac9-a4e3-4f9a-acd7-4a090ff3c6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:46.629109 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb68ac9-a4e3-4f9a-acd7-4a090ff3c6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:46.629382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb68ac9-a4e3-4f9a-acd7-4a090ff3c6f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:46.630403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb68ac9-a4e3-4f9a-acd7-4a090ff3c6f9 None admin] RBAC: Adding query filter params (role.id=8ab4fde39c414029a48964eac4e1c03c, scope.project.id=07b2dd5de0274a6896d407b0ff22ff54, user.id=fe49f95fd5a446f7a57beb62d854d3a7) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:46.630403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb68ac9-a4e3-4f9a-acd7-4a090ff3c6f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:46.631821 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb68ac9-a4e3-4f9a-acd7-4a090ff3c6f9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:46.643958 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 358/705] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:12:46 2022] GET /identity/v3/role_assignments?user.id=fe49f95fd5a446f7a57beb62d854d3a7&scope.project.id=07b2dd5de0274a6896d407b0ff22ff54&role.id=8ab4fde39c414029a48964eac4e1c03c => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:46.699302 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddfe56-4fb6-4d53-9e73-45a24207413c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:46.733442 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:46.744715 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bf263-143e-474a-82b3-98737029040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:46.745700 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf263-143e-474a-82b3-98737029040c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:46.746205 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf263-143e-474a-82b3-98737029040c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:46.746681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf263-143e-474a-82b3-98737029040c None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:46.748204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bf263-143e-474a-82b3-98737029040c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:46.748719 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bf263-143e-474a-82b3-98737029040c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:46.750345 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bf263-143e-474a-82b3-98737029040c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:46.756857 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 348/706] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 17 10:12:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:46.763072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb68ac9-a4e3-4f9a-acd7-4a090ff3c6f9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:46.824059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:46.876032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb68ac9-a4e3-4f9a-acd7-4a090ff3c6f9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:46.912532 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b31e34-8ec5-4cac-9d9f-138362fb7e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:46.913504 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b31e34-8ec5-4cac-9d9f-138362fb7e8e None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:46.914007 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b31e34-8ec5-4cac-9d9f-138362fb7e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:46.914498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b31e34-8ec5-4cac-9d9f-138362fb7e8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:46.915375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b31e34-8ec5-4cac-9d9f-138362fb7e8e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:46.916993 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b31e34-8ec5-4cac-9d9f-138362fb7e8e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:46.941498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 359/707] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:12:46 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:47.756579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b4359-2b70-4349-ac8b-d090efe54ca8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:47.757097 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b4359-2b70-4349-ac8b-d090efe54ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:47.757097 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b4359-2b70-4349-ac8b-d090efe54ca8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:47.758740 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 349/708] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:47.764656 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af64381-341a-440c-9b00-05369e322efa None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:47.764947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af64381-341a-440c-9b00-05369e322efa None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:47.765227 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af64381-341a-440c-9b00-05369e322efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:47.783279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2af64381-341a-440c-9b00-05369e322efa None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:47.784481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2af64381-341a-440c-9b00-05369e322efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:47.859872 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 360/709] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:48.126532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b4359-2b70-4349-ac8b-d090efe54ca8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:48.232927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b4359-2b70-4349-ac8b-d090efe54ca8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:48.273566 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f4c74-feda-46e5-be06-3e648f218b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:48.274195 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f4c74-feda-46e5-be06-3e648f218b28 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:48.274468 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f4c74-feda-46e5-be06-3e648f218b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:48.274736 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f4c74-feda-46e5-be06-3e648f218b28 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:48.275314 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f4c74-feda-46e5-be06-3e648f218b28 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:48.276718 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f4c74-feda-46e5-be06-3e648f218b28 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3b2f4c74-feda-46e5-be06-3e648f218b28 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:48.286319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:48.287299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:48.287299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:48.287299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:48.287299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:48.287299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:48.287299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:48.287299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:48.287299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:48.287299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:48.287299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:48.287299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:48.287299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:48.287299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:48.287299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:48.287299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:48.287299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:48.288164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:48.288164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:48.288164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:48.288164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:48.288164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:48.288164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:48.288164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:48.288164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:48.288164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:48.288164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:48.288164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:48.288164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:48.288164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 10:12:48.288164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:48.288164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 350/710] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 17 10:12:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:48.293595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af64381-341a-440c-9b00-05369e322efa None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:48.330374 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:48.399097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af64381-341a-440c-9b00-05369e322efa None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:48.431058 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda8c9-6825-45be-a60a-ead726b7889b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:48.431367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda8c9-6825-45be-a60a-ead726b7889b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:48.431607 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda8c9-6825-45be-a60a-ead726b7889b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:48.433365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 351/711] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:12:48.436626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb9968-d6d5-447c-9ad6-05e202765c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:48.437339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb9968-d6d5-447c-9ad6-05e202765c7c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:48.437617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb9968-d6d5-447c-9ad6-05e202765c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:48.437886 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb9968-d6d5-447c-9ad6-05e202765c7c None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:48.438519 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb9968-d6d5-447c-9ad6-05e202765c7c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:48.438820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb9968-d6d5-447c-9ad6-05e202765c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:48.440210 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb9968-d6d5-447c-9ad6-05e202765c7c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:48.442169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda20785-15e1-4a67-8fa5-6ac300a0e1b7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:48.442690 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda20785-15e1-4a67-8fa5-6ac300a0e1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:48.443157 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda20785-15e1-4a67-8fa5-6ac300a0e1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:48.448010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 361/712] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 17 10:12:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:48.451530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb9968-d6d5-447c-9ad6-05e202765c7c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:48.470675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dda20785-15e1-4a67-8fa5-6ac300a0e1b7 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:48.472555 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dda20785-15e1-4a67-8fa5-6ac300a0e1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:48.535615 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:48.555588 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 352/713] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 10:12:48.567136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:48.571887 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb9968-d6d5-447c-9ad6-05e202765c7c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:48.608190 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a81f92-72b3-404c-acf6-e527fa75afe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:48.609135 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a81f92-72b3-404c-acf6-e527fa75afe0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:48.609618 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a81f92-72b3-404c-acf6-e527fa75afe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:48.610105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a81f92-72b3-404c-acf6-e527fa75afe0 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:48.610933 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a81f92-72b3-404c-acf6-e527fa75afe0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:48.611494 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a81f92-72b3-404c-acf6-e527fa75afe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:48.613172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a81f92-72b3-404c-acf6-e527fa75afe0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:48.623316 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 362/714] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 17 10:12:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:48.624992 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda20785-15e1-4a67-8fa5-6ac300a0e1b7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:48.726580 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda20785-15e1-4a67-8fa5-6ac300a0e1b7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:48.761670 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486250f-e6d5-4da3-b805-35b456da89c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:48.763215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486250f-e6d5-4da3-b805-35b456da89c6 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:48.763743 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486250f-e6d5-4da3-b805-35b456da89c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:48.764232 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486250f-e6d5-4da3-b805-35b456da89c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:48.765163 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486250f-e6d5-4da3-b805-35b456da89c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:48.766745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486250f-e6d5-4da3-b805-35b456da89c6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:48.795055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 353/715] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:12:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:12:48.841474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a81f92-72b3-404c-acf6-e527fa75afe0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:48.911370 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0549c-a4b0-4bdf-8b89-09f5a4689d37 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:48.911728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0549c-a4b0-4bdf-8b89-09f5a4689d37 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:48.912220 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0549c-a4b0-4bdf-8b89-09f5a4689d37 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:48.914594 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 354/716] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:48.925481 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbefeb-edef-4a5f-9091-a5e2ab71093d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:48.926110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbefeb-edef-4a5f-9091-a5e2ab71093d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:48.926587 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbefeb-edef-4a5f-9091-a5e2ab71093d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:48.946323 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-addbefeb-edef-4a5f-9091-a5e2ab71093d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:48.947979 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-addbefeb-edef-4a5f-9091-a5e2ab71093d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:48.957702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a81f92-72b3-404c-acf6-e527fa75afe0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:48.987734 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:49.012660 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd534dd-80fd-4b87-8bdc-747eb7115261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:49.013195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd534dd-80fd-4b87-8bdc-747eb7115261 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:49.013476 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd534dd-80fd-4b87-8bdc-747eb7115261 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:49.013856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd534dd-80fd-4b87-8bdc-747eb7115261 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:49.015634 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd534dd-80fd-4b87-8bdc-747eb7115261 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:49.015942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd534dd-80fd-4b87-8bdc-747eb7115261 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-cfd534dd-80fd-4b87-8bdc-747eb7115261 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:49.027014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:49.028942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:49.028942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:49.028942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:49.028942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:49.028942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:49.028942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:49.028942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:49.028942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:49.028942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:49.028942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:49.028942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:49.028942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:49.028942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:49.028942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:49.028942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:49.028942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:49.030196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:49.030196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:49.030196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:49.030196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:49.030196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:49.030196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:49.030196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:49.030196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:49.030196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:49.030196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:49.030196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:49.030196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:49.030196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 10:12:49.030196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:49.030196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 363/717] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 17 10:12:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:49.035130 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd534dd-80fd-4b87-8bdc-747eb7115261 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:49.037236 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 355/718] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 10:12:49.073772 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:49.162855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd534dd-80fd-4b87-8bdc-747eb7115261 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:49.200939 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a3de4-32f7-433a-ac62-ec1d7a30a9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:49.201558 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a3de4-32f7-433a-ac62-ec1d7a30a9ac None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:49.201842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a3de4-32f7-433a-ac62-ec1d7a30a9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:49.202121 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a3de4-32f7-433a-ac62-ec1d7a30a9ac None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:49.202756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a3de4-32f7-433a-ac62-ec1d7a30a9ac None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:49.203064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a3de4-32f7-433a-ac62-ec1d7a30a9ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:49.204535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a3de4-32f7-433a-ac62-ec1d7a30a9ac None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:49.209773 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 364/719] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 17 10:12:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:49.215166 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbefeb-edef-4a5f-9091-a5e2ab71093d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:49.264601 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a4df6-7664-433f-bd6c-6cdaf5f87cae None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:49.264907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a4df6-7664-433f-bd6c-6cdaf5f87cae None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:49.265495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a4df6-7664-433f-bd6c-6cdaf5f87cae None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:49.267375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 365/720] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:12:49.272021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b29c51-a325-494a-8b69-fa301f29431f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:49.272306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b29c51-a325-494a-8b69-fa301f29431f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:49.272628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b29c51-a325-494a-8b69-fa301f29431f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:49.294390 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-06b29c51-a325-494a-8b69-fa301f29431f None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:49.295790 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-06b29c51-a325-494a-8b69-fa301f29431f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:49.327178 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbefeb-edef-4a5f-9091-a5e2ab71093d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:49.363294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707a33f-997f-46c4-85e5-118845d5426f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:49.363912 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707a33f-997f-46c4-85e5-118845d5426f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:49.364214 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707a33f-997f-46c4-85e5-118845d5426f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:49.364482 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707a33f-997f-46c4-85e5-118845d5426f None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:49.365112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707a33f-997f-46c4-85e5-118845d5426f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:49.365421 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707a33f-997f-46c4-85e5-118845d5426f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:49.366792 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707a33f-997f-46c4-85e5-118845d5426f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:49.373238 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 356/721] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 17 10:12:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:49.374189 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707a33f-997f-46c4-85e5-118845d5426f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:49.386280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 366/722] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 10:12:49.387058 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b29c51-a325-494a-8b69-fa301f29431f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:49.405252 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:49.425884 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:49.493952 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b29c51-a325-494a-8b69-fa301f29431f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:49.518016 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707a33f-997f-46c4-85e5-118845d5426f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:49.534972 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2edeeb-2ecf-4786-97d4-1163afc4c028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:49.536190 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2edeeb-2ecf-4786-97d4-1163afc4c028 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:49.536676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2edeeb-2ecf-4786-97d4-1163afc4c028 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:49.537405 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2edeeb-2ecf-4786-97d4-1163afc4c028 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:49.538669 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2edeeb-2ecf-4786-97d4-1163afc4c028 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:49.540293 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2edeeb-2ecf-4786-97d4-1163afc4c028 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:49.555680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c74a11-ba67-4fe8-8156-deca113e547b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:49.556556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c74a11-ba67-4fe8-8156-deca113e547b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:49.556864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c74a11-ba67-4fe8-8156-deca113e547b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:49.557111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c74a11-ba67-4fe8-8156-deca113e547b None admin] PATH_INFO: `/v3/services/image` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:49.557823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c74a11-ba67-4fe8-8156-deca113e547b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:49.559415 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c74a11-ba67-4fe8-8156-deca113e547b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:49.567964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 367/723] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:12:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-48c74a11-ba67-4fe8-8156-deca113e547b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:49.570366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:49.571336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:49.571336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:49.571336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:49.571336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:49.571336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:49.571336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:49.571336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:49.571336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:49.571336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:49.571336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:49.571336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:49.571336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:49.571336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:49.571336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:49.571336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:49.571336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:49.572237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:49.572237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:49.572237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:49.572237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:49.572237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:49.572237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:49.572237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:49.572237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:49.572237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:49.572237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:49.572237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:49.572237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:49.572237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 10:12:49.572237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:49.576627 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 357/724] 10.222.0.13 () {56 vars in 1105 bytes} [Mon Oct 17 10:12:49 2022] GET /identity/v3/services/image => generated 86 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:49.578029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2edeeb-2ecf-4786-97d4-1163afc4c028 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:49.662910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:49.672411 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c74a11-ba67-4fe8-8156-deca113e547b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:49.715001 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2edeeb-2ecf-4786-97d4-1163afc4c028 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:49.761410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72273817-56ab-4e04-8cb7-1d708120e4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:49.762035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72273817-56ab-4e04-8cb7-1d708120e4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:49.762317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72273817-56ab-4e04-8cb7-1d708120e4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:49.762665 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72273817-56ab-4e04-8cb7-1d708120e4e2 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:49.763321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72273817-56ab-4e04-8cb7-1d708120e4e2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:49.763632 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72273817-56ab-4e04-8cb7-1d708120e4e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:49.765400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72273817-56ab-4e04-8cb7-1d708120e4e2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:49.772654 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 368/725] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:49.780548 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72273817-56ab-4e04-8cb7-1d708120e4e2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:49.796718 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:49.801892 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c74a11-ba67-4fe8-8156-deca113e547b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:49.849791 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eede3-81a2-40bd-a6c7-84bfa850ed6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:49.850764 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eede3-81a2-40bd-a6c7-84bfa850ed6a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:49.851119 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eede3-81a2-40bd-a6c7-84bfa850ed6a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:49.851829 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eede3-81a2-40bd-a6c7-84bfa850ed6a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:49.852808 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74eede3-81a2-40bd-a6c7-84bfa850ed6a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:49.854281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74eede3-81a2-40bd-a6c7-84bfa850ed6a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d74eede3-81a2-40bd-a6c7-84bfa850ed6a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:49.865784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:49.866779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:49.866779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:49.866779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:49.866779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:49.866779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:49.866779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:49.866779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:49.866779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:49.866779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:49.866779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:49.866779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:49.866779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:49.866779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:49.866779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:49.866779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:49.866779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:49.867691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:49.867691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:49.867691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:49.867691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:49.867691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:49.867691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:49.867691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:49.867691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:49.867691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:49.867691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:49.867691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:49.867691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:49.867691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 10:12:49.867691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:49.872347 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 358/726] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:49.873547 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eede3-81a2-40bd-a6c7-84bfa850ed6a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:49.901209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72273817-56ab-4e04-8cb7-1d708120e4e2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:49.939459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:49.947864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902c7a6-c5ee-4aa6-8c9d-44b5b19ff35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:49.948674 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c7a6-c5ee-4aa6-8c9d-44b5b19ff35f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:49.949096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c7a6-c5ee-4aa6-8c9d-44b5b19ff35f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:49.949508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c7a6-c5ee-4aa6-8c9d-44b5b19ff35f None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:49.950332 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902c7a6-c5ee-4aa6-8c9d-44b5b19ff35f None admin] RBAC: Adding query filter params (type=image) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:49.951273 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902c7a6-c5ee-4aa6-8c9d-44b5b19ff35f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:49.952858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902c7a6-c5ee-4aa6-8c9d-44b5b19ff35f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:49.959914 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 369/727] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:49.982281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eede3-81a2-40bd-a6c7-84bfa850ed6a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:50.022221 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e7850-a897-4258-a2ae-c21a3e928f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:50.023221 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e7850-a897-4258-a2ae-c21a3e928f25 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:50.023700 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e7850-a897-4258-a2ae-c21a3e928f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:50.024401 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e7850-a897-4258-a2ae-c21a3e928f25 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:50.025754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e7850-a897-4258-a2ae-c21a3e928f25 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:50.026493 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e7850-a897-4258-a2ae-c21a3e928f25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:50.028617 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e7850-a897-4258-a2ae-c21a3e928f25 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:50.034794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 359/728] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 17 10:12:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:50.040637 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902c7a6-c5ee-4aa6-8c9d-44b5b19ff35f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:50.152554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902c7a6-c5ee-4aa6-8c9d-44b5b19ff35f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:50.187306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea396df-750a-4075-b846-660053d74a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:50.187917 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea396df-750a-4075-b846-660053d74a93 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:50.188225 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea396df-750a-4075-b846-660053d74a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:50.188498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea396df-750a-4075-b846-660053d74a93 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:50.189135 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea396df-750a-4075-b846-660053d74a93 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:50.189447 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea396df-750a-4075-b846-660053d74a93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:50.190932 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea396df-750a-4075-b846-660053d74a93 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:50.195760 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 370/729] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 17 10:12:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:51.089527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da07c-aa8b-46e2-b7a5-5c3068888d4f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:51.090068 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da07c-aa8b-46e2-b7a5-5c3068888d4f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:51.090068 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da07c-aa8b-46e2-b7a5-5c3068888d4f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:51.092213 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 360/730] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:51.097439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37282be-2618-4c88-a423-c6e41a7adc25 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:51.097820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37282be-2618-4c88-a423-c6e41a7adc25 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:51.098004 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37282be-2618-4c88-a423-c6e41a7adc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:51.117305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d37282be-2618-4c88-a423-c6e41a7adc25 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:51.118494 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d37282be-2618-4c88-a423-c6e41a7adc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:51.176687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:51.188906 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 371/731] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:51.457416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0da07c-aa8b-46e2-b7a5-5c3068888d4f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:51.487147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:51.566670 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0da07c-aa8b-46e2-b7a5-5c3068888d4f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:51.601172 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2fe04-f317-44cc-92b6-fb25878d9448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:51.601802 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2fe04-f317-44cc-92b6-fb25878d9448 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:51.602084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2fe04-f317-44cc-92b6-fb25878d9448 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:51.602354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2fe04-f317-44cc-92b6-fb25878d9448 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:51.602935 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2fe04-f317-44cc-92b6-fb25878d9448 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:51.604328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2fe04-f317-44cc-92b6-fb25878d9448 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-0ef2fe04-f317-44cc-92b6-fb25878d9448 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:51.613960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:51.614922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:51.614922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:51.614922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:51.614922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:51.614922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:51.614922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:51.614922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:51.614922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:51.614922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:51.614922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:51.614922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:51.614922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:51.614922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:51.614922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:51.614922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:51.614922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:51.615775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:51.615775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:51.615775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:51.615775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:51.615775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:51.615775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:51.615775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:51.615775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:51.615775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:51.615775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:51.615775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:51.615775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:51.615775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 10:12:51.615775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:51.615775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 361/732] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 17 10:12:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:51.621437 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37282be-2618-4c88-a423-c6e41a7adc25 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:51.720531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37282be-2618-4c88-a423-c6e41a7adc25 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:51.756547 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa5f2f-0444-4f38-bddc-a88d23af918e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:51.757171 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa5f2f-0444-4f38-bddc-a88d23af918e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:51.757755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa5f2f-0444-4f38-bddc-a88d23af918e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:51.758041 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa5f2f-0444-4f38-bddc-a88d23af918e None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:51.758680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa5f2f-0444-4f38-bddc-a88d23af918e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:51.758985 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa5f2f-0444-4f38-bddc-a88d23af918e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:51.760391 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa5f2f-0444-4f38-bddc-a88d23af918e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:51.765625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 372/733] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 17 10:12:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:51.771371 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2fe04-f317-44cc-92b6-fb25878d9448 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:51.871369 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:51.883392 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2fe04-f317-44cc-92b6-fb25878d9448 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:51.918653 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0373a-8c5b-4e3f-80f4-8308e3237e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:51.919341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0373a-8c5b-4e3f-80f4-8308e3237e5a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:51.919627 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0373a-8c5b-4e3f-80f4-8308e3237e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:51.919898 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0373a-8c5b-4e3f-80f4-8308e3237e5a None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:51.920562 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0373a-8c5b-4e3f-80f4-8308e3237e5a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:51.920870 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0373a-8c5b-4e3f-80f4-8308e3237e5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:51.922305 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0373a-8c5b-4e3f-80f4-8308e3237e5a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:51.927325 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 362/734] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 17 10:12:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:51.933239 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa5f2f-0444-4f38-bddc-a88d23af918e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:51.947477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caae82-4ad2-4808-8d8e-e75734fff268 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:51.947792 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caae82-4ad2-4808-8d8e-e75734fff268 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:51.948062 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caae82-4ad2-4808-8d8e-e75734fff268 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:51.950457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 363/735] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:51.954689 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30dcc7-b9cb-4ffa-bc2f-6202fc38d201 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:51.955519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30dcc7-b9cb-4ffa-bc2f-6202fc38d201 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:51.955519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30dcc7-b9cb-4ffa-bc2f-6202fc38d201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:51.975422 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6f30dcc7-b9cb-4ffa-bc2f-6202fc38d201 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:51.976705 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6f30dcc7-b9cb-4ffa-bc2f-6202fc38d201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:52.002321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:52.048768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 364/736] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 10:12:52.055656 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa5f2f-0444-4f38-bddc-a88d23af918e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:52.109338 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd0339-6e67-4e07-803f-3281290f16b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:52.109977 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd0339-6e67-4e07-803f-3281290f16b4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:52.110223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd0339-6e67-4e07-803f-3281290f16b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:52.110499 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd0339-6e67-4e07-803f-3281290f16b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:52.111215 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd0339-6e67-4e07-803f-3281290f16b4 None admin] RBAC: Adding query filter params (interface=admin, service_id=78b61c1c170746d8b0bc57051fa3d386, region_id=RegionOne) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:52.111524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd0339-6e67-4e07-803f-3281290f16b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:52.112980 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd0339-6e67-4e07-803f-3281290f16b4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:52.120983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 373/737] 10.222.0.13 () {56 vars in 1249 bytes} [Mon Oct 17 10:12:51 2022] GET /identity/v3/endpoints?service_id=78b61c1c170746d8b0bc57051fa3d386&interface=admin®ion_id=RegionOne => generated 193 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:52.127212 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30dcc7-b9cb-4ffa-bc2f-6202fc38d201 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:52.170587 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f050cc-1c29-4f2a-9cc7-f18cba99065c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:52.170862 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f050cc-1c29-4f2a-9cc7-f18cba99065c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:52.171130 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f050cc-1c29-4f2a-9cc7-f18cba99065c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:52.172799 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 374/738] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:52.177782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ca426-9776-4df8-b637-3f09333d3f99 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:52.178071 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ca426-9776-4df8-b637-3f09333d3f99 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:52.178353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ca426-9776-4df8-b637-3f09333d3f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:52.196938 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6a5ca426-9776-4df8-b637-3f09333d3f99 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:52.198130 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6a5ca426-9776-4df8-b637-3f09333d3f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:52.219674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:52.238946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30dcc7-b9cb-4ffa-bc2f-6202fc38d201 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:52.275546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafcb15-24df-4e6a-aacf-f2be9b6e9f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:52.276234 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 375/739] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 10:12:52.276718 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafcb15-24df-4e6a-aacf-f2be9b6e9f0e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:52.277199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafcb15-24df-4e6a-aacf-f2be9b6e9f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:52.277666 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafcb15-24df-4e6a-aacf-f2be9b6e9f0e None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:52.278512 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafcb15-24df-4e6a-aacf-f2be9b6e9f0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:52.280078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafcb15-24df-4e6a-aacf-f2be9b6e9f0e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:52.286735 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 365/740] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 17 10:12:52 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:12:52.329992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ca426-9776-4df8-b637-3f09333d3f99 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:52.387282 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:52.447247 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ca426-9776-4df8-b637-3f09333d3f99 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:52.486507 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3d574-a101-41eb-be79-656ea6746c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:52.487126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3d574-a101-41eb-be79-656ea6746c9c None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:52.487407 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3d574-a101-41eb-be79-656ea6746c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:52.487677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3d574-a101-41eb-be79-656ea6746c9c None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:52.488417 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3d574-a101-41eb-be79-656ea6746c9c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:52.489907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3d574-a101-41eb-be79-656ea6746c9c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:52.492609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: WARNING keystone.server.flask.common [None req-18a3d574-a101-41eb-be79-656ea6746c9c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 17 10:12:52.492908 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4c61d-b41b-46ed-8473-ac71bb3d84f1 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:52.493203 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4c61d-b41b-46ed-8473-ac71bb3d84f1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:52.493536 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4c61d-b41b-46ed-8473-ac71bb3d84f1 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:52.494925 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 366/741] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:12:52.500130 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a87154-64fc-4226-ab72-10af614949f0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:52.500415 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a87154-64fc-4226-ab72-10af614949f0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:52.500684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a87154-64fc-4226-ab72-10af614949f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:52.512750 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.sql.core [None req-18a3d574-a101-41eb-be79-656ea6746c9c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 17 10:12:52.512750 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 10:12:52.512750 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [parameters: {'id': 'b2e4686d9a7d43a1ba4502081524a5f0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 17 10:12:52.512750 dv-cinder-860209-5-smb devstack@keystone.service[81385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 17 10:12:52.520078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-18a3d574-a101-41eb-be79-656ea6746c9c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b2e4686d9a7d43a1ba4502081524a5f0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b2e4686d9a7d43a1ba4502081524a5f0. Oct 17 10:12:52.520078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:52.520078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 10:12:52.520078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 10:12:52.520078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 10:12:52.520078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 10:12:52.520078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 10:12:52.520078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 10:12:52.520078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 10:12:52.520078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application conn.query(q) Oct 17 10:12:52.520078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 10:12:52.520078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 10:12:52.520078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result.read() Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 17 10:12:52.520911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application next(self.gen) Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application yield resource Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application next(self.gen) Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.session.rollback() Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.force_reraise() Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise self.value Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application session.commit() Oct 17 10:12:52.521855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._prepare_impl() Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.session.flush() Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._flush(objects) Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application compat.raise_( Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application flush_context.execute() Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 10:12:52.522793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rec.execute(self) Oct 17 10:12:52.523867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 10:12:52.523867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 17 10:12:52.523867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 10:12:52.523867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 17 10:12:52.523867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 17 10:12:52.523867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 17 10:12:52.523867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 10:12:52.523867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 10:12:52.523867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 10:12:52.523867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 17 10:12:52.523867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 10:12:52.523867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 17 10:12:52.523867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 10:12:52.523867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 17 10:12:52.523867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application conn.query(q) Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result.read() Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 10:12:52.525689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 10:12:52.527230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 10:12:52.527230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 10:12:52.527230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 10:12:52.527230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 10:12:52.527230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 10:12:52.527230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 10:12:52.527230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 17 10:12:52.527230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 10:12:52.527230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [parameters: {'id': 'b2e4686d9a7d43a1ba4502081524a5f0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 17 10:12:52.527230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 10:12:52.527230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:52.527230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:52.527230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:52.527230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:52.527230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:52.529753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:52.533012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:52.533012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 17 10:12:52.533012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 17 10:12:52.533012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:52.533012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:52.533012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 17 10:12:52.533012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 17 10:12:52.533012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b2e4686d9a7d43a1ba4502081524a5f0. Oct 17 10:12:52.533012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:52.533012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 376/742] 10.222.0.13 () {60 vars in 1140 bytes} [Mon Oct 17 10:12:52 2022] POST /identity/v3/projects => generated 262 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:52.533012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3d574-a101-41eb-be79-656ea6746c9c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:52.540683 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-35a87154-64fc-4226-ab72-10af614949f0 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:52.542567 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-35a87154-64fc-4226-ab72-10af614949f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:52.619972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 367/743] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:52.619972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a87154-64fc-4226-ab72-10af614949f0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:52.650148 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3d574-a101-41eb-be79-656ea6746c9c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:52.654768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:52.697701 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da43517-9533-437f-90aa-05175b82878b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:52.698350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da43517-9533-437f-90aa-05175b82878b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:52.698631 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da43517-9533-437f-90aa-05175b82878b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:52.699078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da43517-9533-437f-90aa-05175b82878b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:52.708797 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da43517-9533-437f-90aa-05175b82878b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:52.710528 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da43517-9533-437f-90aa-05175b82878b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:52.715467 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:52.726024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8da43517-9533-437f-90aa-05175b82878b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:52.726024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:52.726024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:52.726024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:52.726024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:52.726024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:52.726024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:52.726024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:52.726024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:52.726024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:52.726024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:52.726024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:52.726024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:12:52.726024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:12:52.726024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:52.727054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:52.728032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:12:52.728032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:12:52.728032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:12:52.728032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:12:52.728032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:12:52.728032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:12:52.728032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:12:52.728032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:52.729955 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 377/744] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:52.735437 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da43517-9533-437f-90aa-05175b82878b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:52.750557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a87154-64fc-4226-ab72-10af614949f0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:52.793110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac23784-aaad-4429-a087-c0522a8d3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:52.793880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac23784-aaad-4429-a087-c0522a8d3ced None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:52.794236 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac23784-aaad-4429-a087-c0522a8d3ced None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:52.794573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac23784-aaad-4429-a087-c0522a8d3ced None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:52.795232 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac23784-aaad-4429-a087-c0522a8d3ced None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:52.796625 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac23784-aaad-4429-a087-c0522a8d3ced None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:52.821727 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 368/745] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 17 10:12:52 2022] POST /identity/v3/services => generated 242 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:52.855371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da43517-9533-437f-90aa-05175b82878b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:52.908759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbdcb4-089c-4864-8be7-eff8c9e39bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:52.909383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbdcb4-089c-4864-8be7-eff8c9e39bcc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:52.909716 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbdcb4-089c-4864-8be7-eff8c9e39bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:52.909990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbdcb4-089c-4864-8be7-eff8c9e39bcc None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:52.910671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbdcb4-089c-4864-8be7-eff8c9e39bcc None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:52.910969 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbdcb4-089c-4864-8be7-eff8c9e39bcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:52.912496 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbdcb4-089c-4864-8be7-eff8c9e39bcc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:52.913939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac23784-aaad-4429-a087-c0522a8d3ced None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:52.932890 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 378/746] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 17 10:12:52 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:53.046487 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac23784-aaad-4429-a087-c0522a8d3ced None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:53.086657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e2bda-f36e-418c-baa2-70fe7d7b4287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:53.087533 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e2bda-f36e-418c-baa2-70fe7d7b4287 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:53.088028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e2bda-f36e-418c-baa2-70fe7d7b4287 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:53.088471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e2bda-f36e-418c-baa2-70fe7d7b4287 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:53.089303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e2bda-f36e-418c-baa2-70fe7d7b4287 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:53.090935 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e2bda-f36e-418c-baa2-70fe7d7b4287 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:53.102262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:53.110635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 369/747] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 17 10:12:52 2022] POST /identity/v3/services => generated 242 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:12:54.565277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261417c3-2a04-42d6-8b96-d4b2b0647d01 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:54.565806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261417c3-2a04-42d6-8b96-d4b2b0647d01 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:54.565806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261417c3-2a04-42d6-8b96-d4b2b0647d01 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:54.567441 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 379/748] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:54.572698 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e957c0-c57b-4588-988a-68ddca320f10 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:54.573111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e957c0-c57b-4588-988a-68ddca320f10 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:54.573295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e957c0-c57b-4588-988a-68ddca320f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:54.592221 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c8e957c0-c57b-4588-988a-68ddca320f10 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:54.593407 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c8e957c0-c57b-4588-988a-68ddca320f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:54.669732 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 370/749] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:54 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:54.940254 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261417c3-2a04-42d6-8b96-d4b2b0647d01 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:54.962871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:55.049284 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957b360-2d63-4642-8f3c-a237042040fb None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:55.049573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957b360-2d63-4642-8f3c-a237042040fb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:55.049834 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957b360-2d63-4642-8f3c-a237042040fb None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:55.051398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 371/750] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:55.056912 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261417c3-2a04-42d6-8b96-d4b2b0647d01 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:55.068550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a61ac-624e-47a0-b667-c99d900dd44b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:55.068856 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a61ac-624e-47a0-b667-c99d900dd44b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:55.069094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a61ac-624e-47a0-b667-c99d900dd44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:55.092969 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0e6a61ac-624e-47a0-b667-c99d900dd44b None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:55.094778 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0e6a61ac-624e-47a0-b667-c99d900dd44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:55.096554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7bcef-1ad6-4c54-9960-e579480d425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:55.097189 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7bcef-1ad6-4c54-9960-e579480d425e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:55.097470 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7bcef-1ad6-4c54-9960-e579480d425e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:55.097743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7bcef-1ad6-4c54-9960-e579480d425e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:55.098332 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7bcef-1ad6-4c54-9960-e579480d425e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:55.099703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7bcef-1ad6-4c54-9960-e579480d425e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-19f7bcef-1ad6-4c54-9960-e579480d425e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:55.109125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:55.110127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:55.110127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:55.110127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:55.110127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:55.110127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:55.110127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:55.110127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:55.110127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:55.110127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:55.110127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:55.110127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:55.110127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:55.110127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:55.110127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:55.110127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:55.110127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:55.110950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:55.110950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:55.110950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:55.110950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:55.110950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:55.110950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:55.110950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:55.110950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:55.110950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:55.110950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:55.110950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:55.110950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:55.110950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 10:12:55.110950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:55.110950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 380/751] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 17 10:12:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:55.116253 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7bcef-1ad6-4c54-9960-e579480d425e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:55.183517 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 372/752] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:55 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:55.183517 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4235e1-6227-479d-9d91-367388fc440c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:55.183517 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4235e1-6227-479d-9d91-367388fc440c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:55.183517 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4235e1-6227-479d-9d91-367388fc440c None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:55.183517 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 373/753] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:55.190164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e0d4f-ac29-4e69-8023-570387bdcae7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:55.190888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e0d4f-ac29-4e69-8023-570387bdcae7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:55.191362 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e0d4f-ac29-4e69-8023-570387bdcae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:55.211779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-698e0d4f-ac29-4e69-8023-570387bdcae7 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:55.213379 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-698e0d4f-ac29-4e69-8023-570387bdcae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:55.222533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:55.243199 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7bcef-1ad6-4c54-9960-e579480d425e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:55.270273 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:55.300018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221f655-4f44-4cf8-a0e4-bb1c1f20f6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:55.300018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221f655-4f44-4cf8-a0e4-bb1c1f20f6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:55.300018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221f655-4f44-4cf8-a0e4-bb1c1f20f6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:55.300018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221f655-4f44-4cf8-a0e4-bb1c1f20f6d3 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:55.300437 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221f655-4f44-4cf8-a0e4-bb1c1f20f6d3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:55.300437 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221f655-4f44-4cf8-a0e4-bb1c1f20f6d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:55.300437 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221f655-4f44-4cf8-a0e4-bb1c1f20f6d3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:55.301147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 374/754] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:55 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 10:12:55.301785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 381/755] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 17 10:12:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:55.307024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e0d4f-ac29-4e69-8023-570387bdcae7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:55.314852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d60ae-8cb9-4ebc-8308-9a128984a9d5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:55.315136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d60ae-8cb9-4ebc-8308-9a128984a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:55.315412 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d60ae-8cb9-4ebc-8308-9a128984a9d5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:55.320041 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 382/756] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:12:55.321999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d0c9e-9ab0-4e30-bd40-2225a9761b81 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:55.322296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d0c9e-9ab0-4e30-bd40-2225a9761b81 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:55.322569 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d0c9e-9ab0-4e30-bd40-2225a9761b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:55.347904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-de4d0c9e-9ab0-4e30-bd40-2225a9761b81 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:55.350156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-de4d0c9e-9ab0-4e30-bd40-2225a9761b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:55.433444 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e0d4f-ac29-4e69-8023-570387bdcae7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:55.444741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 383/757] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:55 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:55.455265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d0c9e-9ab0-4e30-bd40-2225a9761b81 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:55.480377 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56a12c-81d1-42c7-a509-d5496057e04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:55.481847 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56a12c-81d1-42c7-a509-d5496057e04b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:55.482283 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56a12c-81d1-42c7-a509-d5496057e04b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:55.482563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56a12c-81d1-42c7-a509-d5496057e04b None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:55.483193 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56a12c-81d1-42c7-a509-d5496057e04b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:55.483502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56a12c-81d1-42c7-a509-d5496057e04b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:55.484958 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56a12c-81d1-42c7-a509-d5496057e04b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:55.494955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 375/758] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 17 10:12:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:55.495790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56a12c-81d1-42c7-a509-d5496057e04b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:55.548412 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:55.556570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:55.583641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d0c9e-9ab0-4e30-bd40-2225a9761b81 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:55.602931 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56a12c-81d1-42c7-a509-d5496057e04b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:55.617753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0648228-8e40-4aa6-9bcf-ebfbc2a3e656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:55.618646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0648228-8e40-4aa6-9bcf-ebfbc2a3e656 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:55.618922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0648228-8e40-4aa6-9bcf-ebfbc2a3e656 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:55.619337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0648228-8e40-4aa6-9bcf-ebfbc2a3e656 None admin] PATH_INFO: `/v3/services/image` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:55.619916 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0648228-8e40-4aa6-9bcf-ebfbc2a3e656 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:55.621583 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0648228-8e40-4aa6-9bcf-ebfbc2a3e656 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b0648228-8e40-4aa6-9bcf-ebfbc2a3e656 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:55.631060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:55.632040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:55.632040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:55.632040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:55.632040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:55.632040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:55.632040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:55.632040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:55.632040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:55.632040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:55.632040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:55.632040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:55.632040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:55.632040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:55.632040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:55.632040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:55.632040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:55.632903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:55.632903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:55.632903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:55.632903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:55.632903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:55.632903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:55.632903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:55.632903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:55.632903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:55.632903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:55.632903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:55.632903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:55.632903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 10:12:55.632903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:55.632903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 384/759] 10.222.0.13 () {56 vars in 1105 bytes} [Mon Oct 17 10:12:55 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:55.634203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0648228-8e40-4aa6-9bcf-ebfbc2a3e656 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:55.642686 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9527fc-9f04-4ddd-92b0-5cb2370f3b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:55.643294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9527fc-9f04-4ddd-92b0-5cb2370f3b33 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:55.643576 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9527fc-9f04-4ddd-92b0-5cb2370f3b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:55.643849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9527fc-9f04-4ddd-92b0-5cb2370f3b33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:55.644549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9527fc-9f04-4ddd-92b0-5cb2370f3b33 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:55.645905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9527fc-9f04-4ddd-92b0-5cb2370f3b33 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:55.662696 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 376/760] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:12:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:55.672972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9527fc-9f04-4ddd-92b0-5cb2370f3b33 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:55.766190 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0648228-8e40-4aa6-9bcf-ebfbc2a3e656 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:55.808266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a99bb-eb39-46c0-acbb-efd72c7ffd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:55.808491 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9527fc-9f04-4ddd-92b0-5cb2370f3b33 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:55.808884 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a99bb-eb39-46c0-acbb-efd72c7ffd07 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:55.809163 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a99bb-eb39-46c0-acbb-efd72c7ffd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:55.809974 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a99bb-eb39-46c0-acbb-efd72c7ffd07 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:55.810628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a99bb-eb39-46c0-acbb-efd72c7ffd07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:55.811512 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:55.812134 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a99bb-eb39-46c0-acbb-efd72c7ffd07 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:55.824394 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:55.828990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.sql.core [None req-5e2a99bb-eb39-46c0-acbb-efd72c7ffd07 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 17 10:12:55.828990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 17 10:12:55.828990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [parameters: {'user_id': '1b12679a929f4812aaa8d033b813c7eb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 17 10:12:55.828990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 17 10:12:55.838822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-5e2a99bb-eb39-46c0-acbb-efd72c7ffd07 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 17 10:12:55.838822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:55.838822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 10:12:55.838822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 10:12:55.838822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 10:12:55.838822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 10:12:55.838822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 10:12:55.838822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 10:12:55.838822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 10:12:55.838822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application conn.query(q) Oct 17 10:12:55.838822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 10:12:55.838822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 10:12:55.838822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 10:12:55.838822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result.read() Oct 17 10:12:55.838822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 10:12:55.839763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application next(self.gen) Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application yield resource Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application next(self.gen) Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.session.rollback() Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.force_reraise() Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise self.value Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application session.commit() Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 17 10:12:55.841263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._prepare_impl() Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.session.flush() Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._flush(objects) Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application compat.raise_( Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application flush_context.execute() Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rec.execute(self) Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 10:12:55.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 17 10:12:55.843356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 10:12:55.843356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 17 10:12:55.843356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 17 10:12:55.843356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 17 10:12:55.843356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 10:12:55.843356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 10:12:55.843356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 10:12:55.843356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 17 10:12:55.843356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 10:12:55.843356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 17 10:12:55.843356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 10:12:55.843356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 17 10:12:55.843356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 10:12:55.843356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 10:12:55.843356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 10:12:55.843356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception Oct 17 10:12:55.845719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 10:12:55.845719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 10:12:55.845719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 10:12:55.845719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 10:12:55.845719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 10:12:55.845719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 10:12:55.845719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 10:12:55.845719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application conn.query(q) Oct 17 10:12:55.845719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 10:12:55.845719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 10:12:55.845719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 10:12:55.845719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result.read() Oct 17 10:12:55.845719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 10:12:55.845719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 10:12:55.845719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 10:12:55.845719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 10:12:55.846818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 10:12:55.846818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 10:12:55.846818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 10:12:55.846818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 10:12:55.846818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 17 10:12:55.846818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 17 10:12:55.846818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [parameters: {'user_id': '1b12679a929f4812aaa8d033b813c7eb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 17 10:12:55.846818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 10:12:55.846818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:55.846818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:55.846818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:55.846818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:55.846818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:55.846818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:55.846818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 17 10:12:55.847804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 17 10:12:55.848926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 17 10:12:55.848926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 17 10:12:55.848926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 17 10:12:55.848926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 17 10:12:55.848926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 17 10:12:55.848926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:55.848926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 385/761] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Oct 17 10:12:55 2022] POST /identity/v3/users => generated 160 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:55.848926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a99bb-eb39-46c0-acbb-efd72c7ffd07 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:55.851898 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242123a-a35d-41f2-9e5c-4c103a9487d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:55.853484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242123a-a35d-41f2-9e5c-4c103a9487d4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:55.853484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242123a-a35d-41f2-9e5c-4c103a9487d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:55.853484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242123a-a35d-41f2-9e5c-4c103a9487d4 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:55.853700 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242123a-a35d-41f2-9e5c-4c103a9487d4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:55.853993 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242123a-a35d-41f2-9e5c-4c103a9487d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:55.855402 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242123a-a35d-41f2-9e5c-4c103a9487d4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:55.864818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 377/762] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:55.864818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242123a-a35d-41f2-9e5c-4c103a9487d4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:55.955833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a99bb-eb39-46c0-acbb-efd72c7ffd07 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:55.977289 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242123a-a35d-41f2-9e5c-4c103a9487d4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:55.990129 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c3387-7dd3-469c-b304-f48fa7892c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:55.990869 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c3387-7dd3-469c-b304-f48fa7892c82 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:55.991273 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c3387-7dd3-469c-b304-f48fa7892c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:55.991641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c3387-7dd3-469c-b304-f48fa7892c82 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:55.992354 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c3387-7dd3-469c-b304-f48fa7892c82 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:55.993996 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c3387-7dd3-469c-b304-f48fa7892c82 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-fd2c3387-7dd3-469c-b304-f48fa7892c82 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:56.002770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:56.003981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:56.003981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:56.003981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:56.003981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:56.003981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:56.003981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:56.003981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:56.003981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:56.003981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:56.003981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:56.003981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:56.003981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:56.003981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:56.003981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:56.003981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:56.003981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:56.005020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:56.005020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:56.005020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:56.005020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:56.005020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:56.005020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:56.005020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:56.005020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:56.005020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:56.005020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:56.005020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:56.005020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:56.005020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 10:12:56.005020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:56.005913 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 386/763] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:56.006757 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c3387-7dd3-469c-b304-f48fa7892c82 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:56.021682 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e88cd-21d2-4d17-a5fb-c246072bae25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:56.022228 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e88cd-21d2-4d17-a5fb-c246072bae25 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:56.022510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e88cd-21d2-4d17-a5fb-c246072bae25 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:56.022777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e88cd-21d2-4d17-a5fb-c246072bae25 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:56.031252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e88cd-21d2-4d17-a5fb-c246072bae25 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:56.032709 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e88cd-21d2-4d17-a5fb-c246072bae25 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:56.044916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e86e88cd-21d2-4d17-a5fb-c246072bae25 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 10:12:56.044916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:56.044916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:56.044916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:56.044916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:56.044916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:56.044916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:56.044916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:56.044916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:56.044916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:56.044916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:56.044916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:56.044916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:12:56.044916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:12:56.044916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:12:56.044916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:56.046083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:56.047240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:56.047240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:56.047240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:12:56.047240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:12:56.047240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:12:56.047240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:12:56.047240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:12:56.047240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:12:56.047240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 10:12:56.047240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:56.048879 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 378/764] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:12:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:12:56.049535 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e88cd-21d2-4d17-a5fb-c246072bae25 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:56.083621 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:56.088472 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:56.124929 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c3387-7dd3-469c-b304-f48fa7892c82 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:56.161907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d40fb-c82a-4347-888c-90aae2fb642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:56.162685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d40fb-c82a-4347-888c-90aae2fb642a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:56.163211 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d40fb-c82a-4347-888c-90aae2fb642a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:56.163377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d40fb-c82a-4347-888c-90aae2fb642a None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:56.164166 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d40fb-c82a-4347-888c-90aae2fb642a None admin] RBAC: Adding query filter params (type=image) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:56.164481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d40fb-c82a-4347-888c-90aae2fb642a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:56.165922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d40fb-c82a-4347-888c-90aae2fb642a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:56.166346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e88cd-21d2-4d17-a5fb-c246072bae25 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:56.178676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 387/765] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:56.179433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d40fb-c82a-4347-888c-90aae2fb642a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:56.207785 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cc423-a922-4efb-a841-a84fad972707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:56.208420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cc423-a922-4efb-a841-a84fad972707 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:56.208696 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cc423-a922-4efb-a841-a84fad972707 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:56.208963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cc423-a922-4efb-a841-a84fad972707 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:56.209612 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0cc423-a922-4efb-a841-a84fad972707 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:56.209921 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0cc423-a922-4efb-a841-a84fad972707 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:56.211272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0cc423-a922-4efb-a841-a84fad972707 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:56.216477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 379/766] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 17 10:12:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:56.217139 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cc423-a922-4efb-a841-a84fad972707 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:56.291986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d40fb-c82a-4347-888c-90aae2fb642a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:56.315943 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:56.321913 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:56.327833 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cc423-a922-4efb-a841-a84fad972707 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:56.330757 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300802bb-96e5-4d87-aa59-07721035c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:56.330914 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300802bb-96e5-4d87-aa59-07721035c131 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:56.331057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300802bb-96e5-4d87-aa59-07721035c131 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:56.331326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300802bb-96e5-4d87-aa59-07721035c131 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:56.332055 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300802bb-96e5-4d87-aa59-07721035c131 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:56.332359 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300802bb-96e5-4d87-aa59-07721035c131 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:56.333798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300802bb-96e5-4d87-aa59-07721035c131 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:56.363750 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36ee1d-7509-4e51-9eea-6033bfb07deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:56.364377 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36ee1d-7509-4e51-9eea-6033bfb07deb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:56.364652 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36ee1d-7509-4e51-9eea-6033bfb07deb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:56.364918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36ee1d-7509-4e51-9eea-6033bfb07deb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:56.365606 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36ee1d-7509-4e51-9eea-6033bfb07deb None admin] RBAC: Adding query filter params (interface=public, service_id=294cb81d60554fce8540e73093d87449, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:56.365911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36ee1d-7509-4e51-9eea-6033bfb07deb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:56.367252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36ee1d-7509-4e51-9eea-6033bfb07deb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:56.369843 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 388/767] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 17 10:12:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:56.370688 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300802bb-96e5-4d87-aa59-07721035c131 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:56.394723 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 380/768] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Oct 17 10:12:56 2022] GET /identity/v3/endpoints?service_id=294cb81d60554fce8540e73093d87449&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:56.400521 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36ee1d-7509-4e51-9eea-6033bfb07deb None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:56.504447 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300802bb-96e5-4d87-aa59-07721035c131 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:56.519294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36ee1d-7509-4e51-9eea-6033bfb07deb None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:56.543655 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b948b-db4a-4fcd-939d-fbae5fceccb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:56.544690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b948b-db4a-4fcd-939d-fbae5fceccb8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:56.545111 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b948b-db4a-4fcd-939d-fbae5fceccb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:56.545571 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b948b-db4a-4fcd-939d-fbae5fceccb8 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:56.546464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b948b-db4a-4fcd-939d-fbae5fceccb8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:56.546913 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b948b-db4a-4fcd-939d-fbae5fceccb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:56.548734 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b948b-db4a-4fcd-939d-fbae5fceccb8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:56.554985 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 389/769] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 17 10:12:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:56.557642 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c01550-00cc-4097-9956-6edaf039e49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:56.558432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c01550-00cc-4097-9956-6edaf039e49c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:56.558852 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c01550-00cc-4097-9956-6edaf039e49c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:56.559835 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c01550-00cc-4097-9956-6edaf039e49c None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:56.561323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b948b-db4a-4fcd-939d-fbae5fceccb8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:56.562063 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c01550-00cc-4097-9956-6edaf039e49c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:56.563439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c01550-00cc-4097-9956-6edaf039e49c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:56.571868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 381/770] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 17 10:12:56 2022] GET /identity/v3/services => generated 1957 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:12:56.629634 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:56.692451 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b948b-db4a-4fcd-939d-fbae5fceccb8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:56.732611 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fa4be-c25e-4872-8a8d-a35de1474dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:56.733323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fa4be-c25e-4872-8a8d-a35de1474dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:56.733664 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fa4be-c25e-4872-8a8d-a35de1474dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:56.734061 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fa4be-c25e-4872-8a8d-a35de1474dd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:56.734850 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fa4be-c25e-4872-8a8d-a35de1474dd5 None admin] RBAC: Adding query filter params (interface=public, service_id=9ef4a286db2344e1af7e92be39ba7fb2, region_id=RegionOne) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:56.735232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fa4be-c25e-4872-8a8d-a35de1474dd5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:56.736744 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fa4be-c25e-4872-8a8d-a35de1474dd5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:56.742898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 390/771] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Oct 17 10:12:56 2022] GET /identity/v3/endpoints?service_id=9ef4a286db2344e1af7e92be39ba7fb2&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:56.749135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c01550-00cc-4097-9956-6edaf039e49c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:56.773627 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:56.852323 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c01550-00cc-4097-9956-6edaf039e49c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:56.886781 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847535f6-5b6e-4f39-be0c-d4951f01833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:56.887502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847535f6-5b6e-4f39-be0c-d4951f01833a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:56.887847 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847535f6-5b6e-4f39-be0c-d4951f01833a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:56.888208 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847535f6-5b6e-4f39-be0c-d4951f01833a None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:56.888876 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847535f6-5b6e-4f39-be0c-d4951f01833a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:56.890291 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847535f6-5b6e-4f39-be0c-d4951f01833a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:56.896970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 382/772] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 17 10:12:56 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:12:57.873002 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf34e65-e00b-44f4-9e03-ad83a095fb9c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:57.873518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf34e65-e00b-44f4-9e03-ad83a095fb9c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:57.873594 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf34e65-e00b-44f4-9e03-ad83a095fb9c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:57.874913 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 391/773] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:57.880023 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4a547-ee84-4276-baf2-6ae30cabb187 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:57.880415 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4a547-ee84-4276-baf2-6ae30cabb187 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:57.880573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4a547-ee84-4276-baf2-6ae30cabb187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:57.898394 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-79d4a547-ee84-4276-baf2-6ae30cabb187 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:57.899563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-79d4a547-ee84-4276-baf2-6ae30cabb187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:57.964547 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 383/774] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:57 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:58.230456 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf34e65-e00b-44f4-9e03-ad83a095fb9c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:58.331550 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf34e65-e00b-44f4-9e03-ad83a095fb9c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:58.345457 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:58.367041 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69334c40-5057-4bf2-bc75-2094a11998f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:58.367673 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69334c40-5057-4bf2-bc75-2094a11998f9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:58.367968 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69334c40-5057-4bf2-bc75-2094a11998f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:58.368246 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69334c40-5057-4bf2-bc75-2094a11998f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:58.369368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69334c40-5057-4bf2-bc75-2094a11998f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:58.370810 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69334c40-5057-4bf2-bc75-2094a11998f9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:58.373127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 392/775] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:58.378630 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4a547-ee84-4276-baf2-6ae30cabb187 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:58.393462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:58.476959 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4a547-ee84-4276-baf2-6ae30cabb187 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:58.510657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1c873-b4a6-488f-a6bf-3ec02bd1edb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:58.511524 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1c873-b4a6-488f-a6bf-3ec02bd1edb7 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:58.512045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1c873-b4a6-488f-a6bf-3ec02bd1edb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:58.512528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1c873-b4a6-488f-a6bf-3ec02bd1edb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:58.513377 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1c873-b4a6-488f-a6bf-3ec02bd1edb7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:58.514984 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1c873-b4a6-488f-a6bf-3ec02bd1edb7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:58.542966 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 384/776] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 17 10:12:58 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:58.732105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360136-c408-4817-aac7-9979637a64ab None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:58.732498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360136-c408-4817-aac7-9979637a64ab None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:58.732676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360136-c408-4817-aac7-9979637a64ab None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:58.733996 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 393/777] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:58.739171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9fd3-06cf-4314-8291-48f15be61804 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:58.739456 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9fd3-06cf-4314-8291-48f15be61804 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:58.739726 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9fd3-06cf-4314-8291-48f15be61804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:58.757978 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6efe9fd3-06cf-4314-8291-48f15be61804 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:58.759147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6efe9fd3-06cf-4314-8291-48f15be61804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:58.819182 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:58.827799 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 385/778] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:58 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:59.047281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab10873-7c1d-4e76-ba80-731c3f5bf09d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:59.047795 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab10873-7c1d-4e76-ba80-731c3f5bf09d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:59.047870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab10873-7c1d-4e76-ba80-731c3f5bf09d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:59.049331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 394/779] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:12:59.054516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299602e-5168-4777-b4a3-bf21a35f2e54 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:59.054900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299602e-5168-4777-b4a3-bf21a35f2e54 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:59.055081 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299602e-5168-4777-b4a3-bf21a35f2e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:59.073417 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9299602e-5168-4777-b4a3-bf21a35f2e54 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:12:59.074550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9299602e-5168-4777-b4a3-bf21a35f2e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:12:59.098418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab10873-7c1d-4e76-ba80-731c3f5bf09d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:59.144825 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 386/780] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:12:59 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:12:59.202868 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab10873-7c1d-4e76-ba80-731c3f5bf09d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:59.237297 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0d3f9-b319-41aa-9ad3-36127059ef9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:59.237934 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0d3f9-b319-41aa-9ad3-36127059ef9c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:59.238209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0d3f9-b319-41aa-9ad3-36127059ef9c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:59.238478 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0d3f9-b319-41aa-9ad3-36127059ef9c None admin] PATH_INFO: `/v3/services/image` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:59.239057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0d3f9-b319-41aa-9ad3-36127059ef9c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:59.240469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0d3f9-b319-41aa-9ad3-36127059ef9c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-69c0d3f9-b319-41aa-9ad3-36127059ef9c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:59.249576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:59.250534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:59.250534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:59.250534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:59.250534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:59.250534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:59.250534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:59.250534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:59.250534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:59.250534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:59.250534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:59.250534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:59.250534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:59.250534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:59.250534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:59.250534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:59.250534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:59.252910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:59.252910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:59.252910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:59.252910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:59.252910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:59.252910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:59.252910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:59.252910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:59.252910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:59.252910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:59.252910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:59.252910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:59.252910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 10:12:59.252910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:12:59.252910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 395/781] 10.222.0.13 () {56 vars in 1105 bytes} [Mon Oct 17 10:12:59 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:59.256570 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299602e-5168-4777-b4a3-bf21a35f2e54 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:59.357408 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299602e-5168-4777-b4a3-bf21a35f2e54 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:59.382553 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:59.393046 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d0376-2a56-46ad-9362-69dd04f88d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:59.393659 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0376-2a56-46ad-9362-69dd04f88d73 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:59.393936 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0376-2a56-46ad-9362-69dd04f88d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:59.394206 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0376-2a56-46ad-9362-69dd04f88d73 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:59.394835 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d0376-2a56-46ad-9362-69dd04f88d73 None admin] RBAC: Adding query filter params (name=image) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:59.395142 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d0376-2a56-46ad-9362-69dd04f88d73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:59.396531 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d0376-2a56-46ad-9362-69dd04f88d73 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:59.405978 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 387/782] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:59.409000 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0d3f9-b319-41aa-9ad3-36127059ef9c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:59.415955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d0376-2a56-46ad-9362-69dd04f88d73 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:59.463210 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:59.524774 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d0376-2a56-46ad-9362-69dd04f88d73 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:59.525640 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0d3f9-b319-41aa-9ad3-36127059ef9c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:59.558145 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d751f4c-66ec-4740-bdc6-fa549fe130c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:59.558768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d751f4c-66ec-4740-bdc6-fa549fe130c3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:59.559039 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d751f4c-66ec-4740-bdc6-fa549fe130c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:59.559872 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d751f4c-66ec-4740-bdc6-fa549fe130c3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:59.560439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d751f4c-66ec-4740-bdc6-fa549fe130c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:59.560539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc253e-5301-4beb-81fa-187f29aa12e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:59.561053 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc253e-5301-4beb-81fa-187f29aa12e1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:59.561333 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc253e-5301-4beb-81fa-187f29aa12e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:59.561605 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc253e-5301-4beb-81fa-187f29aa12e1 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:59.561785 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d751f4c-66ec-4740-bdc6-fa549fe130c3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:59.562233 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc253e-5301-4beb-81fa-187f29aa12e1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:59.562539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc253e-5301-4beb-81fa-187f29aa12e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:59.563898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc253e-5301-4beb-81fa-187f29aa12e1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:59.568800 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 396/783] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:12:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-7d751f4c-66ec-4740-bdc6-fa549fe130c3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:12:59.573471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:12:59.574498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:12:59.574498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:12:59.574498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:12:59.574498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:12:59.574498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:12:59.574498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:12:59.574498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:12:59.574498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:12:59.574498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:12:59.574498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:12:59.574498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:12:59.574498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:12:59.574498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:12:59.574498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:12:59.574498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:12:59.574498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:12:59.575903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:12:59.575903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:12:59.575903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:12:59.575903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:12:59.575903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:12:59.575903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:12:59.575903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:12:59.575903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:12:59.575903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:12:59.575903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:12:59.575903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:12:59.575903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:12:59.575903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 10:12:59.575903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:12:59.575903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 388/784] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:12:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:12:59.578255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d751f4c-66ec-4740-bdc6-fa549fe130c3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:59.578361 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc253e-5301-4beb-81fa-187f29aa12e1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:59.637741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:59.681559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc253e-5301-4beb-81fa-187f29aa12e1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:59.685989 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d751f4c-66ec-4740-bdc6-fa549fe130c3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:59.692200 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:59.718905 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfddf8-819d-4100-bf25-b4fd6ca876d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:59.719515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfddf8-819d-4100-bf25-b4fd6ca876d7 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:59.719795 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfddf8-819d-4100-bf25-b4fd6ca876d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:59.720153 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfddf8-819d-4100-bf25-b4fd6ca876d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:59.720758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfddf8-819d-4100-bf25-b4fd6ca876d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:59.722122 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfddf8-819d-4100-bf25-b4fd6ca876d7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:59.723088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711a026-80f1-4926-a2fc-ba3326d1a404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:59.723689 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a026-80f1-4926-a2fc-ba3326d1a404 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:59.723994 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a026-80f1-4926-a2fc-ba3326d1a404 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:59.724267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a026-80f1-4926-a2fc-ba3326d1a404 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:59.724893 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711a026-80f1-4926-a2fc-ba3326d1a404 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:59.725201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711a026-80f1-4926-a2fc-ba3326d1a404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:59.726563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711a026-80f1-4926-a2fc-ba3326d1a404 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:59.736698 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 389/785] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 17 10:12:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:12:59.738072 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711a026-80f1-4926-a2fc-ba3326d1a404 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:12:59.747030 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 397/786] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:12:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:12:59.859648 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711a026-80f1-4926-a2fc-ba3326d1a404 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:12:59.879037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:12:59.905409 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbf718-d64d-4b40-9555-6cbb853b60f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:12:59.905942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbf718-d64d-4b40-9555-6cbb853b60f1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:12:59.906218 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbf718-d64d-4b40-9555-6cbb853b60f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:12:59.906489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbf718-d64d-4b40-9555-6cbb853b60f1 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:12:59.907116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbf718-d64d-4b40-9555-6cbb853b60f1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:12:59.907417 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbf718-d64d-4b40-9555-6cbb853b60f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:12:59.908874 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbf718-d64d-4b40-9555-6cbb853b60f1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:12:59.914437 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 390/787] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 17 10:12:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:12:59.920580 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfddf8-819d-4100-bf25-b4fd6ca876d7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:00.023484 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfddf8-819d-4100-bf25-b4fd6ca876d7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:00.060489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10029ad7-e840-47fa-8377-d3e8159d19eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:00.061270 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10029ad7-e840-47fa-8377-d3e8159d19eb None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:00.061437 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10029ad7-e840-47fa-8377-d3e8159d19eb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:00.061692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10029ad7-e840-47fa-8377-d3e8159d19eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:00.062360 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10029ad7-e840-47fa-8377-d3e8159d19eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:00.063733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10029ad7-e840-47fa-8377-d3e8159d19eb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:00.090293 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 398/788] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:12:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:13:00.746651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ec6d4-01be-490c-bb4e-a97b66b9e385 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:00.747215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ec6d4-01be-490c-bb4e-a97b66b9e385 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:00.747293 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ec6d4-01be-490c-bb4e-a97b66b9e385 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:00.748658 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 391/789] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:00.753724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c26220-ee72-46da-a66d-ae94e319fd5d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:00.754011 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c26220-ee72-46da-a66d-ae94e319fd5d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:00.754283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c26220-ee72-46da-a66d-ae94e319fd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:00.772470 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b8c26220-ee72-46da-a66d-ae94e319fd5d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:00.773975 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b8c26220-ee72-46da-a66d-ae94e319fd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:00.791157 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:00.849090 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 399/790] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:13:01.112656 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ec6d4-01be-490c-bb4e-a97b66b9e385 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:01.212675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ec6d4-01be-490c-bb4e-a97b66b9e385 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:01.245619 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdef9e-f324-4a22-90ac-ddc09556ce3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:01.246235 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdef9e-f324-4a22-90ac-ddc09556ce3a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:01.246508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdef9e-f324-4a22-90ac-ddc09556ce3a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:01.246834 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdef9e-f324-4a22-90ac-ddc09556ce3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:01.247949 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdef9e-f324-4a22-90ac-ddc09556ce3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:01.249368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdef9e-f324-4a22-90ac-ddc09556ce3a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:01.251129 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 392/791] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:13:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:01.256548 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c26220-ee72-46da-a66d-ae94e319fd5d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:01.355325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c26220-ee72-46da-a66d-ae94e319fd5d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:01.390380 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a26066-47e7-497a-af40-acd85926e3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:01.390991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a26066-47e7-497a-af40-acd85926e3f2 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:01.391266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a26066-47e7-497a-af40-acd85926e3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:01.391535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a26066-47e7-497a-af40-acd85926e3f2 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:01.392222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a26066-47e7-497a-af40-acd85926e3f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:01.393681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a26066-47e7-497a-af40-acd85926e3f2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:01.415565 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 400/792] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:13:01 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:13:01.920272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af372679-1046-49be-baa7-4d9f2919c9e6 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:01.920786 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af372679-1046-49be-baa7-4d9f2919c9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:01.920869 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af372679-1046-49be-baa7-4d9f2919c9e6 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:01.922280 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 393/793] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:01.927271 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736b76c-c373-4875-a8e2-3a6977099104 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:01.927572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736b76c-c373-4875-a8e2-3a6977099104 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:01.927846 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736b76c-c373-4875-a8e2-3a6977099104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:01.935091 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:01.946658 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3736b76c-c373-4875-a8e2-3a6977099104 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:01.947835 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3736b76c-c373-4875-a8e2-3a6977099104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:02.019968 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 401/794] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:13:02.285374 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af372679-1046-49be-baa7-4d9f2919c9e6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:02.314944 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f5c92-1f2c-4c8d-9c81-7fe739b878eb None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:02.315481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f5c92-1f2c-4c8d-9c81-7fe739b878eb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:02.315481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f5c92-1f2c-4c8d-9c81-7fe739b878eb None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:02.316910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 402/795] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:02.322308 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143595ca-6669-4bf4-974c-b9b5f540ed74 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:02.322593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143595ca-6669-4bf4-974c-b9b5f540ed74 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:02.322865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143595ca-6669-4bf4-974c-b9b5f540ed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:02.338384 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:02.341900 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-143595ca-6669-4bf4-974c-b9b5f540ed74 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:02.343085 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-143595ca-6669-4bf4-974c-b9b5f540ed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:02.396336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af372679-1046-49be-baa7-4d9f2919c9e6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:02.411303 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 403/796] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 10:13:02.431543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f485dd1-09fa-49ac-826d-6b27a882a9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:02.432510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f485dd1-09fa-49ac-826d-6b27a882a9f0 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:02.432985 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f485dd1-09fa-49ac-826d-6b27a882a9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:02.433479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f485dd1-09fa-49ac-826d-6b27a882a9f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:02.434836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f485dd1-09fa-49ac-826d-6b27a882a9f0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:02.436405 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f485dd1-09fa-49ac-826d-6b27a882a9f0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:02.444827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.sql.core [None req-9f485dd1-09fa-49ac-826d-6b27a882a9f0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 10:13:02.444827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 10:13:02.444827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [parameters: {'id': '57f52b62000c4bab987af3667024f929', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 17 10:13:02.444827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81386) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 17 10:13:02.453281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9f485dd1-09fa-49ac-826d-6b27a882a9f0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 17 10:13:02.453281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:02.453281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 10:13:02.453281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 10:13:02.453281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 10:13:02.453281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 10:13:02.453281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 10:13:02.453281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 10:13:02.453281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 10:13:02.453281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application conn.query(q) Oct 17 10:13:02.453281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 10:13:02.453281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 10:13:02.453281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 10:13:02.453281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result.read() Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 17 10:13:02.454249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application next(self.gen) Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application yield resource Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application next(self.gen) Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.session.rollback() Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.force_reraise() Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise self.value Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application session.commit() Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 17 10:13:02.455389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._prepare_impl() Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.session.flush() Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._flush(objects) Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application compat.raise_( Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application flush_context.execute() Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rec.execute(self) Oct 17 10:13:02.456498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 10:13:02.457579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 17 10:13:02.457579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 10:13:02.457579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 17 10:13:02.457579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 17 10:13:02.457579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 17 10:13:02.457579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 10:13:02.457579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 10:13:02.457579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 10:13:02.457579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 17 10:13:02.457579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 10:13:02.457579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 17 10:13:02.457579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 10:13:02.457579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 17 10:13:02.457579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 10:13:02.457579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application conn.query(q) Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result.read() Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 10:13:02.458516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 10:13:02.459657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 10:13:02.459657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 10:13:02.459657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 10:13:02.459657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 10:13:02.459657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 10:13:02.459657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 10:13:02.459657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 10:13:02.459657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [parameters: {'id': '57f52b62000c4bab987af3667024f929', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 17 10:13:02.459657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 10:13:02.459657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:13:02.459657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:13:02.459657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:13:02.459657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:02.459657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 17 10:13:02.459657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:02.461387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:02.463525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 17 10:13:02.463525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 17 10:13:02.463525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:02.463525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:02.463525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 17 10:13:02.463525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 17 10:13:02.463525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:02.463525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:02.463525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 17 10:13:02.463525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 17 10:13:02.463525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 17 10:13:02.463525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:13:02.467518 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 394/797] 10.222.0.13 () {60 vars in 1137 bytes} [Mon Oct 17 10:13:02 2022] POST /identity/v3/domains => generated 190 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:13:02.467685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143595ca-6669-4bf4-974c-b9b5f540ed74 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:02.530346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:02.569272 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143595ca-6669-4bf4-974c-b9b5f540ed74 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:02.602755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e32e6-3639-4873-b875-6709181ec204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:02.603643 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e32e6-3639-4873-b875-6709181ec204 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:02.604157 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e32e6-3639-4873-b875-6709181ec204 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:02.604618 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e32e6-3639-4873-b875-6709181ec204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:02.615483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e32e6-3639-4873-b875-6709181ec204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:02.617263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e32e6-3639-4873-b875-6709181ec204 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:02.632114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-0f9e32e6-3639-4873-b875-6709181ec204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:13:02.632114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:02.632114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:02.632114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:02.632114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:02.632114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:02.632114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:02.632114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:02.632114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:02.632114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:02.632114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:02.632114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:02.632114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:13:02.632114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:13:02.632114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:13:02.632114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:02.633057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:13:02.633943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:13:02.633943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:13:02.633943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:13:02.633943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 404/798] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:13:02.639536 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f485dd1-09fa-49ac-826d-6b27a882a9f0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:02.683806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e32e6-3639-4873-b875-6709181ec204 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:02.741659 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f485dd1-09fa-49ac-826d-6b27a882a9f0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:02.752062 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:02.779953 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c62ed-6a75-4116-8f1f-5ec9e75263a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:02.780972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c62ed-6a75-4116-8f1f-5ec9e75263a2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:02.781257 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c62ed-6a75-4116-8f1f-5ec9e75263a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:02.781680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c62ed-6a75-4116-8f1f-5ec9e75263a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:02.782329 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c62ed-6a75-4116-8f1f-5ec9e75263a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:02.782637 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c62ed-6a75-4116-8f1f-5ec9e75263a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:02.784019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c62ed-6a75-4116-8f1f-5ec9e75263a2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:02.794953 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e32e6-3639-4873-b875-6709181ec204 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:02.799365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 395/799] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:13:02.814067 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:02.835287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cda9e5-3e77-4edf-a124-1be7b72222e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:02.835839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cda9e5-3e77-4edf-a124-1be7b72222e0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:02.836165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cda9e5-3e77-4edf-a124-1be7b72222e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:02.836437 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cda9e5-3e77-4edf-a124-1be7b72222e0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:02.848723 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cda9e5-3e77-4edf-a124-1be7b72222e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:13:02.853696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-84cda9e5-3e77-4edf-a124-1be7b72222e0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 10:13:02.853696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:02.853696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:02.853696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:02.853696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:02.853696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:02.853696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:02.853696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:02.853696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:02.853696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:02.853696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:02.853696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:02.853696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:13:02.853696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:13:02.853696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:13:02.853696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:13:02.854758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:13:02.854758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:13:02.854758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:13:02.854758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:13:02.854758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:02.854758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:02.854758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:02.854758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:02.854758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:02.854758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:02.854758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:02.854758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:02.854758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:02.854758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:02.854758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:02.854758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:02.861127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:02.861127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:02.861127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:02.861127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:02.861127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:13:02.861127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:13:02.861127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:13:02.861127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:13:02.861127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:13:02.861127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:13:02.861127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 10:13:02.861127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:13:02.861127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 405/800] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Oct 17 10:13:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:13:02.862167 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c62ed-6a75-4116-8f1f-5ec9e75263a2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:02.970717 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c62ed-6a75-4116-8f1f-5ec9e75263a2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:03.009587 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41201d17-da4a-47ed-b59e-9ab656c91a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:03.010181 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41201d17-da4a-47ed-b59e-9ab656c91a38 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:03.010454 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41201d17-da4a-47ed-b59e-9ab656c91a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:03.010719 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41201d17-da4a-47ed-b59e-9ab656c91a38 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:03.011385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41201d17-da4a-47ed-b59e-9ab656c91a38 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:03.011662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41201d17-da4a-47ed-b59e-9ab656c91a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:03.013132 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41201d17-da4a-47ed-b59e-9ab656c91a38 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:03.021684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 396/801] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Oct 17 10:13:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:03.027056 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cda9e5-3e77-4edf-a124-1be7b72222e0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:03.135715 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cda9e5-3e77-4edf-a124-1be7b72222e0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:03.168113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30511b0-6533-4f21-b572-2080187fc46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:03.169305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30511b0-6533-4f21-b572-2080187fc46e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:03.169583 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30511b0-6533-4f21-b572-2080187fc46e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:03.169850 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30511b0-6533-4f21-b572-2080187fc46e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:03.179880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30511b0-6533-4f21-b572-2080187fc46e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:03.181334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30511b0-6533-4f21-b572-2080187fc46e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:03.194907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e30511b0-6533-4f21-b572-2080187fc46e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:13:03.194907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:03.194907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:03.194907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:03.194907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:03.194907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:03.194907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:03.194907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:03.194907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:03.194907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:03.194907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:03.194907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:03.194907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:13:03.194907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:13:03.194907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:13:03.194907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:03.195895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:13:03.196818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:13:03.196818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:13:03.196818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:13:03.196818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 406/802] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:13:03.201691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41201d17-da4a-47ed-b59e-9ab656c91a38 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:03.346963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:03.412413 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41201d17-da4a-47ed-b59e-9ab656c91a38 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:03.445254 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0f59c-da28-4551-b2d4-63a050461458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:03.445844 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f59c-da28-4551-b2d4-63a050461458 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:03.446115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f59c-da28-4551-b2d4-63a050461458 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:03.446376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f59c-da28-4551-b2d4-63a050461458 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:03.447001 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0f59c-da28-4551-b2d4-63a050461458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:03.447296 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0f59c-da28-4551-b2d4-63a050461458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:03.448653 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0f59c-da28-4551-b2d4-63a050461458 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:03.459863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 397/803] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:13:03.465963 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30511b0-6533-4f21-b572-2080187fc46e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:03.496452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:03.565700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30511b0-6533-4f21-b572-2080187fc46e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:03.580622 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024e64c-1fcb-43d7-8486-3548bb65570e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:03.580909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024e64c-1fcb-43d7-8486-3548bb65570e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:03.581183 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024e64c-1fcb-43d7-8486-3548bb65570e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:03.582498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 398/804] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:13:03.587279 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0088d1-1da4-46ec-a560-37ef8638e36c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:03.587559 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0088d1-1da4-46ec-a560-37ef8638e36c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:03.587825 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0088d1-1da4-46ec-a560-37ef8638e36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:03.598429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053eaf4-641a-46df-b46b-837bbf4299e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:03.599048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053eaf4-641a-46df-b46b-837bbf4299e8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:03.599328 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053eaf4-641a-46df-b46b-837bbf4299e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:03.599597 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053eaf4-641a-46df-b46b-837bbf4299e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:03.605339 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0a0088d1-1da4-46ec-a560-37ef8638e36c None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:03.607263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0a0088d1-1da4-46ec-a560-37ef8638e36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:03.607604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053eaf4-641a-46df-b46b-837bbf4299e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:03.609088 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053eaf4-641a-46df-b46b-837bbf4299e8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:03.619888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-0053eaf4-641a-46df-b46b-837bbf4299e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 10:13:03.619888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:03.619888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:03.619888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:03.619888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:03.619888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:03.619888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:03.619888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:03.619888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:03.619888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:03.619888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:03.619888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:03.619888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:13:03.619888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:13:03.619888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:13:03.619888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:03.620902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:03.622530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:03.622530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:03.622530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:13:03.622530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:13:03.622530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:13:03.622530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:13:03.622530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:13:03.622530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:13:03.622530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 10:13:03.622530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:13:03.622530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 407/805] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Oct 17 10:13:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:13:03.627206 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053eaf4-641a-46df-b46b-837bbf4299e8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:03.674549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 399/806] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 10:13:03.711747 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:03.724061 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053eaf4-641a-46df-b46b-837bbf4299e8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:03.756573 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca2707-101b-4e06-8919-741b2495af59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:03.757172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca2707-101b-4e06-8919-741b2495af59 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:03.757455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca2707-101b-4e06-8919-741b2495af59 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:03.757715 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca2707-101b-4e06-8919-741b2495af59 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:03.758437 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca2707-101b-4e06-8919-741b2495af59 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:03.758740 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca2707-101b-4e06-8919-741b2495af59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:03.760196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca2707-101b-4e06-8919-741b2495af59 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:03.776653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 408/807] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Oct 17 10:13:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:13:03.783049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0088d1-1da4-46ec-a560-37ef8638e36c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:03.806180 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:03.876789 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0088d1-1da4-46ec-a560-37ef8638e36c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:03.908484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202bc74-e76c-48f0-b4bd-0639705fb2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:03.909090 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202bc74-e76c-48f0-b4bd-0639705fb2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:03.909362 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202bc74-e76c-48f0-b4bd-0639705fb2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:03.909626 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202bc74-e76c-48f0-b4bd-0639705fb2e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:03.919149 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202bc74-e76c-48f0-b4bd-0639705fb2e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:03.920584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202bc74-e76c-48f0-b4bd-0639705fb2e5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:03.934940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-6202bc74-e76c-48f0-b4bd-0639705fb2e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:13:03.934940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:03.934940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:03.934940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:03.934940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:03.934940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:03.934940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:03.934940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:03.934940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:03.934940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:03.934940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:03.934940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:03.934940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:13:03.934940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:13:03.934940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:13:03.934940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:03.936060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:13:03.936948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:13:03.936948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:13:03.936948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:13:03.936948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 400/808] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:13:03.941619 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca2707-101b-4e06-8919-741b2495af59 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:03.943370 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202bc74-e76c-48f0-b4bd-0639705fb2e5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:04.015556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:04.039008 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca2707-101b-4e06-8919-741b2495af59 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:04.040069 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202bc74-e76c-48f0-b4bd-0639705fb2e5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:04.075976 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791d4e7-3cf2-40e7-8c67-a237e9ec2f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:04.076586 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791d4e7-3cf2-40e7-8c67-a237e9ec2f3e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:04.076863 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791d4e7-3cf2-40e7-8c67-a237e9ec2f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:04.077134 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791d4e7-3cf2-40e7-8c67-a237e9ec2f3e None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:04.077701 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0743c4-3ec7-4c98-a8d7-c238d461a259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:04.077806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791d4e7-3cf2-40e7-8c67-a237e9ec2f3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:04.078059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791d4e7-3cf2-40e7-8c67-a237e9ec2f3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:04.078318 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0743c4-3ec7-4c98-a8d7-c238d461a259 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:04.078595 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0743c4-3ec7-4c98-a8d7-c238d461a259 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:04.078860 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0743c4-3ec7-4c98-a8d7-c238d461a259 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:04.079431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791d4e7-3cf2-40e7-8c67-a237e9ec2f3e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:04.088705 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0743c4-3ec7-4c98-a8d7-c238d461a259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:13:04.095128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 409/809] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:13:04.095368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ed0743c4-3ec7-4c98-a8d7-c238d461a259 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:13:04.095368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:04.095368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:04.095368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:04.095368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:04.095368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:04.095368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:04.095368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:04.095368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:04.095368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:04.095368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:04.095368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:04.095368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:13:04.095368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:13:04.095368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:13:04.095368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:13:04.096469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:13:04.096469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:13:04.096469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:13:04.096469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:13:04.096469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:04.096469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:04.096469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:04.096469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:04.096469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:04.096469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:04.096469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:04.096469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:04.096469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:04.096469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:04.096469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:04.096469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:04.097299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:04.097299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:04.097299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:04.097299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:04.097299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:13:04.097299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:13:04.097299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:13:04.097299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:13:04.097299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:13:04.097299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:13:04.097299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:13:04.097299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:13:04.097299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 401/810] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:13:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:13:04.097994 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791d4e7-3cf2-40e7-8c67-a237e9ec2f3e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:04.100823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0743c4-3ec7-4c98-a8d7-c238d461a259 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:04.106696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:04.192826 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791d4e7-3cf2-40e7-8c67-a237e9ec2f3e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:04.197977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0743c4-3ec7-4c98-a8d7-c238d461a259 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:04.225765 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274e921-1271-487e-b643-a878ead7f122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:04.226385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274e921-1271-487e-b643-a878ead7f122 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:04.226662 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274e921-1271-487e-b643-a878ead7f122 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:04.226935 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274e921-1271-487e-b643-a878ead7f122 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:04.231242 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972359e8-478d-48e6-84fd-fe9cce404008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:04.231834 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972359e8-478d-48e6-84fd-fe9cce404008 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:04.232145 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972359e8-478d-48e6-84fd-fe9cce404008 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:04.232415 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972359e8-478d-48e6-84fd-fe9cce404008 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:04.233066 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972359e8-478d-48e6-84fd-fe9cce404008 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:04.233362 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972359e8-478d-48e6-84fd-fe9cce404008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:04.233559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274e921-1271-487e-b643-a878ead7f122 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:04.234710 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972359e8-478d-48e6-84fd-fe9cce404008 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:04.234966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274e921-1271-487e-b643-a878ead7f122 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:04.236058 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:04.244419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 402/811] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:13:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:13:04.246467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f274e921-1271-487e-b643-a878ead7f122 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:13:04.246467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:04.246467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:04.246467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:04.246467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:04.246467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:04.246467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:04.246467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:04.246467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:04.246467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:04.246467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:04.246467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:04.246467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:13:04.246467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:13:04.246467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:04.247539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:04.248501 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:13:04.248501 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:13:04.248501 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:13:04.248501 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:13:04.248501 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:13:04.248501 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:13:04.248501 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:13:04.248501 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:13:04.248501 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 410/812] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:13:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:13:04.250111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972359e8-478d-48e6-84fd-fe9cce404008 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:04.252993 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274e921-1271-487e-b643-a878ead7f122 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:04.315358 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:04.349233 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972359e8-478d-48e6-84fd-fe9cce404008 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:04.352538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274e921-1271-487e-b643-a878ead7f122 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:04.381623 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0262d37-190f-4146-b291-5680791836ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:04.382234 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0262d37-190f-4146-b291-5680791836ec None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:04.382510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0262d37-190f-4146-b291-5680791836ec None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:04.382776 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0262d37-190f-4146-b291-5680791836ec None admin] PATH_INFO: `/v3/users/70c9fc8bb5d1433e8402756d7f1b6586` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:04.385202 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3f0f2-5914-42fb-8c3f-f59592228b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:04.385793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3f0f2-5914-42fb-8c3f-f59592228b23 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:04.386071 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3f0f2-5914-42fb-8c3f-f59592228b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:04.386339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3f0f2-5914-42fb-8c3f-f59592228b23 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:04.387022 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3f0f2-5914-42fb-8c3f-f59592228b23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:04.387850 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3f0f2-5914-42fb-8c3f-f59592228b23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:04.389314 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3f0f2-5914-42fb-8c3f-f59592228b23 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:04.396302 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0262d37-190f-4146-b291-5680791836ec None admin] RBAC: Authorizing `identity:get_user(user_id=70c9fc8bb5d1433e8402756d7f1b6586)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:04.397327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0262d37-190f-4146-b291-5680791836ec None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:04.398901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 403/813] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:13:04 2022] GET /identity/v3/users/70c9fc8bb5d1433e8402756d7f1b6586 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:04.401117 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 411/814] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:13:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:13:04.406688 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0262d37-190f-4146-b291-5680791836ec None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:04.406820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3f0f2-5914-42fb-8c3f-f59592228b23 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:04.459826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:04.501629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3f0f2-5914-42fb-8c3f-f59592228b23 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:04.502999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0262d37-190f-4146-b291-5680791836ec None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:04.529133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:04.535551 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df579c95-4b90-4e20-842d-7627a909a3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:04.536192 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df579c95-4b90-4e20-842d-7627a909a3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:04.536469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df579c95-4b90-4e20-842d-7627a909a3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:04.536736 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df579c95-4b90-4e20-842d-7627a909a3f6 None admin] PATH_INFO: `/v3/projects/6f3f143eb32a47318c42a037ad745f68` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:04.537810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df579c95-4b90-4e20-842d-7627a909a3f6 None admin] RBAC: Authorizing `identity:get_project(project_id=6f3f143eb32a47318c42a037ad745f68)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:04.538031 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f41912-fcfd-4dda-a59c-a34c26bcbadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:04.538677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f41912-fcfd-4dda-a59c-a34c26bcbadd None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:04.538960 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f41912-fcfd-4dda-a59c-a34c26bcbadd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:04.539202 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df579c95-4b90-4e20-842d-7627a909a3f6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:04.539298 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f41912-fcfd-4dda-a59c-a34c26bcbadd None admin] PATH_INFO: `/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/a80cc7ec3d2d49f88c81403f918a6900/roles/8ab4fde39c414029a48964eac4e1c03c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:04.540820 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 404/815] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:13:04 2022] GET /identity/v3/projects/6f3f143eb32a47318c42a037ad745f68 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:04.541620 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f41912-fcfd-4dda-a59c-a34c26bcbadd None admin] RBAC: Authorizing `identity:create_grant(project_id=07b2dd5de0274a6896d407b0ff22ff54, user_id=a80cc7ec3d2d49f88c81403f918a6900, role_id=8ab4fde39c414029a48964eac4e1c03c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:04.543080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f41912-fcfd-4dda-a59c-a34c26bcbadd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:04.547068 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df579c95-4b90-4e20-842d-7627a909a3f6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:04.555990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 412/816] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:13:04 2022] PUT /identity/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/a80cc7ec3d2d49f88c81403f918a6900/roles/8ab4fde39c414029a48964eac4e1c03c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:13:04.651455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df579c95-4b90-4e20-842d-7627a909a3f6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:04.675223 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:04.688473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516646b-4097-4671-a1c9-f09bd7a9b9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:04.689146 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516646b-4097-4671-a1c9-f09bd7a9b9e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:04.689422 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516646b-4097-4671-a1c9-f09bd7a9b9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:04.689694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516646b-4097-4671-a1c9-f09bd7a9b9e2 None admin] PATH_INFO: `/v3/projects/6f3f143eb32a47318c42a037ad745f68/users/70c9fc8bb5d1433e8402756d7f1b6586/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:04.691758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516646b-4097-4671-a1c9-f09bd7a9b9e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f3f143eb32a47318c42a037ad745f68, user_id=70c9fc8bb5d1433e8402756d7f1b6586, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:04.693246 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516646b-4097-4671-a1c9-f09bd7a9b9e2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:04.708581 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 405/817] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:13:04 2022] PUT /identity/v3/projects/6f3f143eb32a47318c42a037ad745f68/users/70c9fc8bb5d1433e8402756d7f1b6586/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:13:06.677900 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813df1eb-db61-48fe-82fd-762f2e5b8c84 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:06.678453 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813df1eb-db61-48fe-82fd-762f2e5b8c84 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:06.678453 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813df1eb-db61-48fe-82fd-762f2e5b8c84 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:06.679771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 413/818] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:06.684983 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae15d5b-ec80-4d8a-844c-1a09acfb6dd8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:06.685380 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae15d5b-ec80-4d8a-844c-1a09acfb6dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:06.685601 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae15d5b-ec80-4d8a-844c-1a09acfb6dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:06.704571 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fae15d5b-ec80-4d8a-844c-1a09acfb6dd8 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:06.705801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fae15d5b-ec80-4d8a-844c-1a09acfb6dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:06.774416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 406/819] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:13:06.827744 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afd6c8-060e-44e6-9d96-ace45a8a31e4 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:06.828064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afd6c8-060e-44e6-9d96-ace45a8a31e4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:06.828334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afd6c8-060e-44e6-9d96-ace45a8a31e4 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:06.829664 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 414/820] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:06.834812 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fe7f9-f4d2-4350-a1bb-ae1bfefb43cb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:06.835091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fe7f9-f4d2-4350-a1bb-ae1bfefb43cb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:06.835357 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fe7f9-f4d2-4350-a1bb-ae1bfefb43cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:06.853892 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-165fe7f9-f4d2-4350-a1bb-ae1bfefb43cb None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:06.855049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-165fe7f9-f4d2-4350-a1bb-ae1bfefb43cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:06.918050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 407/821] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:13:07.047852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afd6c8-060e-44e6-9d96-ace45a8a31e4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:07.148351 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afd6c8-060e-44e6-9d96-ace45a8a31e4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:07.181044 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a44f9b-d3c6-4aea-99c1-8582b82d504a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:07.181667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a44f9b-d3c6-4aea-99c1-8582b82d504a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:07.181944 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a44f9b-d3c6-4aea-99c1-8582b82d504a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:07.182216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a44f9b-d3c6-4aea-99c1-8582b82d504a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:07.185715 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fe7f9-f4d2-4350-a1bb-ae1bfefb43cb None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:07.192770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a44f9b-d3c6-4aea-99c1-8582b82d504a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:13:07.197531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-86a44f9b-d3c6-4aea-99c1-8582b82d504a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 10:13:07.197531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:07.197531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:07.197531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:07.197531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:07.197531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:07.197531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:07.197531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:07.197531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:07.197531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:07.197531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:07.197531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:07.197531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:13:07.197531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:13:07.197531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:13:07.197531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:13:07.198460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:13:07.198460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:13:07.198460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:13:07.198460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:13:07.198460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:07.198460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:07.198460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:07.198460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:07.198460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:07.198460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:07.198460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:07.198460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:07.198460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:07.198460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:07.198460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:07.198460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:07.199292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:07.199292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:07.199292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:07.199292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:07.199292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:13:07.199292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:13:07.199292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:13:07.199292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:13:07.199292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:13:07.199292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:13:07.199292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 10:13:07.199292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:13:07.204165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 415/822] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Oct 17 10:13:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:13:07.204772 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a44f9b-d3c6-4aea-99c1-8582b82d504a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:07.229315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:07.251212 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:07.286460 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fe7f9-f4d2-4350-a1bb-ae1bfefb43cb None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:07.304645 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a44f9b-d3c6-4aea-99c1-8582b82d504a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:07.322234 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a43a52-9215-4378-ae92-9ae47a6d8308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:07.322866 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a43a52-9215-4378-ae92-9ae47a6d8308 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:07.323142 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a43a52-9215-4378-ae92-9ae47a6d8308 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:07.323410 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a43a52-9215-4378-ae92-9ae47a6d8308 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:07.333726 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a43a52-9215-4378-ae92-9ae47a6d8308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:13:07.338479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-89a43a52-9215-4378-ae92-9ae47a6d8308 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:13:07.338479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:07.338479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:07.338479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:07.338479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:07.338479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:07.338479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:07.338479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:07.338479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:07.338479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:07.338479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:07.338479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:07.338479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:13:07.338479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:13:07.338479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:13:07.338479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:13:07.339557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:13:07.339557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:13:07.339557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:13:07.339557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:13:07.339557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:07.339557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:07.339557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:07.339557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:07.339557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:07.339557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:07.339557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:07.339557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:07.339557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:07.339557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:07.339557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:07.339557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:07.340455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:07.340455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:07.340455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:07.340455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:07.340455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:13:07.340455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:13:07.340455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:13:07.340455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:13:07.340455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:13:07.340455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:13:07.340455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:13:07.340455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:13:07.341128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18656564-0214-4c86-883c-e2b9710c9ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:07.341128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18656564-0214-4c86-883c-e2b9710c9ffb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:07.341128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18656564-0214-4c86-883c-e2b9710c9ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:07.341339 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 408/823] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:13:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:13:07.341413 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18656564-0214-4c86-883c-e2b9710c9ffb None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:07.341413 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18656564-0214-4c86-883c-e2b9710c9ffb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:07.341413 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18656564-0214-4c86-883c-e2b9710c9ffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:07.342195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18656564-0214-4c86-883c-e2b9710c9ffb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:07.345697 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a43a52-9215-4378-ae92-9ae47a6d8308 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:07.350111 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 416/824] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Oct 17 10:13:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:07.355696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18656564-0214-4c86-883c-e2b9710c9ffb None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:07.446935 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a43a52-9215-4378-ae92-9ae47a6d8308 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:07.448479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:07.456250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18656564-0214-4c86-883c-e2b9710c9ffb None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:07.464836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:07.482484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5f685-c46c-4b08-84d2-ccfe05578e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:07.483076 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5f685-c46c-4b08-84d2-ccfe05578e5e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:07.483357 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5f685-c46c-4b08-84d2-ccfe05578e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:07.483626 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5f685-c46c-4b08-84d2-ccfe05578e5e None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:07.484308 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5f685-c46c-4b08-84d2-ccfe05578e5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:07.484650 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5f685-c46c-4b08-84d2-ccfe05578e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:07.485965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5f685-c46c-4b08-84d2-ccfe05578e5e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:07.490132 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067855e-ad6f-4303-b2b5-eef022a1117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:07.490771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067855e-ad6f-4303-b2b5-eef022a1117b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:07.491047 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067855e-ad6f-4303-b2b5-eef022a1117b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:07.491324 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067855e-ad6f-4303-b2b5-eef022a1117b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:07.493845 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 409/825] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:13:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:13:07.499695 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5f685-c46c-4b08-84d2-ccfe05578e5e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:07.502176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067855e-ad6f-4303-b2b5-eef022a1117b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:07.503628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067855e-ad6f-4303-b2b5-eef022a1117b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:07.517608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8067855e-ad6f-4303-b2b5-eef022a1117b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:13:07.517608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:07.517608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:07.517608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:07.517608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:07.517608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:07.517608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:07.517608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:07.517608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:07.517608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:07.517608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:07.517608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:07.517608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:13:07.517608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:13:07.517608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:13:07.517608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:07.518524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:13:07.520084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:13:07.520084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:13:07.520084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:13:07.520084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 417/826] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:13:07.524495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067855e-ad6f-4303-b2b5-eef022a1117b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:07.595773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5f685-c46c-4b08-84d2-ccfe05578e5e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:07.620346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067855e-ad6f-4303-b2b5-eef022a1117b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:07.628648 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add40929-6494-4321-89c4-71f6a6e204cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:07.629269 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add40929-6494-4321-89c4-71f6a6e204cf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:07.629549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add40929-6494-4321-89c4-71f6a6e204cf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:07.629820 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add40929-6494-4321-89c4-71f6a6e204cf None admin] PATH_INFO: `/v3/users/70c9fc8bb5d1433e8402756d7f1b6586` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:07.630948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add40929-6494-4321-89c4-71f6a6e204cf None admin] RBAC: Authorizing `identity:get_user(user_id=70c9fc8bb5d1433e8402756d7f1b6586)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:07.632391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add40929-6494-4321-89c4-71f6a6e204cf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:07.634442 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 410/827] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:13:07 2022] GET /identity/v3/users/70c9fc8bb5d1433e8402756d7f1b6586 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:13:07.639587 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add40929-6494-4321-89c4-71f6a6e204cf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:07.654274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1a8d7-cfb8-4e94-b5d8-ba8c080e1787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:07.654877 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1a8d7-cfb8-4e94-b5d8-ba8c080e1787 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:07.655158 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1a8d7-cfb8-4e94-b5d8-ba8c080e1787 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:07.655427 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1a8d7-cfb8-4e94-b5d8-ba8c080e1787 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:07.656093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1a8d7-cfb8-4e94-b5d8-ba8c080e1787 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:07.656391 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1a8d7-cfb8-4e94-b5d8-ba8c080e1787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:07.657750 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1a8d7-cfb8-4e94-b5d8-ba8c080e1787 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:07.668980 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 418/828] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:13:07.670204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:07.674640 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1a8d7-cfb8-4e94-b5d8-ba8c080e1787 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:07.695279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:07.741661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add40929-6494-4321-89c4-71f6a6e204cf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:07.772833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1a8d7-cfb8-4e94-b5d8-ba8c080e1787 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:07.775327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796fdb9-0a20-4990-a87e-cc60c6ee78df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:07.775943 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796fdb9-0a20-4990-a87e-cc60c6ee78df None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:07.776240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796fdb9-0a20-4990-a87e-cc60c6ee78df None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:07.776509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796fdb9-0a20-4990-a87e-cc60c6ee78df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:07.806028 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892fe16-51f4-4b33-bdc4-2e4d54135176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:07.806642 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892fe16-51f4-4b33-bdc4-2e4d54135176 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:07.806920 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892fe16-51f4-4b33-bdc4-2e4d54135176 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:07.807192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892fe16-51f4-4b33-bdc4-2e4d54135176 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:07.814529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892fe16-51f4-4b33-bdc4-2e4d54135176 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:07.816020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892fe16-51f4-4b33-bdc4-2e4d54135176 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:07.827294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8892fe16-51f4-4b33-bdc4-2e4d54135176 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 10:13:07.827294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:07.827294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:07.827294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:07.827294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:07.827294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:07.827294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:07.827294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:07.827294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:07.827294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:07.827294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:07.827294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:07.827294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:13:07.827294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:13:07.827294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:13:07.827294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:07.828274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:07.829216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:07.829216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:07.829216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:13:07.829216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:13:07.829216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:13:07.829216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:13:07.829216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:13:07.829216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:13:07.829216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 10:13:07.829216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:13:07.829216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 419/829] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Oct 17 10:13:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:13:07.834064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892fe16-51f4-4b33-bdc4-2e4d54135176 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:07.844145 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796fdb9-0a20-4990-a87e-cc60c6ee78df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:07.845577 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796fdb9-0a20-4990-a87e-cc60c6ee78df None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:07.875511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:07.915632 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:07.935517 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892fe16-51f4-4b33-bdc4-2e4d54135176 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:07.946602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 411/830] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:13:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 17 10:13:07.952889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796fdb9-0a20-4990-a87e-cc60c6ee78df None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:07.968461 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8fb3b-7413-4ecc-acf7-c3e63c0df2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:07.969069 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8fb3b-7413-4ecc-acf7-c3e63c0df2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:07.969351 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8fb3b-7413-4ecc-acf7-c3e63c0df2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:07.969625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8fb3b-7413-4ecc-acf7-c3e63c0df2e5 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:07.970353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8fb3b-7413-4ecc-acf7-c3e63c0df2e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:07.970660 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8fb3b-7413-4ecc-acf7-c3e63c0df2e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:07.972120 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8fb3b-7413-4ecc-acf7-c3e63c0df2e5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:07.989530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 420/831] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Oct 17 10:13:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:13:07.995108 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8fb3b-7413-4ecc-acf7-c3e63c0df2e5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:08.049339 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796fdb9-0a20-4990-a87e-cc60c6ee78df None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:08.078485 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:08.085870 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67690fb-81ff-4812-9dda-977cb5cfd256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:08.086492 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67690fb-81ff-4812-9dda-977cb5cfd256 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:08.086768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67690fb-81ff-4812-9dda-977cb5cfd256 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:08.087034 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67690fb-81ff-4812-9dda-977cb5cfd256 None admin] PATH_INFO: `/v3/projects/6f3f143eb32a47318c42a037ad745f68` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:08.088168 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67690fb-81ff-4812-9dda-977cb5cfd256 None admin] RBAC: Authorizing `identity:get_project(project_id=6f3f143eb32a47318c42a037ad745f68)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:08.089577 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67690fb-81ff-4812-9dda-977cb5cfd256 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:08.091233 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 412/832] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:13:07 2022] GET /identity/v3/projects/6f3f143eb32a47318c42a037ad745f68 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:13:08.094312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8fb3b-7413-4ecc-acf7-c3e63c0df2e5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:08.097138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67690fb-81ff-4812-9dda-977cb5cfd256 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:08.129006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946f5af-84e3-442f-a6bc-24dfadb8b4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:08.129534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946f5af-84e3-442f-a6bc-24dfadb8b4ae None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:08.129815 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946f5af-84e3-442f-a6bc-24dfadb8b4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:08.130084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946f5af-84e3-442f-a6bc-24dfadb8b4ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:08.138798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:08.194679 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67690fb-81ff-4812-9dda-977cb5cfd256 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:08.196677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946f5af-84e3-442f-a6bc-24dfadb8b4ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:08.198153 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946f5af-84e3-442f-a6bc-24dfadb8b4ae None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:08.230522 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d08e5-c522-4e4d-a7f2-dd917af942c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:08.231414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d08e5-c522-4e4d-a7f2-dd917af942c3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:08.231692 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d08e5-c522-4e4d-a7f2-dd917af942c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:08.231993 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d08e5-c522-4e4d-a7f2-dd917af942c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:08.232710 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d08e5-c522-4e4d-a7f2-dd917af942c3 None admin] RBAC: Adding query filter params (role.id=5e3dfffec8aa470fab9232cc439aec74, scope.project.id=6f3f143eb32a47318c42a037ad745f68, user.id=70c9fc8bb5d1433e8402756d7f1b6586) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:08.233017 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d08e5-c522-4e4d-a7f2-dd917af942c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:08.234426 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d08e5-c522-4e4d-a7f2-dd917af942c3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:08.240037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 413/833] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:13:08 2022] GET /identity/v3/role_assignments?user.id=70c9fc8bb5d1433e8402756d7f1b6586&scope.project.id=6f3f143eb32a47318c42a037ad745f68&role.id=5e3dfffec8aa470fab9232cc439aec74 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:13:08.299434 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 421/834] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:13:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 17 10:13:08.305513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d08e5-c522-4e4d-a7f2-dd917af942c3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:08.369397 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:08.409828 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d08e5-c522-4e4d-a7f2-dd917af942c3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:08.445901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c38570-5be4-4195-aa97-f1788c567f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:08.446535 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c38570-5be4-4195-aa97-f1788c567f18 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:08.446808 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c38570-5be4-4195-aa97-f1788c567f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:08.447077 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c38570-5be4-4195-aa97-f1788c567f18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:08.458724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c38570-5be4-4195-aa97-f1788c567f18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:08.460200 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c38570-5be4-4195-aa97-f1788c567f18 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:08.474722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-48c38570-5be4-4195-aa97-f1788c567f18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:13:08.474722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:08.474722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:08.474722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:08.474722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:08.474722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:08.474722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:08.474722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:08.474722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:08.474722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:08.474722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:08.474722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:08.474722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:13:08.474722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:13:08.474722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:13:08.474722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:08.475794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:13:08.476739 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:13:08.476739 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:13:08.476739 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:13:08.476739 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 414/835] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:13:08.481966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946f5af-84e3-442f-a6bc-24dfadb8b4ae None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:08.521067 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:08.582356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946f5af-84e3-442f-a6bc-24dfadb8b4ae None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:08.618604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a895f-df22-4068-93ce-ec4846d8e14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:08.619219 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a895f-df22-4068-93ce-ec4846d8e14b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:08.619499 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a895f-df22-4068-93ce-ec4846d8e14b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:08.619774 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a895f-df22-4068-93ce-ec4846d8e14b None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:08.620448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a895f-df22-4068-93ce-ec4846d8e14b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:08.620751 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a895f-df22-4068-93ce-ec4846d8e14b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:08.622661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a895f-df22-4068-93ce-ec4846d8e14b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:08.635121 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 422/836] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:08.641523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c38570-5be4-4195-aa97-f1788c567f18 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:08.743724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c38570-5be4-4195-aa97-f1788c567f18 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:08.759317 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:08.777376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5a9ac-6a66-46bc-ae07-88088ee9b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:08.778525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5a9ac-6a66-46bc-ae07-88088ee9b060 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:08.778813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5a9ac-6a66-46bc-ae07-88088ee9b060 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:08.779083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5a9ac-6a66-46bc-ae07-88088ee9b060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:08.785682 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5a9ac-6a66-46bc-ae07-88088ee9b060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:08.787109 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5a9ac-6a66-46bc-ae07-88088ee9b060 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:08.798117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9bd5a9ac-6a66-46bc-ae07-88088ee9b060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:13:08.798117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:08.798117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:08.798117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:08.798117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:08.798117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:08.798117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:08.798117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:08.798117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:08.798117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:08.798117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:08.798117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:08.798117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:13:08.798117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:13:08.798117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:08.799179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:08.800115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:13:08.800115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:13:08.800115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:13:08.800115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:13:08.800115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:13:08.800115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:13:08.800115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:13:08.800115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:13:08.800115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 415/837] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:13:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:13:08.805086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a895f-df22-4068-93ce-ec4846d8e14b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:08.899228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:08.903678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a895f-df22-4068-93ce-ec4846d8e14b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:08.936792 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cbb1a-d216-4a55-a404-9d358d4bb8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:08.937395 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cbb1a-d216-4a55-a404-9d358d4bb8ec None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:08.937672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cbb1a-d216-4a55-a404-9d358d4bb8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:08.937943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cbb1a-d216-4a55-a404-9d358d4bb8ec None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:08.938631 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cbb1a-d216-4a55-a404-9d358d4bb8ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:08.938935 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cbb1a-d216-4a55-a404-9d358d4bb8ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:08.940402 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cbb1a-d216-4a55-a404-9d358d4bb8ec None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:08.952843 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 423/838] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:13:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:08.959119 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5a9ac-6a66-46bc-ae07-88088ee9b060 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:09.058817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5a9ac-6a66-46bc-ae07-88088ee9b060 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:09.093292 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17deab80-045c-4f47-a88e-875e10ec0a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:09.093884 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17deab80-045c-4f47-a88e-875e10ec0a4c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:09.094155 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17deab80-045c-4f47-a88e-875e10ec0a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:09.094419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17deab80-045c-4f47-a88e-875e10ec0a4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:09.095127 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17deab80-045c-4f47-a88e-875e10ec0a4c None admin] RBAC: Adding query filter params (role.id=8ab4fde39c414029a48964eac4e1c03c, scope.project.id=07b2dd5de0274a6896d407b0ff22ff54, user.id=a80cc7ec3d2d49f88c81403f918a6900) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:09.095430 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17deab80-045c-4f47-a88e-875e10ec0a4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:09.096864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17deab80-045c-4f47-a88e-875e10ec0a4c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:09.102556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 416/839] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:13:08 2022] GET /identity/v3/role_assignments?user.id=a80cc7ec3d2d49f88c81403f918a6900&scope.project.id=07b2dd5de0274a6896d407b0ff22ff54&role.id=8ab4fde39c414029a48964eac4e1c03c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:13:10.436738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9330bdb-3075-4254-b935-ad98b0eae4c5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:10.437266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9330bdb-3075-4254-b935-ad98b0eae4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:10.437266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9330bdb-3075-4254-b935-ad98b0eae4c5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:10.438608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 424/840] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:10.443817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d816-b1bd-498d-a203-b130191dc118 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:10.444229 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d816-b1bd-498d-a203-b130191dc118 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:10.444390 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d816-b1bd-498d-a203-b130191dc118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:10.462344 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6b46d816-b1bd-498d-a203-b130191dc118 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:10.463501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6b46d816-b1bd-498d-a203-b130191dc118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:10.496058 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:10.528377 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 417/841] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:13:10.791262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9330bdb-3075-4254-b935-ad98b0eae4c5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:10.889192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9330bdb-3075-4254-b935-ad98b0eae4c5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:10.921492 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd4e69-d860-4468-ab1d-5a975364db72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:10.922105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd4e69-d860-4468-ab1d-5a975364db72 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:10.922382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd4e69-d860-4468-ab1d-5a975364db72 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:10.922653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd4e69-d860-4468-ab1d-5a975364db72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:10.923750 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd4e69-d860-4468-ab1d-5a975364db72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:10.925201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd4e69-d860-4468-ab1d-5a975364db72 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:10.926737 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 425/842] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:13:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:10.932363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46d816-b1bd-498d-a203-b130191dc118 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:11.026393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46d816-b1bd-498d-a203-b130191dc118 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:11.058835 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56092bf5-5c7b-4796-8264-e534e62915fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:11.059951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56092bf5-5c7b-4796-8264-e534e62915fc None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:11.060226 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56092bf5-5c7b-4796-8264-e534e62915fc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:11.060494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56092bf5-5c7b-4796-8264-e534e62915fc None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:11.061134 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56092bf5-5c7b-4796-8264-e534e62915fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:11.062549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56092bf5-5c7b-4796-8264-e534e62915fc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:11.082584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 418/843] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:13:10 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:13:13.193555 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a508e40-4cf1-461b-b6b9-6c5d0d9fd1a8 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:13.194067 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a508e40-4cf1-461b-b6b9-6c5d0d9fd1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:13.194158 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a508e40-4cf1-461b-b6b9-6c5d0d9fd1a8 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:13.195419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 426/844] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:13.200733 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2d3fd-9f32-49b8-9855-7aeea30081ee None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:13.201098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2d3fd-9f32-49b8-9855-7aeea30081ee None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:13.201299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2d3fd-9f32-49b8-9855-7aeea30081ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:13.219001 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-40f2d3fd-9f32-49b8-9855-7aeea30081ee None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:13.220280 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-40f2d3fd-9f32-49b8-9855-7aeea30081ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:13.240186 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:13.285737 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 419/845] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:13:13.560819 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a508e40-4cf1-461b-b6b9-6c5d0d9fd1a8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:13.587696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:13.658625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a508e40-4cf1-461b-b6b9-6c5d0d9fd1a8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:13.691129 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd6655-c511-4872-964a-8a5e7a05b893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:13.691739 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd6655-c511-4872-964a-8a5e7a05b893 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:13.692043 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd6655-c511-4872-964a-8a5e7a05b893 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:13.692316 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd6655-c511-4872-964a-8a5e7a05b893 None admin] PATH_INFO: `/v3/roles/b76852b6c05a46a9b493c465fd3441a3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:13.693711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd6655-c511-4872-964a-8a5e7a05b893 None admin] RBAC: Authorizing `identity:get_role(role_id=b76852b6c05a46a9b493c465fd3441a3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:13.695057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd6655-c511-4872-964a-8a5e7a05b893 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:13.696381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 427/846] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:13:13 2022] GET /identity/v3/roles/b76852b6c05a46a9b493c465fd3441a3 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:13.702464 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2d3fd-9f32-49b8-9855-7aeea30081ee None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:13.796444 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2d3fd-9f32-49b8-9855-7aeea30081ee None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:13.828161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62d03c-1124-4360-af7e-190c4d3bef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:13.828717 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62d03c-1124-4360-af7e-190c4d3bef22 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:13.828994 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62d03c-1124-4360-af7e-190c4d3bef22 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:13.829266 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62d03c-1124-4360-af7e-190c4d3bef22 None admin] PATH_INFO: `/v3/users/c77506258b354a61a4648d6fc2b4a3d1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:13.842203 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62d03c-1124-4360-af7e-190c4d3bef22 None admin] RBAC: Authorizing `identity:get_user(user_id=c77506258b354a61a4648d6fc2b4a3d1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:13.843622 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62d03c-1124-4360-af7e-190c4d3bef22 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:13.845192 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 420/847] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:13:13 2022] GET /identity/v3/users/c77506258b354a61a4648d6fc2b4a3d1 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:13:13.850717 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd6655-c511-4872-964a-8a5e7a05b893 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:13.939491 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:13.946550 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd6655-c511-4872-964a-8a5e7a05b893 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:13.979670 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983479bd-5756-49d1-ad71-b1981c5e48e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:13.980338 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983479bd-5756-49d1-ad71-b1981c5e48e3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:13.980593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983479bd-5756-49d1-ad71-b1981c5e48e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:13.980868 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983479bd-5756-49d1-ad71-b1981c5e48e3 None admin] PATH_INFO: `/v3/projects/6f3f143eb32a47318c42a037ad745f68` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:13.982270 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983479bd-5756-49d1-ad71-b1981c5e48e3 None admin] RBAC: Authorizing `identity:get_project(project_id=6f3f143eb32a47318c42a037ad745f68)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:13.983693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983479bd-5756-49d1-ad71-b1981c5e48e3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:13.985337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 428/848] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:13:13 2022] GET /identity/v3/projects/6f3f143eb32a47318c42a037ad745f68 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:13.990985 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62d03c-1124-4360-af7e-190c4d3bef22 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:14.005977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:14.086666 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62d03c-1124-4360-af7e-190c4d3bef22 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:14.119592 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd054de-c709-4323-9ef7-ed16d4dabc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:14.120258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd054de-c709-4323-9ef7-ed16d4dabc91 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:14.120532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd054de-c709-4323-9ef7-ed16d4dabc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:14.120796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd054de-c709-4323-9ef7-ed16d4dabc91 None admin] PATH_INFO: `/v3/projects/6f3f143eb32a47318c42a037ad745f68/users/c77506258b354a61a4648d6fc2b4a3d1/roles/b76852b6c05a46a9b493c465fd3441a3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:14.123564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd054de-c709-4323-9ef7-ed16d4dabc91 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f3f143eb32a47318c42a037ad745f68, user_id=c77506258b354a61a4648d6fc2b4a3d1, role_id=b76852b6c05a46a9b493c465fd3441a3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:14.125007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd054de-c709-4323-9ef7-ed16d4dabc91 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:14.136962 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 421/849] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:13:13 2022] PUT /identity/v3/projects/6f3f143eb32a47318c42a037ad745f68/users/c77506258b354a61a4648d6fc2b4a3d1/roles/b76852b6c05a46a9b493c465fd3441a3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:13:16.228965 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea23e5b-39cb-4c3b-ab02-7563bad62d03 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:16.229480 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea23e5b-39cb-4c3b-ab02-7563bad62d03 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:16.229480 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea23e5b-39cb-4c3b-ab02-7563bad62d03 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:16.230837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 429/850] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:16.236578 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb8714-037e-4b0d-9040-6a963783864d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:16.236959 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb8714-037e-4b0d-9040-6a963783864d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:16.237116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb8714-037e-4b0d-9040-6a963783864d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:16.255300 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-adeb8714-037e-4b0d-9040-6a963783864d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:16.256497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-adeb8714-037e-4b0d-9040-6a963783864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:16.319332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 422/851] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:13:16.584079 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea23e5b-39cb-4c3b-ab02-7563bad62d03 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:16.679742 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea23e5b-39cb-4c3b-ab02-7563bad62d03 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:16.715195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22ac4a-d1aa-4922-9d4a-163204144421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:16.715830 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22ac4a-d1aa-4922-9d4a-163204144421 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:16.716132 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22ac4a-d1aa-4922-9d4a-163204144421 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:16.716404 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22ac4a-d1aa-4922-9d4a-163204144421 None admin] PATH_INFO: `/v3/roles/b76852b6c05a46a9b493c465fd3441a3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:16.717778 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22ac4a-d1aa-4922-9d4a-163204144421 None admin] RBAC: Authorizing `identity:get_role(role_id=b76852b6c05a46a9b493c465fd3441a3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:16.719138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22ac4a-d1aa-4922-9d4a-163204144421 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:16.720472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 430/852] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:13:16 2022] GET /identity/v3/roles/b76852b6c05a46a9b493c465fd3441a3 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:16.726249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb8714-037e-4b0d-9040-6a963783864d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:16.729271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:16.820596 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb8714-037e-4b0d-9040-6a963783864d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:16.852411 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b06c8-3298-4348-9889-43616325038e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:16.852966 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b06c8-3298-4348-9889-43616325038e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:16.853240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b06c8-3298-4348-9889-43616325038e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:16.853504 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b06c8-3298-4348-9889-43616325038e None admin] PATH_INFO: `/v3/users/c77506258b354a61a4648d6fc2b4a3d1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:16.854601 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b06c8-3298-4348-9889-43616325038e None admin] RBAC: Authorizing `identity:get_user(user_id=c77506258b354a61a4648d6fc2b4a3d1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:16.856038 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b06c8-3298-4348-9889-43616325038e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:16.857862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 423/853] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:13:16 2022] GET /identity/v3/users/c77506258b354a61a4648d6fc2b4a3d1 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:16.863513 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22ac4a-d1aa-4922-9d4a-163204144421 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:16.893322 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:16.960252 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22ac4a-d1aa-4922-9d4a-163204144421 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:16.992888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a5b98-9ba3-4636-a0cb-59e120023e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:16.993484 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5b98-9ba3-4636-a0cb-59e120023e0e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:16.993762 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5b98-9ba3-4636-a0cb-59e120023e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:16.994034 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5b98-9ba3-4636-a0cb-59e120023e0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:17.057661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a5b98-9ba3-4636-a0cb-59e120023e0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:17.059113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a5b98-9ba3-4636-a0cb-59e120023e0e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:17.088320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:17.155485 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 431/854] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:13:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 10:13:17.161469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b06c8-3298-4348-9889-43616325038e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:17.227825 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:17.257445 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b06c8-3298-4348-9889-43616325038e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:17.288998 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f51484-4269-48d5-b259-6f4082ba8bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:17.289603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51484-4269-48d5-b259-6f4082ba8bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:17.289877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51484-4269-48d5-b259-6f4082ba8bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:17.290144 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51484-4269-48d5-b259-6f4082ba8bc0 None admin] PATH_INFO: `/v3/projects/6f3f143eb32a47318c42a037ad745f68` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:17.291222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f51484-4269-48d5-b259-6f4082ba8bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=6f3f143eb32a47318c42a037ad745f68)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:17.292651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f51484-4269-48d5-b259-6f4082ba8bc0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:17.294787 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 424/855] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:13:17 2022] GET /identity/v3/projects/6f3f143eb32a47318c42a037ad745f68 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:17.300965 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a5b98-9ba3-4636-a0cb-59e120023e0e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:17.394254 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a5b98-9ba3-4636-a0cb-59e120023e0e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:17.422375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:17.428435 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871c78a-3047-4ac7-8ac2-46b06d8a43a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:17.429032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871c78a-3047-4ac7-8ac2-46b06d8a43a0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:17.429311 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871c78a-3047-4ac7-8ac2-46b06d8a43a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:17.429578 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871c78a-3047-4ac7-8ac2-46b06d8a43a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:17.430295 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871c78a-3047-4ac7-8ac2-46b06d8a43a0 None admin] RBAC: Adding query filter params (role.id=b76852b6c05a46a9b493c465fd3441a3, scope.project.id=6f3f143eb32a47318c42a037ad745f68, user.id=c77506258b354a61a4648d6fc2b4a3d1) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:17.430603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871c78a-3047-4ac7-8ac2-46b06d8a43a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:17.432036 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871c78a-3047-4ac7-8ac2-46b06d8a43a0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:17.437584 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 432/856] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:13:17 2022] GET /identity/v3/role_assignments?user.id=c77506258b354a61a4648d6fc2b4a3d1&scope.project.id=6f3f143eb32a47318c42a037ad745f68&role.id=b76852b6c05a46a9b493c465fd3441a3 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:19.567562 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703076f-02af-4530-9692-ea629f25c801 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:19.568176 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703076f-02af-4530-9692-ea629f25c801 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:19.568176 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703076f-02af-4530-9692-ea629f25c801 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:19.569449 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 425/857] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:19.574708 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b93af-2841-4086-8b32-7aec4c20d93e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:19.575137 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b93af-2841-4086-8b32-7aec4c20d93e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:19.575276 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b93af-2841-4086-8b32-7aec4c20d93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:19.593471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-050b93af-2841-4086-8b32-7aec4c20d93e None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:19.594664 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-050b93af-2841-4086-8b32-7aec4c20d93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:19.658412 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 433/858] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:13:19.925577 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703076f-02af-4530-9692-ea629f25c801 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:20.021759 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703076f-02af-4530-9692-ea629f25c801 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:20.053574 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcff22e-2df2-4520-a1a7-3b2465e3036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:20.054177 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcff22e-2df2-4520-a1a7-3b2465e3036d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:20.054450 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcff22e-2df2-4520-a1a7-3b2465e3036d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:20.054721 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcff22e-2df2-4520-a1a7-3b2465e3036d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:20.055807 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcff22e-2df2-4520-a1a7-3b2465e3036d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:20.057270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcff22e-2df2-4520-a1a7-3b2465e3036d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:20.058943 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 426/859] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:13:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:20.065095 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b93af-2841-4086-8b32-7aec4c20d93e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:20.158764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b93af-2841-4086-8b32-7aec4c20d93e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:20.181374 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:20.192814 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0176008-c6a3-4b22-b922-86a8ad24ba56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:20.193414 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0176008-c6a3-4b22-b922-86a8ad24ba56 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:20.193691 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0176008-c6a3-4b22-b922-86a8ad24ba56 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:20.193961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0176008-c6a3-4b22-b922-86a8ad24ba56 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:20.194613 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0176008-c6a3-4b22-b922-86a8ad24ba56 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:20.196072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0176008-c6a3-4b22-b922-86a8ad24ba56 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:20.221007 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 434/860] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 17 10:13:20 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:13:22.338381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e819d-68ae-4595-9195-52cad8f961dc None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:22.338889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e819d-68ae-4595-9195-52cad8f961dc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:22.338889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e819d-68ae-4595-9195-52cad8f961dc None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:22.340182 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 427/861] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:22.345328 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0805c6-9479-4c4a-92a1-dae03a5ad0a0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:22.345763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0805c6-9479-4c4a-92a1-dae03a5ad0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:22.345888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0805c6-9479-4c4a-92a1-dae03a5ad0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:22.364353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1b0805c6-9479-4c4a-92a1-dae03a5ad0a0 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:22.365542 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1b0805c6-9479-4c4a-92a1-dae03a5ad0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:22.429347 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 435/862] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:13:22.697851 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e819d-68ae-4595-9195-52cad8f961dc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:22.708967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:22.796446 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e819d-68ae-4595-9195-52cad8f961dc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:22.828679 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15f693-5372-41a4-af74-ed4c53d192f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:22.829283 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f693-5372-41a4-af74-ed4c53d192f9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:22.829558 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f693-5372-41a4-af74-ed4c53d192f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:22.829828 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f693-5372-41a4-af74-ed4c53d192f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:22.830923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15f693-5372-41a4-af74-ed4c53d192f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:22.832367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15f693-5372-41a4-af74-ed4c53d192f9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:22.833879 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 428/863] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:13:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:22.839626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0805c6-9479-4c4a-92a1-dae03a5ad0a0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:22.933605 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0805c6-9479-4c4a-92a1-dae03a5ad0a0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:22.940566 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:22.967075 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c5efd-1a55-4e24-99a2-d1d42082a271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:22.967612 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c5efd-1a55-4e24-99a2-d1d42082a271 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:22.967889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c5efd-1a55-4e24-99a2-d1d42082a271 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:22.968198 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c5efd-1a55-4e24-99a2-d1d42082a271 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:22.968848 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c5efd-1a55-4e24-99a2-d1d42082a271 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:22.970292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c5efd-1a55-4e24-99a2-d1d42082a271 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:22.991907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 436/864] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:13:22 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:13:25.145540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7f91d-7a60-4743-ad33-a3769a16f9be None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:25.146055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7f91d-7a60-4743-ad33-a3769a16f9be None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:25.146145 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7f91d-7a60-4743-ad33-a3769a16f9be None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:25.147405 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 429/865] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:25.152620 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b1b2d-f540-441b-a641-b3aab12eecab None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:25.153609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b1b2d-f540-441b-a641-b3aab12eecab None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:25.153699 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b1b2d-f540-441b-a641-b3aab12eecab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:25.171374 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-762b1b2d-f540-441b-a641-b3aab12eecab None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:25.172590 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-762b1b2d-f540-441b-a641-b3aab12eecab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:25.237036 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 437/866] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:13:25.503913 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7f91d-7a60-4743-ad33-a3769a16f9be None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:25.580946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:25.603724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7f91d-7a60-4743-ad33-a3769a16f9be None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:25.636402 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c0d1b-25ff-418e-8a3e-0729f149475a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:25.637006 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c0d1b-25ff-418e-8a3e-0729f149475a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:25.637820 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c0d1b-25ff-418e-8a3e-0729f149475a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:25.638090 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c0d1b-25ff-418e-8a3e-0729f149475a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:25.647912 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c0d1b-25ff-418e-8a3e-0729f149475a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:13:25.652728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-8d5c0d1b-25ff-418e-8a3e-0729f149475a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:13:25.652728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:25.652728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:25.652728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:25.652728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:25.652728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:25.652728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:25.652728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:25.652728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:25.652728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:25.652728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:25.652728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:25.652728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:13:25.652728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:13:25.652728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:13:25.652728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:13:25.653894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:13:25.653894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:13:25.653894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:13:25.653894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:13:25.653894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:25.653894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:25.653894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:25.653894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:25.653894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:25.653894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:25.653894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:25.653894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:25.653894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:25.653894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:25.653894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:25.653894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:25.654999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:25.654999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:25.654999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:25.654999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:25.654999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:13:25.654999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:13:25.654999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:13:25.654999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:13:25.654999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:13:25.654999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:13:25.654999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:13:25.654999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:13:25.654999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 430/867] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:13:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:13:25.659965 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b1b2d-f540-441b-a641-b3aab12eecab None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:25.748292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:25.757518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b1b2d-f540-441b-a641-b3aab12eecab None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:25.789917 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f928cd-ebdb-4ab5-bf76-ee2b19092f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:25.790520 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f928cd-ebdb-4ab5-bf76-ee2b19092f54 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:25.790801 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f928cd-ebdb-4ab5-bf76-ee2b19092f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:25.791072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f928cd-ebdb-4ab5-bf76-ee2b19092f54 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:25.791736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f928cd-ebdb-4ab5-bf76-ee2b19092f54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:25.792060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f928cd-ebdb-4ab5-bf76-ee2b19092f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:25.793419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f928cd-ebdb-4ab5-bf76-ee2b19092f54 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:25.801170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 438/868] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:13:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:25.807076 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c0d1b-25ff-418e-8a3e-0729f149475a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:25.902327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c0d1b-25ff-418e-8a3e-0729f149475a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:25.935393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486195d-b5d8-4644-9754-420cf659f064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:25.936031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486195d-b5d8-4644-9754-420cf659f064 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:25.936312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486195d-b5d8-4644-9754-420cf659f064 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:25.936582 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486195d-b5d8-4644-9754-420cf659f064 None admin] PATH_INFO: `/v3/users/594f03ad1e164741869e5dd74ce4842b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:25.939151 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:25.949926 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486195d-b5d8-4644-9754-420cf659f064 None admin] RBAC: Authorizing `identity:get_user(user_id=594f03ad1e164741869e5dd74ce4842b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:25.951351 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486195d-b5d8-4644-9754-420cf659f064 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:25.952963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 431/869] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:13:25 2022] GET /identity/v3/users/594f03ad1e164741869e5dd74ce4842b => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:25.958668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f928cd-ebdb-4ab5-bf76-ee2b19092f54 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:26.053959 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f928cd-ebdb-4ab5-bf76-ee2b19092f54 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:26.086193 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff4d87-30fb-4af9-9356-84f213fc2d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:26.086812 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff4d87-30fb-4af9-9356-84f213fc2d59 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:26.087087 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff4d87-30fb-4af9-9356-84f213fc2d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:26.087355 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff4d87-30fb-4af9-9356-84f213fc2d59 None admin] PATH_INFO: `/v3/projects/be0c8770c7994c739b9ceb74d0177ac9` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:26.088480 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff4d87-30fb-4af9-9356-84f213fc2d59 None admin] RBAC: Authorizing `identity:get_project(project_id=be0c8770c7994c739b9ceb74d0177ac9)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:26.089891 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff4d87-30fb-4af9-9356-84f213fc2d59 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:26.091495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 439/870] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:13:25 2022] GET /identity/v3/projects/be0c8770c7994c739b9ceb74d0177ac9 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:26.097619 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486195d-b5d8-4644-9754-420cf659f064 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:26.191633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486195d-b5d8-4644-9754-420cf659f064 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:26.224661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d242cf-02da-4506-9da7-97d0625ea194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:26.225303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d242cf-02da-4506-9da7-97d0625ea194 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:26.225583 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d242cf-02da-4506-9da7-97d0625ea194 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:26.225854 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d242cf-02da-4506-9da7-97d0625ea194 None admin] PATH_INFO: `/v3/projects/be0c8770c7994c739b9ceb74d0177ac9/users/594f03ad1e164741869e5dd74ce4842b/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:26.227755 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d242cf-02da-4506-9da7-97d0625ea194 None admin] RBAC: Authorizing `identity:create_grant(project_id=be0c8770c7994c739b9ceb74d0177ac9, user_id=594f03ad1e164741869e5dd74ce4842b, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:26.229212 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d242cf-02da-4506-9da7-97d0625ea194 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:26.241894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 432/871] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:13:26 2022] PUT /identity/v3/projects/be0c8770c7994c739b9ceb74d0177ac9/users/594f03ad1e164741869e5dd74ce4842b/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:13:28.336195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55e538-a491-4de3-84d9-bce5265e1f74 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:28.336704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55e538-a491-4de3-84d9-bce5265e1f74 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:28.336704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55e538-a491-4de3-84d9-bce5265e1f74 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:28.337994 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 440/872] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:28.344050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710334e1-568c-4206-95df-7ff810a25d57 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:28.344426 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710334e1-568c-4206-95df-7ff810a25d57 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:28.344599 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710334e1-568c-4206-95df-7ff810a25d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:28.362467 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-710334e1-568c-4206-95df-7ff810a25d57 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:28.363664 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-710334e1-568c-4206-95df-7ff810a25d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:28.410813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:28.428311 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 433/873] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:13:28.700496 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55e538-a491-4de3-84d9-bce5265e1f74 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:28.725689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:28.800114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55e538-a491-4de3-84d9-bce5265e1f74 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:28.831320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cef8c9-807d-4f8e-ae83-e086a84cc3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:28.831944 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cef8c9-807d-4f8e-ae83-e086a84cc3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:28.832226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cef8c9-807d-4f8e-ae83-e086a84cc3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:28.832495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cef8c9-807d-4f8e-ae83-e086a84cc3b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:28.843038 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cef8c9-807d-4f8e-ae83-e086a84cc3b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:13:28.847756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-15cef8c9-807d-4f8e-ae83-e086a84cc3b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:13:28.847756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:28.847756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:28.847756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:28.847756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:28.847756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:28.847756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:28.847756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:28.847756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:28.847756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:28.847756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:28.847756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:28.847756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:13:28.847756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:13:28.847756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:13:28.847756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:13:28.848828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:13:28.848828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:13:28.848828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:13:28.848828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:13:28.848828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:28.848828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:28.848828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:28.848828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:28.848828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:28.848828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:28.848828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:28.848828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:28.848828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:28.848828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:28.848828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:28.848828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:28.849678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:28.849678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:28.849678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:28.849678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:28.849678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:13:28.849678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:13:28.849678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:13:28.849678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:13:28.849678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:13:28.849678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:13:28.849678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:13:28.849678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:13:28.849678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 441/874] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:13:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:13:28.854785 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710334e1-568c-4206-95df-7ff810a25d57 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:28.948653 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710334e1-568c-4206-95df-7ff810a25d57 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:28.982280 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701f522-79b8-4b5b-a2de-e0a5a17c7ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:28.982814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701f522-79b8-4b5b-a2de-e0a5a17c7ebf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:28.983089 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701f522-79b8-4b5b-a2de-e0a5a17c7ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:28.983358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701f522-79b8-4b5b-a2de-e0a5a17c7ebf None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:28.984036 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701f522-79b8-4b5b-a2de-e0a5a17c7ebf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:28.984340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701f522-79b8-4b5b-a2de-e0a5a17c7ebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:28.985682 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701f522-79b8-4b5b-a2de-e0a5a17c7ebf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:28.993355 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 434/875] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:13:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:28.999042 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cef8c9-807d-4f8e-ae83-e086a84cc3b6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:29.079747 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:29.097148 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cef8c9-807d-4f8e-ae83-e086a84cc3b6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:29.129983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812108c-8053-419d-aef0-6dce74348e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:29.130598 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812108c-8053-419d-aef0-6dce74348e47 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:29.130878 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812108c-8053-419d-aef0-6dce74348e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:29.131151 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812108c-8053-419d-aef0-6dce74348e47 None admin] PATH_INFO: `/v3/users/594f03ad1e164741869e5dd74ce4842b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:29.132283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812108c-8053-419d-aef0-6dce74348e47 None admin] RBAC: Authorizing `identity:get_user(user_id=594f03ad1e164741869e5dd74ce4842b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:29.133717 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812108c-8053-419d-aef0-6dce74348e47 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:29.135275 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 442/876] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:13:28 2022] GET /identity/v3/users/594f03ad1e164741869e5dd74ce4842b => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:29.140969 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701f522-79b8-4b5b-a2de-e0a5a17c7ebf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:29.186324 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:29.237839 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701f522-79b8-4b5b-a2de-e0a5a17c7ebf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:29.269273 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9bea7-2329-47d2-9cbe-0c85cadf2912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:29.269857 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9bea7-2329-47d2-9cbe-0c85cadf2912 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:29.270133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9bea7-2329-47d2-9cbe-0c85cadf2912 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:29.270397 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9bea7-2329-47d2-9cbe-0c85cadf2912 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:29.333436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9bea7-2329-47d2-9cbe-0c85cadf2912 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:29.334846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9bea7-2329-47d2-9cbe-0c85cadf2912 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:29.377409 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:29.428506 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 435/877] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:13:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 10:13:29.434331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812108c-8053-419d-aef0-6dce74348e47 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:29.528868 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812108c-8053-419d-aef0-6dce74348e47 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:29.561567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa2738-eeb5-4b48-8c05-f7791ec1987a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:29.562175 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa2738-eeb5-4b48-8c05-f7791ec1987a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:29.562448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa2738-eeb5-4b48-8c05-f7791ec1987a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:29.562715 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa2738-eeb5-4b48-8c05-f7791ec1987a None admin] PATH_INFO: `/v3/projects/be0c8770c7994c739b9ceb74d0177ac9` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:29.563810 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa2738-eeb5-4b48-8c05-f7791ec1987a None admin] RBAC: Authorizing `identity:get_project(project_id=be0c8770c7994c739b9ceb74d0177ac9)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:29.565251 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa2738-eeb5-4b48-8c05-f7791ec1987a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:29.566852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 443/878] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:13:29 2022] GET /identity/v3/projects/be0c8770c7994c739b9ceb74d0177ac9 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:29.572892 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9bea7-2329-47d2-9cbe-0c85cadf2912 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:29.667184 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9bea7-2329-47d2-9cbe-0c85cadf2912 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:29.698656 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c0fa2-e43a-4105-9cd3-0eb9fb31dc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:29.699262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c0fa2-e43a-4105-9cd3-0eb9fb31dc35 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:29.699538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c0fa2-e43a-4105-9cd3-0eb9fb31dc35 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:29.700337 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c0fa2-e43a-4105-9cd3-0eb9fb31dc35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:29.701153 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c0fa2-e43a-4105-9cd3-0eb9fb31dc35 None admin] RBAC: Adding query filter params (role.id=5e3dfffec8aa470fab9232cc439aec74, scope.project.id=be0c8770c7994c739b9ceb74d0177ac9, user.id=594f03ad1e164741869e5dd74ce4842b) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:29.701460 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c0fa2-e43a-4105-9cd3-0eb9fb31dc35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:29.702880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c0fa2-e43a-4105-9cd3-0eb9fb31dc35 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:29.708595 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 436/879] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:13:29 2022] GET /identity/v3/role_assignments?user.id=594f03ad1e164741869e5dd74ce4842b&scope.project.id=be0c8770c7994c739b9ceb74d0177ac9&role.id=5e3dfffec8aa470fab9232cc439aec74 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:31.821160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f2a84-4724-40bc-8c38-a8d40ad26403 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:31.821680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f2a84-4724-40bc-8c38-a8d40ad26403 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:31.821680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f2a84-4724-40bc-8c38-a8d40ad26403 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:31.823034 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 444/880] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:31.828397 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5c3dc-aaa4-4671-8083-ee99fda1b10c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:31.828813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5c3dc-aaa4-4671-8083-ee99fda1b10c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:31.828939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5c3dc-aaa4-4671-8083-ee99fda1b10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:31.846942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4ff5c3dc-aaa4-4671-8083-ee99fda1b10c None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:31.848136 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4ff5c3dc-aaa4-4671-8083-ee99fda1b10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:31.850777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:31.912305 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 437/881] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 10:13:32.175471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f2a84-4724-40bc-8c38-a8d40ad26403 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:32.194344 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:32.273389 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f2a84-4724-40bc-8c38-a8d40ad26403 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:32.305558 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0f867-14f9-41e8-a1dc-6b8375acf27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:32.306146 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0f867-14f9-41e8-a1dc-6b8375acf27c None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:32.306422 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0f867-14f9-41e8-a1dc-6b8375acf27c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:32.306692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0f867-14f9-41e8-a1dc-6b8375acf27c None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:32.307344 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0f867-14f9-41e8-a1dc-6b8375acf27c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:32.308722 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0f867-14f9-41e8-a1dc-6b8375acf27c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:32.323719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 445/882] 10.222.0.13 () {60 vars in 1138 bytes} [Mon Oct 17 10:13:32 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:13:34.458198 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342280a-4650-4142-8c4b-abf86c0f7b1f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:34.458778 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342280a-4650-4142-8c4b-abf86c0f7b1f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:34.458778 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342280a-4650-4142-8c4b-abf86c0f7b1f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:34.460075 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 438/883] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:34.465882 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd5ca8-ad07-4f3a-979b-013235769640 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:34.466321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd5ca8-ad07-4f3a-979b-013235769640 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:34.466422 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd5ca8-ad07-4f3a-979b-013235769640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:34.484410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-38bd5ca8-ad07-4f3a-979b-013235769640 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:34.485578 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-38bd5ca8-ad07-4f3a-979b-013235769640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:34.548546 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 446/884] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:13:34.820059 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342280a-4650-4142-8c4b-abf86c0f7b1f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:34.915821 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342280a-4650-4142-8c4b-abf86c0f7b1f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:34.948058 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef733e3-3c3b-46d4-b2af-4fdd7bf88102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:34.948667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef733e3-3c3b-46d4-b2af-4fdd7bf88102 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:34.948943 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef733e3-3c3b-46d4-b2af-4fdd7bf88102 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:34.949210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef733e3-3c3b-46d4-b2af-4fdd7bf88102 None admin] PATH_INFO: `/v3/domains/a3b9215af7c349589a84a6df6648df8d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:34.957089 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:34.959586 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef733e3-3c3b-46d4-b2af-4fdd7bf88102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a3b9215af7c349589a84a6df6648df8d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:34.961626 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef733e3-3c3b-46d4-b2af-4fdd7bf88102 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:34.963159 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 439/885] 10.222.0.13 () {56 vars in 1183 bytes} [Mon Oct 17 10:13:34 2022] GET /identity/v3/domains/a3b9215af7c349589a84a6df6648df8d => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:34.968976 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd5ca8-ad07-4f3a-979b-013235769640 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:34.978828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:35.066029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd5ca8-ad07-4f3a-979b-013235769640 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:35.098229 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da7fc7-6e3e-4cdb-916e-7824694c2fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:35.098769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da7fc7-6e3e-4cdb-916e-7824694c2fb5 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:35.099045 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da7fc7-6e3e-4cdb-916e-7824694c2fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:35.099311 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da7fc7-6e3e-4cdb-916e-7824694c2fb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:35.099965 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da7fc7-6e3e-4cdb-916e-7824694c2fb5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:35.101384 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da7fc7-6e3e-4cdb-916e-7824694c2fb5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:35.127648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 447/886] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 17 10:13:34 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:13:37.292959 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6309752-c5aa-4f12-92eb-b495dc387b74 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:37.294011 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6309752-c5aa-4f12-92eb-b495dc387b74 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:37.294011 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6309752-c5aa-4f12-92eb-b495dc387b74 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:37.295339 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 440/887] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:37.300494 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d826ec-bead-408a-a144-6e3859067b83 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:37.300916 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d826ec-bead-408a-a144-6e3859067b83 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:37.301043 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d826ec-bead-408a-a144-6e3859067b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:37.319511 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e7d826ec-bead-408a-a144-6e3859067b83 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:37.320650 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e7d826ec-bead-408a-a144-6e3859067b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:37.374493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:37.385953 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 448/888] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:13:37.661094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6309752-c5aa-4f12-92eb-b495dc387b74 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:37.759525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6309752-c5aa-4f12-92eb-b495dc387b74 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:37.791755 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92277e-d238-4a41-a934-d6bd3c7169db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:37.792394 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92277e-d238-4a41-a934-d6bd3c7169db None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:37.792674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92277e-d238-4a41-a934-d6bd3c7169db None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:37.792942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92277e-d238-4a41-a934-d6bd3c7169db None admin] PATH_INFO: `/v3/domains/a3b9215af7c349589a84a6df6648df8d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:37.794055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92277e-d238-4a41-a934-d6bd3c7169db None admin] RBAC: Authorizing `identity:get_domain(domain_id=a3b9215af7c349589a84a6df6648df8d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:37.795461 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92277e-d238-4a41-a934-d6bd3c7169db None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:37.797011 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 441/889] 10.222.0.13 () {56 vars in 1183 bytes} [Mon Oct 17 10:13:37 2022] GET /identity/v3/domains/a3b9215af7c349589a84a6df6648df8d => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:37.802637 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d826ec-bead-408a-a144-6e3859067b83 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:37.897650 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d826ec-bead-408a-a144-6e3859067b83 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:37.929972 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee61fc8-7d2d-4b4a-b4ea-73babf5085a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:37.930508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee61fc8-7d2d-4b4a-b4ea-73babf5085a7 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:37.930784 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee61fc8-7d2d-4b4a-b4ea-73babf5085a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:37.931050 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee61fc8-7d2d-4b4a-b4ea-73babf5085a7 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:37.931681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee61fc8-7d2d-4b4a-b4ea-73babf5085a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:37.933125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee61fc8-7d2d-4b4a-b4ea-73babf5085a7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:37.953684 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 449/890] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:13:37 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:13:40.099659 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e98ceb-8217-4ed4-8f72-b7cee5a3e26f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:40.100121 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e98ceb-8217-4ed4-8f72-b7cee5a3e26f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:40.100217 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e98ceb-8217-4ed4-8f72-b7cee5a3e26f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:40.101553 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 442/891] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:40.107712 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498e297-3372-4317-9942-a7105d559f0d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:40.108159 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498e297-3372-4317-9942-a7105d559f0d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:40.108267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498e297-3372-4317-9942-a7105d559f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:40.125879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c498e297-3372-4317-9942-a7105d559f0d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:40.127048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c498e297-3372-4317-9942-a7105d559f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:40.167493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:40.191236 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 450/892] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:13:40.454218 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e98ceb-8217-4ed4-8f72-b7cee5a3e26f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:40.517992 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:40.550416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e98ceb-8217-4ed4-8f72-b7cee5a3e26f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:40.581547 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90fd05-c442-4dc0-bc7f-b6da40aee388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:40.582145 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90fd05-c442-4dc0-bc7f-b6da40aee388 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:40.582418 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90fd05-c442-4dc0-bc7f-b6da40aee388 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:40.582685 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90fd05-c442-4dc0-bc7f-b6da40aee388 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:40.592777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90fd05-c442-4dc0-bc7f-b6da40aee388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:13:40.597458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3c90fd05-c442-4dc0-bc7f-b6da40aee388 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:13:40.597458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:40.597458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:40.597458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:40.597458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:40.597458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:40.597458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:40.597458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:40.597458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:40.597458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:40.597458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:40.597458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:40.597458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:13:40.597458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:13:40.597458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:13:40.597458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:13:40.598605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:13:40.598605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:13:40.598605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:13:40.598605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:13:40.598605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:40.598605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:40.598605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:40.598605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:40.598605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:40.598605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:40.598605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:40.598605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:40.598605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:40.598605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:40.598605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:40.598605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:40.599707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:40.599707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:40.599707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:40.599707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:40.599707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:13:40.599707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:13:40.599707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:13:40.599707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:13:40.599707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:13:40.599707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:13:40.599707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:13:40.599707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:13:40.599707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 443/893] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:13:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:13:40.604420 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498e297-3372-4317-9942-a7105d559f0d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:40.699024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498e297-3372-4317-9942-a7105d559f0d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:40.732710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5fbc-1d3e-4aee-9297-3c7778ea5546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:40.733242 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5fbc-1d3e-4aee-9297-3c7778ea5546 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:40.733516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5fbc-1d3e-4aee-9297-3c7778ea5546 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:40.733783 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5fbc-1d3e-4aee-9297-3c7778ea5546 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:40.734434 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d5fbc-1d3e-4aee-9297-3c7778ea5546 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:40.734731 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d5fbc-1d3e-4aee-9297-3c7778ea5546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:40.736106 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d5fbc-1d3e-4aee-9297-3c7778ea5546 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:40.743740 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 451/894] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:13:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:40.749447 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90fd05-c442-4dc0-bc7f-b6da40aee388 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:40.843378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90fd05-c442-4dc0-bc7f-b6da40aee388 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:40.868216 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:40.876759 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09859fca-b650-488f-aadd-b1aa92f50b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:40.877372 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09859fca-b650-488f-aadd-b1aa92f50b77 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:40.877645 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09859fca-b650-488f-aadd-b1aa92f50b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:40.877912 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09859fca-b650-488f-aadd-b1aa92f50b77 None admin] PATH_INFO: `/v3/users/3c51a462230b43258d50babe164f88e8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:40.890642 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09859fca-b650-488f-aadd-b1aa92f50b77 None admin] RBAC: Authorizing `identity:get_user(user_id=3c51a462230b43258d50babe164f88e8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:40.892093 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09859fca-b650-488f-aadd-b1aa92f50b77 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:40.893643 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 444/895] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:13:40 2022] GET /identity/v3/users/3c51a462230b43258d50babe164f88e8 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:40.899351 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5fbc-1d3e-4aee-9297-3c7778ea5546 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:40.938162 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:40.998341 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5fbc-1d3e-4aee-9297-3c7778ea5546 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:41.029783 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ac605-1f8d-49bd-b295-5b085a8918cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:41.030401 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ac605-1f8d-49bd-b295-5b085a8918cd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:41.030678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ac605-1f8d-49bd-b295-5b085a8918cd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:41.030947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ac605-1f8d-49bd-b295-5b085a8918cd None admin] PATH_INFO: `/v3/projects/7bf28fc7b7984447b7d3199e6b19560e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:41.032084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ac605-1f8d-49bd-b295-5b085a8918cd None admin] RBAC: Authorizing `identity:get_project(project_id=7bf28fc7b7984447b7d3199e6b19560e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:41.033498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ac605-1f8d-49bd-b295-5b085a8918cd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:41.035102 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 452/896] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:13:40 2022] GET /identity/v3/projects/7bf28fc7b7984447b7d3199e6b19560e => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:41.040996 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09859fca-b650-488f-aadd-b1aa92f50b77 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:41.137345 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09859fca-b650-488f-aadd-b1aa92f50b77 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:41.169505 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75b8f3-5b67-48e7-88a1-caf551362081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:41.170140 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75b8f3-5b67-48e7-88a1-caf551362081 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:41.170416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75b8f3-5b67-48e7-88a1-caf551362081 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:41.170687 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75b8f3-5b67-48e7-88a1-caf551362081 None admin] PATH_INFO: `/v3/projects/7bf28fc7b7984447b7d3199e6b19560e/users/3c51a462230b43258d50babe164f88e8/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:41.172568 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75b8f3-5b67-48e7-88a1-caf551362081 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bf28fc7b7984447b7d3199e6b19560e, user_id=3c51a462230b43258d50babe164f88e8, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:41.173993 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75b8f3-5b67-48e7-88a1-caf551362081 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:41.186659 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 445/897] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:13:41 2022] PUT /identity/v3/projects/7bf28fc7b7984447b7d3199e6b19560e/users/3c51a462230b43258d50babe164f88e8/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:13:43.277639 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f346ee1-a6f9-40c3-bf7e-e34a03cfbb61 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:43.278259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f346ee1-a6f9-40c3-bf7e-e34a03cfbb61 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:43.278259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f346ee1-a6f9-40c3-bf7e-e34a03cfbb61 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:43.279570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 453/898] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:13:43.284829 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7ca6a-7d21-4754-a027-d5247261691f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:43.285248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7ca6a-7d21-4754-a027-d5247261691f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:43.285386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7ca6a-7d21-4754-a027-d5247261691f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:43.303594 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f7d7ca6a-7d21-4754-a027-d5247261691f None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:13:43.304811 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f7d7ca6a-7d21-4754-a027-d5247261691f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:13:43.346094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:43.371249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 446/899] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:13:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:13:43.647991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f346ee1-a6f9-40c3-bf7e-e34a03cfbb61 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:43.747488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f346ee1-a6f9-40c3-bf7e-e34a03cfbb61 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:43.754077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:43.780155 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3f5f6-ff13-4c5d-b208-f06cc76217ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:43.780766 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3f5f6-ff13-4c5d-b208-f06cc76217ba None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:43.781043 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3f5f6-ff13-4c5d-b208-f06cc76217ba None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:43.781311 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3f5f6-ff13-4c5d-b208-f06cc76217ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:43.790889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3f5f6-ff13-4c5d-b208-f06cc76217ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:13:43.796168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7ac3f5f6-ff13-4c5d-b208-f06cc76217ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:13:43.796168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:13:43.796168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:13:43.796168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:13:43.796168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:13:43.796168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:13:43.796168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:13:43.796168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:13:43.796168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:13:43.796168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:13:43.796168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:13:43.796168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:13:43.796168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:13:43.796168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:13:43.796168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:13:43.796168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:13:43.797260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:13:43.797260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:13:43.797260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:13:43.797260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:13:43.797260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:13:43.797260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:13:43.797260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:13:43.797260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:13:43.797260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:13:43.797260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:13:43.797260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:13:43.797260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:13:43.797260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:13:43.797260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:13:43.797260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:13:43.797260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:13:43.798475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:13:43.798475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:13:43.798475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:13:43.798475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:13:43.798475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:13:43.798475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:13:43.798475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:13:43.798475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:13:43.798475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:13:43.798475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:13:43.798475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:13:43.798475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:13:43.798475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 454/900] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:13:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:13:43.803221 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7ca6a-7d21-4754-a027-d5247261691f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:43.897690 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7ca6a-7d21-4754-a027-d5247261691f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:43.930773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af1b9f-345f-4f56-ad99-95c7c4d904c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:43.931305 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af1b9f-345f-4f56-ad99-95c7c4d904c1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:43.931582 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af1b9f-345f-4f56-ad99-95c7c4d904c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:43.931850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af1b9f-345f-4f56-ad99-95c7c4d904c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:43.932535 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af1b9f-345f-4f56-ad99-95c7c4d904c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:43.932841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af1b9f-345f-4f56-ad99-95c7c4d904c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:43.934217 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af1b9f-345f-4f56-ad99-95c7c4d904c1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:43.941968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 447/901] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:13:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:43.947793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3f5f6-ff13-4c5d-b208-f06cc76217ba None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:44.044509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3f5f6-ff13-4c5d-b208-f06cc76217ba None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:44.191312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b742ed-5381-4df7-98cb-1fbcb0bc1272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:44.191839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b742ed-5381-4df7-98cb-1fbcb0bc1272 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:44.192142 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b742ed-5381-4df7-98cb-1fbcb0bc1272 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:44.192414 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b742ed-5381-4df7-98cb-1fbcb0bc1272 None admin] PATH_INFO: `/v3/users/3c51a462230b43258d50babe164f88e8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:44.193520 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b742ed-5381-4df7-98cb-1fbcb0bc1272 None admin] RBAC: Authorizing `identity:get_user(user_id=3c51a462230b43258d50babe164f88e8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:44.194930 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b742ed-5381-4df7-98cb-1fbcb0bc1272 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:44.196525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 455/902] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 17 10:13:43 2022] GET /identity/v3/users/3c51a462230b43258d50babe164f88e8 => generated 311 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:44.202504 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af1b9f-345f-4f56-ad99-95c7c4d904c1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:44.241420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:44.298904 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af1b9f-345f-4f56-ad99-95c7c4d904c1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:44.330759 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf361d-9524-4c9b-b0d4-6f4d130b1d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:44.331342 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf361d-9524-4c9b-b0d4-6f4d130b1d47 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:44.331618 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf361d-9524-4c9b-b0d4-6f4d130b1d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:44.331889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf361d-9524-4c9b-b0d4-6f4d130b1d47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:44.395622 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf361d-9524-4c9b-b0d4-6f4d130b1d47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:44.397084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf361d-9524-4c9b-b0d4-6f4d130b1d47 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:44.433387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:44.491224 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 448/903] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:13:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 10:13:44.497067 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b742ed-5381-4df7-98cb-1fbcb0bc1272 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:44.530153 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:44.593199 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b742ed-5381-4df7-98cb-1fbcb0bc1272 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:44.625714 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0eb3f9-58e7-417f-acb2-dd18e1b8a599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:44.626326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0eb3f9-58e7-417f-acb2-dd18e1b8a599 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:44.626604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0eb3f9-58e7-417f-acb2-dd18e1b8a599 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:44.626877 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0eb3f9-58e7-417f-acb2-dd18e1b8a599 None admin] PATH_INFO: `/v3/projects/7bf28fc7b7984447b7d3199e6b19560e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:44.628024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0eb3f9-58e7-417f-acb2-dd18e1b8a599 None admin] RBAC: Authorizing `identity:get_project(project_id=7bf28fc7b7984447b7d3199e6b19560e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:44.629444 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0eb3f9-58e7-417f-acb2-dd18e1b8a599 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:44.631034 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 456/904] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 17 10:13:44 2022] GET /identity/v3/projects/7bf28fc7b7984447b7d3199e6b19560e => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:44.637051 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf361d-9524-4c9b-b0d4-6f4d130b1d47 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:13:44.732814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf361d-9524-4c9b-b0d4-6f4d130b1d47 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:13:44.764879 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d42668-ee3f-41ce-8158-85c1214a9302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:13:44.765407 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d42668-ee3f-41ce-8158-85c1214a9302 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:13:44.765686 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d42668-ee3f-41ce-8158-85c1214a9302 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:13:44.765958 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d42668-ee3f-41ce-8158-85c1214a9302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:13:44.766673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d42668-ee3f-41ce-8158-85c1214a9302 None admin] RBAC: Adding query filter params (role.id=5e3dfffec8aa470fab9232cc439aec74, scope.project.id=7bf28fc7b7984447b7d3199e6b19560e, user.id=3c51a462230b43258d50babe164f88e8) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:13:44.766980 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d42668-ee3f-41ce-8158-85c1214a9302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:13:44.768436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d42668-ee3f-41ce-8158-85c1214a9302 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:13:44.773946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 449/905] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:13:44 2022] GET /identity/v3/role_assignments?user.id=3c51a462230b43258d50babe164f88e8&scope.project.id=7bf28fc7b7984447b7d3199e6b19560e&role.id=5e3dfffec8aa470fab9232cc439aec74 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:13:54.621610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=49 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:13:54.771443 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:39.839969 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb78b32-1a82-4360-9a22-c8eb27486a35 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:39.839969 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb78b32-1a82-4360-9a22-c8eb27486a35 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:39.839969 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb78b32-1a82-4360-9a22-c8eb27486a35 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:39.841701 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 457/906] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:14:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:14:39.848240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda63c62-5f12-4c85-b6f8-c17aaef28c35 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:39.849346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda63c62-5f12-4c85-b6f8-c17aaef28c35 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:39.849712 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda63c62-5f12-4c85-b6f8-c17aaef28c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:39.874858 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bda63c62-5f12-4c85-b6f8-c17aaef28c35 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:14:39.876701 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bda63c62-5f12-4c85-b6f8-c17aaef28c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:14:39.974452 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 450/907] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:14:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:14:40.251782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb78b32-1a82-4360-9a22-c8eb27486a35 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:40.381276 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb78b32-1a82-4360-9a22-c8eb27486a35 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:40.418110 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a818b5b-2f7f-4f75-8f22-59b74e9d8e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:40.419298 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a818b5b-2f7f-4f75-8f22-59b74e9d8e1c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:40.419576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a818b5b-2f7f-4f75-8f22-59b74e9d8e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:40.419843 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a818b5b-2f7f-4f75-8f22-59b74e9d8e1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:40.430312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a818b5b-2f7f-4f75-8f22-59b74e9d8e1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:40.431782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a818b5b-2f7f-4f75-8f22-59b74e9d8e1c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:40.450922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9a818b5b-2f7f-4f75-8f22-59b74e9d8e1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:14:40.450922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:40.450922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:40.450922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:40.450922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:40.450922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:40.450922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:40.450922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:40.450922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:40.450922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:40.450922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:40.450922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:40.450922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:14:40.450922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:14:40.450922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:14:40.450922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:40.452046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:14:40.453027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:14:40.453027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:14:40.453027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:14:40.453027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 458/908] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:40.458499 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda63c62-5f12-4c85-b6f8-c17aaef28c35 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:40.581362 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda63c62-5f12-4c85-b6f8-c17aaef28c35 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:40.615875 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:40.623386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607f077-ed8f-41e0-b0ed-4650f12b431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:40.624059 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607f077-ed8f-41e0-b0ed-4650f12b431a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:40.624347 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607f077-ed8f-41e0-b0ed-4650f12b431a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:40.625098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607f077-ed8f-41e0-b0ed-4650f12b431a None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:40.625272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607f077-ed8f-41e0-b0ed-4650f12b431a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:40.625586 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607f077-ed8f-41e0-b0ed-4650f12b431a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:40.626951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607f077-ed8f-41e0-b0ed-4650f12b431a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:40.648196 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 451/909] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:14:40.649060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a818b5b-2f7f-4f75-8f22-59b74e9d8e1c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:40.723604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:40.790285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a818b5b-2f7f-4f75-8f22-59b74e9d8e1c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:40.843093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29294fcd-22fc-4c7b-a256-33b269486fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:40.843093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29294fcd-22fc-4c7b-a256-33b269486fc9 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:40.843093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29294fcd-22fc-4c7b-a256-33b269486fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:40.843093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29294fcd-22fc-4c7b-a256-33b269486fc9 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:40.844745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29294fcd-22fc-4c7b-a256-33b269486fc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:40.846458 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29294fcd-22fc-4c7b-a256-33b269486fc9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:40.874139 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 459/910] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 17 10:14:40 2022] POST /identity/v3/users => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:14:43.439862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f88071-5239-4fc9-be19-d089f008cfc0 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:43.440446 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f88071-5239-4fc9-be19-d089f008cfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:43.440639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f88071-5239-4fc9-be19-d089f008cfc0 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:43.442369 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 452/911] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:14:43.451397 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc4986-32c7-4e82-afbe-36139ee4d66c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:43.451397 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc4986-32c7-4e82-afbe-36139ee4d66c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:43.451397 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc4986-32c7-4e82-afbe-36139ee4d66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:43.468660 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-80cc4986-32c7-4e82-afbe-36139ee4d66c None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:14:43.470202 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-80cc4986-32c7-4e82-afbe-36139ee4d66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:14:43.550385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 460/912] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:14:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:14:43.893488 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f88071-5239-4fc9-be19-d089f008cfc0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:44.027194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f88071-5239-4fc9-be19-d089f008cfc0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:44.079545 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ed51f-bf6e-4f71-87d0-30e979912ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:44.080615 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ed51f-bf6e-4f71-87d0-30e979912ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:44.081100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ed51f-bf6e-4f71-87d0-30e979912ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:44.081441 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ed51f-bf6e-4f71-87d0-30e979912ca1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:44.096680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ed51f-bf6e-4f71-87d0-30e979912ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:14:44.103386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-288ed51f-bf6e-4f71-87d0-30e979912ca1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:14:44.103386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:44.103386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:44.103386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:44.103386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:44.103386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:44.103386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:44.103386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:44.103386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:44.103386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:44.103386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:44.103386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:44.103386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:14:44.103386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:14:44.103386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:14:44.103386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:14:44.104490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:14:44.104490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:14:44.104490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:14:44.104490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:14:44.104490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:44.104490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:44.104490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:44.104490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:44.104490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:44.104490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:44.104490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:44.104490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:44.104490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:44.104490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:44.104490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:44.104490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:44.105507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:44.105507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:44.105507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:44.105507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:44.105507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:14:44.105507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:14:44.105507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:14:44.105507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:14:44.105507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:14:44.105507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:14:44.105507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:14:44.105507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:14:44.105507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 453/913] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 17 10:14:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:44.111699 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc4986-32c7-4e82-afbe-36139ee4d66c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:44.162301 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:44.232875 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc4986-32c7-4e82-afbe-36139ee4d66c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:44.270304 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc65a8-d5c1-429a-9bf4-85d0b8fe23e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:44.270927 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc65a8-d5c1-429a-9bf4-85d0b8fe23e7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:44.271205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc65a8-d5c1-429a-9bf4-85d0b8fe23e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:44.271521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc65a8-d5c1-429a-9bf4-85d0b8fe23e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:44.272210 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc65a8-d5c1-429a-9bf4-85d0b8fe23e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:44.272497 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc65a8-d5c1-429a-9bf4-85d0b8fe23e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:44.274049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc65a8-d5c1-429a-9bf4-85d0b8fe23e7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:44.285034 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 461/914] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 17 10:14:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:14:44.289937 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ed51f-bf6e-4f71-87d0-30e979912ca1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:44.353505 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:44.407613 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ed51f-bf6e-4f71-87d0-30e979912ca1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:44.442004 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b4110-ad37-4aab-8a5a-43bf9569046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:44.442842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b4110-ad37-4aab-8a5a-43bf9569046c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:44.442842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b4110-ad37-4aab-8a5a-43bf9569046c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:44.443027 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b4110-ad37-4aab-8a5a-43bf9569046c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:44.453196 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b4110-ad37-4aab-8a5a-43bf9569046c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:44.454623 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b4110-ad37-4aab-8a5a-43bf9569046c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:44.469603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-590b4110-ad37-4aab-8a5a-43bf9569046c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:14:44.469603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:44.469603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:44.469603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:44.469603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:44.469603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:44.469603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:44.469603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:44.469603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:44.469603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:44.469603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:44.469603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:44.469603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:14:44.469603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:14:44.469603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:14:44.469603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:44.470796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:14:44.471877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:14:44.471877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:14:44.471877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:14:44.475412 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 454/915] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:44.476712 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc65a8-d5c1-429a-9bf4-85d0b8fe23e7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:44.585416 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:44.588748 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc65a8-d5c1-429a-9bf4-85d0b8fe23e7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:44.625204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af4f9f-1f34-41b5-9f8b-b005f52469d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:44.625839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af4f9f-1f34-41b5-9f8b-b005f52469d0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:44.626106 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af4f9f-1f34-41b5-9f8b-b005f52469d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:44.626405 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af4f9f-1f34-41b5-9f8b-b005f52469d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:44.627025 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af4f9f-1f34-41b5-9f8b-b005f52469d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:44.627452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af4f9f-1f34-41b5-9f8b-b005f52469d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:44.628892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af4f9f-1f34-41b5-9f8b-b005f52469d0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:44.642417 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 462/916] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:14:44.648508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b4110-ad37-4aab-8a5a-43bf9569046c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:44.759781 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b4110-ad37-4aab-8a5a-43bf9569046c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:44.761333 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:44.798695 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc1e94-1ab1-4e45-b88e-9af79f714a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:44.799313 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc1e94-1ab1-4e45-b88e-9af79f714a16 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:44.799589 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc1e94-1ab1-4e45-b88e-9af79f714a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:44.799855 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc1e94-1ab1-4e45-b88e-9af79f714a16 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:44.808688 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc1e94-1ab1-4e45-b88e-9af79f714a16 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:44.810666 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc1e94-1ab1-4e45-b88e-9af79f714a16 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:44.821940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-7cbc1e94-1ab1-4e45-b88e-9af79f714a16 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 17 10:14:44.821940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:44.821940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:44.821940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:44.821940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:44.821940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:44.821940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:44.821940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:44.821940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:44.821940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:44.821940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:44.821940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:44.821940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:14:44.821940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:14:44.821940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:14:44.821940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:44.822927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:44.823883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:44.823883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:44.823883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:14:44.823883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:14:44.823883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:14:44.823883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:14:44.823883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:14:44.823883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:14:44.823883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 17 10:14:44.823883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:14:44.823883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 455/917] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:14:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:44.831151 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af4f9f-1f34-41b5-9f8b-b005f52469d0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:44.942424 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af4f9f-1f34-41b5-9f8b-b005f52469d0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:44.979379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773008c-9a50-4eb9-946e-64baf455504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:44.980027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773008c-9a50-4eb9-946e-64baf455504c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:44.980305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773008c-9a50-4eb9-946e-64baf455504c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:44.980571 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773008c-9a50-4eb9-946e-64baf455504c None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:44.981839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773008c-9a50-4eb9-946e-64baf455504c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:44.982140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773008c-9a50-4eb9-946e-64baf455504c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:44.983618 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773008c-9a50-4eb9-946e-64baf455504c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:45.003103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 463/918] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Oct 17 10:14:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:14:45.008813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc1e94-1ab1-4e45-b88e-9af79f714a16 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:45.134170 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc1e94-1ab1-4e45-b88e-9af79f714a16 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:45.178640 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f389fcb-e311-4680-bf0f-dde4e3bec3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:45.179479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f389fcb-e311-4680-bf0f-dde4e3bec3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:45.179966 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f389fcb-e311-4680-bf0f-dde4e3bec3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:45.180397 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f389fcb-e311-4680-bf0f-dde4e3bec3e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:45.194947 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f389fcb-e311-4680-bf0f-dde4e3bec3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:45.196650 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f389fcb-e311-4680-bf0f-dde4e3bec3e7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:45.213363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-0f389fcb-e311-4680-bf0f-dde4e3bec3e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:14:45.213363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:45.213363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:45.213363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:45.213363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:45.213363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:45.213363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:45.213363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:45.213363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:45.213363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:45.213363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:45.213363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:45.213363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:14:45.213363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:14:45.213363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:14:45.213363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:45.214624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:14:45.216262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:14:45.216262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:14:45.216262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:14:45.216262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 456/919] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:45.221524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773008c-9a50-4eb9-946e-64baf455504c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:45.245741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:45.336397 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773008c-9a50-4eb9-946e-64baf455504c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:45.378463 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ef5c4-8212-4cd1-9b9b-07077bd48bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:45.379080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ef5c4-8212-4cd1-9b9b-07077bd48bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:45.379363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ef5c4-8212-4cd1-9b9b-07077bd48bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:45.379711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ef5c4-8212-4cd1-9b9b-07077bd48bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:45.380631 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ef5c4-8212-4cd1-9b9b-07077bd48bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:45.380904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ef5c4-8212-4cd1-9b9b-07077bd48bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:45.382429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ef5c4-8212-4cd1-9b9b-07077bd48bb9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:45.395969 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 464/920] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:14:45.401504 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f389fcb-e311-4680-bf0f-dde4e3bec3e7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:45.421158 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:45.513075 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f389fcb-e311-4680-bf0f-dde4e3bec3e7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:45.550604 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50631706-32a7-4501-80dd-eff43d7274c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:45.551230 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50631706-32a7-4501-80dd-eff43d7274c9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:45.551506 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50631706-32a7-4501-80dd-eff43d7274c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:45.551780 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50631706-32a7-4501-80dd-eff43d7274c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:45.559714 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50631706-32a7-4501-80dd-eff43d7274c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:45.561451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50631706-32a7-4501-80dd-eff43d7274c9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:45.573663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-50631706-32a7-4501-80dd-eff43d7274c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:14:45.573663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:45.573663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:45.573663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:45.573663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:45.573663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:45.573663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:45.573663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:45.573663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:45.573663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:45.573663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:45.573663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:45.573663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:14:45.573663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:14:45.573663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:45.574909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:45.575818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:14:45.575818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:14:45.575818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:14:45.575818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:14:45.575818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:14:45.575818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:14:45.575818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:14:45.575818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:14:45.575818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 457/921] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:14:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:45.580885 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ef5c4-8212-4cd1-9b9b-07077bd48bb9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:45.669409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:45.693219 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ef5c4-8212-4cd1-9b9b-07077bd48bb9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:45.733525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912d08a-031b-48dd-8722-ae34094f4d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:45.734563 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912d08a-031b-48dd-8722-ae34094f4d79 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:45.734877 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912d08a-031b-48dd-8722-ae34094f4d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:45.735150 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912d08a-031b-48dd-8722-ae34094f4d79 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:45.735913 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912d08a-031b-48dd-8722-ae34094f4d79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:45.736263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912d08a-031b-48dd-8722-ae34094f4d79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:45.737895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912d08a-031b-48dd-8722-ae34094f4d79 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:45.752729 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 465/922] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:14:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:14:45.759091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50631706-32a7-4501-80dd-eff43d7274c9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:45.839538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:45.865985 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50631706-32a7-4501-80dd-eff43d7274c9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:45.901256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b0f0f-80de-4b55-8b2b-c50e04c00d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:45.901934 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b0f0f-80de-4b55-8b2b-c50e04c00d66 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:45.902149 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b0f0f-80de-4b55-8b2b-c50e04c00d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:45.902415 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b0f0f-80de-4b55-8b2b-c50e04c00d66 None admin] PATH_INFO: `/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/dd52eee25ef347e1ae905cc3cba17284/roles/365b9c4c3245430e872f4aa988da3beb` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:45.917377 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b0f0f-80de-4b55-8b2b-c50e04c00d66 None admin] RBAC: Authorizing `identity:create_grant(project_id=07b2dd5de0274a6896d407b0ff22ff54, user_id=dd52eee25ef347e1ae905cc3cba17284, role_id=365b9c4c3245430e872f4aa988da3beb)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:45.919026 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b0f0f-80de-4b55-8b2b-c50e04c00d66 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:45.932740 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 458/923] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:14:45 2022] PUT /identity/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/dd52eee25ef347e1ae905cc3cba17284/roles/365b9c4c3245430e872f4aa988da3beb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:14:48.332796 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc9ebc-4231-4fc9-ab91-726d3cffea94 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:48.333319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc9ebc-4231-4fc9-ab91-726d3cffea94 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:48.333319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc9ebc-4231-4fc9-ab91-726d3cffea94 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:48.334516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 466/924] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:14:48.340020 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e940c3-0640-4931-b6ef-a3ab9779c321 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:48.340941 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e940c3-0640-4931-b6ef-a3ab9779c321 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:48.341085 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e940c3-0640-4931-b6ef-a3ab9779c321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:48.362535 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a4e940c3-0640-4931-b6ef-a3ab9779c321 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:14:48.363830 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a4e940c3-0640-4931-b6ef-a3ab9779c321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:14:48.439636 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 459/925] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:14:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:14:48.707404 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc9ebc-4231-4fc9-ab91-726d3cffea94 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:48.823828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc9ebc-4231-4fc9-ab91-726d3cffea94 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:48.876077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212778a3-63ed-41a7-971c-5d87c86e8fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:48.876745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212778a3-63ed-41a7-971c-5d87c86e8fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:48.876987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212778a3-63ed-41a7-971c-5d87c86e8fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:48.877261 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212778a3-63ed-41a7-971c-5d87c86e8fe3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:48.884658 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:48.890438 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212778a3-63ed-41a7-971c-5d87c86e8fe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:14:48.896226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-212778a3-63ed-41a7-971c-5d87c86e8fe3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:14:48.896226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:48.896226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:48.896226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:48.896226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:48.896226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:48.896226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:48.896226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:48.896226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:48.896226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:48.896226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:48.896226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:48.896226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:14:48.896226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:14:48.896226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:14:48.896226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:14:48.897346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:14:48.897346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:14:48.897346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:14:48.897346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:14:48.897346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:48.897346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:48.897346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:48.897346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:48.897346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:48.897346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:48.897346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:48.897346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:48.897346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:48.897346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:48.897346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:48.897346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:48.898222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:48.898222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:48.898222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:48.898222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:48.898222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:14:48.898222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:14:48.898222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:14:48.898222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:14:48.898222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:14:48.898222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:14:48.898222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 10:14:48.898222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:14:48.898222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 467/926] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 17 10:14:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:14:48.903561 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e940c3-0640-4931-b6ef-a3ab9779c321 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:48.966239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:49.020142 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e940c3-0640-4931-b6ef-a3ab9779c321 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:49.058148 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fb798-6a0b-4167-942d-eb6a92f353b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:49.058821 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fb798-6a0b-4167-942d-eb6a92f353b0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:49.059596 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fb798-6a0b-4167-942d-eb6a92f353b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:49.059914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fb798-6a0b-4167-942d-eb6a92f353b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:49.060598 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fb798-6a0b-4167-942d-eb6a92f353b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:49.060941 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fb798-6a0b-4167-942d-eb6a92f353b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:49.062465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fb798-6a0b-4167-942d-eb6a92f353b0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:49.071138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 460/927] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 17 10:14:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:14:49.077459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212778a3-63ed-41a7-971c-5d87c86e8fe3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:49.187235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212778a3-63ed-41a7-971c-5d87c86e8fe3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:49.225132 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556949f5-fdf6-44a7-86d1-ff51537ce5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:49.225771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556949f5-fdf6-44a7-86d1-ff51537ce5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:49.226129 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556949f5-fdf6-44a7-86d1-ff51537ce5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:49.226515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556949f5-fdf6-44a7-86d1-ff51537ce5a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:49.237635 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556949f5-fdf6-44a7-86d1-ff51537ce5a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:49.239198 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556949f5-fdf6-44a7-86d1-ff51537ce5a1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:49.254323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-556949f5-fdf6-44a7-86d1-ff51537ce5a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:14:49.254323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:49.254323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:49.254323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:49.254323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:49.254323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:49.254323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:49.254323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:49.254323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:49.254323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:49.254323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:49.254323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:49.254323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:14:49.254323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:14:49.254323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:14:49.254323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:49.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:14:49.256739 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:14:49.256739 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:14:49.256739 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:14:49.257668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 468/928] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:49.264418 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fb798-6a0b-4167-942d-eb6a92f353b0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:49.375005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fb798-6a0b-4167-942d-eb6a92f353b0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:49.392673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:49.413402 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9bbc9-8e88-4541-b44b-0353ddabe602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:49.414066 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9bbc9-8e88-4541-b44b-0353ddabe602 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:49.414443 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9bbc9-8e88-4541-b44b-0353ddabe602 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:49.414782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9bbc9-8e88-4541-b44b-0353ddabe602 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:49.415560 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9bbc9-8e88-4541-b44b-0353ddabe602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:49.415867 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9bbc9-8e88-4541-b44b-0353ddabe602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:49.417538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9bbc9-8e88-4541-b44b-0353ddabe602 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:49.432772 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 461/929] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:14:49.439085 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556949f5-fdf6-44a7-86d1-ff51537ce5a1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:49.497269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:49.554432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556949f5-fdf6-44a7-86d1-ff51537ce5a1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:49.588554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7ae5f-447e-45e3-b8b2-47a68a55ba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:49.589217 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ae5f-447e-45e3-b8b2-47a68a55ba71 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:49.589478 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ae5f-447e-45e3-b8b2-47a68a55ba71 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:49.589737 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ae5f-447e-45e3-b8b2-47a68a55ba71 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:49.598084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7ae5f-447e-45e3-b8b2-47a68a55ba71 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:49.599658 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7ae5f-447e-45e3-b8b2-47a68a55ba71 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:49.612235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-67c7ae5f-447e-45e3-b8b2-47a68a55ba71 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 17 10:14:49.612235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:49.612235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:49.612235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:49.612235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:49.612235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:49.612235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:49.612235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:49.612235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:49.612235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:49.612235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:49.612235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:49.612235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:14:49.612235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:14:49.612235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:14:49.612235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:49.613323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:49.614430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:49.614430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:49.614430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:14:49.614430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:14:49.614430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:14:49.614430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:14:49.614430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:14:49.614430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:14:49.614430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 17 10:14:49.614430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:14:49.614430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 469/930] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:14:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:49.619654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9bbc9-8e88-4541-b44b-0353ddabe602 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:49.730608 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9bbc9-8e88-4541-b44b-0353ddabe602 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:49.769550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f9b1f-55d3-40da-8ae7-6b5032f56e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:49.770094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f9b1f-55d3-40da-8ae7-6b5032f56e8e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:49.770375 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f9b1f-55d3-40da-8ae7-6b5032f56e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:49.770650 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f9b1f-55d3-40da-8ae7-6b5032f56e8e None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:49.771391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f9b1f-55d3-40da-8ae7-6b5032f56e8e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:49.771695 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f9b1f-55d3-40da-8ae7-6b5032f56e8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:49.773273 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f9b1f-55d3-40da-8ae7-6b5032f56e8e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:49.792222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 462/931] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Oct 17 10:14:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:14:49.798378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7ae5f-447e-45e3-b8b2-47a68a55ba71 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:49.904375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7ae5f-447e-45e3-b8b2-47a68a55ba71 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:49.917215 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:49.946288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa855de-c1f4-4633-9f90-091d15a0b908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:49.946903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa855de-c1f4-4633-9f90-091d15a0b908 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:49.947175 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa855de-c1f4-4633-9f90-091d15a0b908 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:49.947445 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa855de-c1f4-4633-9f90-091d15a0b908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:50.026326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa855de-c1f4-4633-9f90-091d15a0b908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:50.027733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa855de-c1f4-4633-9f90-091d15a0b908 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:50.139414 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 470/932] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:14:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 10:14:50.145588 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f9b1f-55d3-40da-8ae7-6b5032f56e8e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:50.182871 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:50.254255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f9b1f-55d3-40da-8ae7-6b5032f56e8e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:50.289523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc6f7c-addb-4ca4-a64d-e23f30f067b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:50.290102 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc6f7c-addb-4ca4-a64d-e23f30f067b9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:50.290384 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc6f7c-addb-4ca4-a64d-e23f30f067b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:50.290654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc6f7c-addb-4ca4-a64d-e23f30f067b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:50.301289 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc6f7c-addb-4ca4-a64d-e23f30f067b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:50.302729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc6f7c-addb-4ca4-a64d-e23f30f067b9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:50.318826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9cfc6f7c-addb-4ca4-a64d-e23f30f067b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:14:50.318826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:50.318826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:50.318826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:50.318826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:50.318826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:50.318826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:50.318826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:50.318826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:50.318826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:50.318826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:50.318826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:50.318826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:14:50.318826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:14:50.318826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:14:50.318826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:50.319880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:14:50.320805 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:14:50.320805 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:14:50.320805 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:14:50.320805 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 463/933] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:50.325912 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa855de-c1f4-4633-9f90-091d15a0b908 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:50.338348 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:50.433768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa855de-c1f4-4633-9f90-091d15a0b908 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:50.473379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d874bf9-0367-4fa9-a6cf-058dfd28ac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:50.474095 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d874bf9-0367-4fa9-a6cf-058dfd28ac55 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:50.474260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d874bf9-0367-4fa9-a6cf-058dfd28ac55 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:50.474527 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d874bf9-0367-4fa9-a6cf-058dfd28ac55 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:50.475168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d874bf9-0367-4fa9-a6cf-058dfd28ac55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:50.475470 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d874bf9-0367-4fa9-a6cf-058dfd28ac55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:50.477009 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d874bf9-0367-4fa9-a6cf-058dfd28ac55 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:50.490635 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 471/934] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:14:50.496661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc6f7c-addb-4ca4-a64d-e23f30f067b9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:50.589797 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:50.606038 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc6f7c-addb-4ca4-a64d-e23f30f067b9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:50.642375 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf1334-37b8-45db-a0d3-94a82a482ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:50.642997 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf1334-37b8-45db-a0d3-94a82a482ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:50.643278 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf1334-37b8-45db-a0d3-94a82a482ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:50.643626 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf1334-37b8-45db-a0d3-94a82a482ab2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:50.650681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf1334-37b8-45db-a0d3-94a82a482ab2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:50.652144 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf1334-37b8-45db-a0d3-94a82a482ab2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:50.663550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-95bf1334-37b8-45db-a0d3-94a82a482ab2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:14:50.663550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:50.663550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:50.663550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:50.663550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:50.663550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:50.663550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:50.663550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:50.663550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:50.663550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:50.663550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:50.663550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:50.663550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:14:50.663550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:14:50.663550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:50.664649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:50.671078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:14:50.671078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:14:50.671078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:14:50.671078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:14:50.671078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:14:50.671078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:14:50.671078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:14:50.671078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:14:50.671078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 464/935] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:14:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:50.671675 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d874bf9-0367-4fa9-a6cf-058dfd28ac55 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:50.748693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:50.784785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d874bf9-0367-4fa9-a6cf-058dfd28ac55 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:50.821238 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5aad90-f380-4118-8e5b-1496bdb7d2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:50.821972 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5aad90-f380-4118-8e5b-1496bdb7d2ca None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:50.822259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5aad90-f380-4118-8e5b-1496bdb7d2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:50.822521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5aad90-f380-4118-8e5b-1496bdb7d2ca None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:50.823318 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5aad90-f380-4118-8e5b-1496bdb7d2ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:50.823660 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5aad90-f380-4118-8e5b-1496bdb7d2ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:50.825362 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5aad90-f380-4118-8e5b-1496bdb7d2ca None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:50.838014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 472/936] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:14:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:14:50.844690 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf1334-37b8-45db-a0d3-94a82a482ab2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:50.954902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf1334-37b8-45db-a0d3-94a82a482ab2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:50.995560 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c27a94-5147-496e-b8ea-6d69fc403ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:50.996329 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c27a94-5147-496e-b8ea-6d69fc403ebd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:50.996611 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c27a94-5147-496e-b8ea-6d69fc403ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:50.997384 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c27a94-5147-496e-b8ea-6d69fc403ebd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:50.998118 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c27a94-5147-496e-b8ea-6d69fc403ebd None admin] RBAC: Adding query filter params (role.id=365b9c4c3245430e872f4aa988da3beb, scope.project.id=07b2dd5de0274a6896d407b0ff22ff54, user.id=dd52eee25ef347e1ae905cc3cba17284) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:50.998425 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c27a94-5147-496e-b8ea-6d69fc403ebd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:50.999872 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c27a94-5147-496e-b8ea-6d69fc403ebd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:51.005963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 465/937] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:14:50 2022] GET /identity/v3/role_assignments?user.id=dd52eee25ef347e1ae905cc3cba17284&scope.project.id=07b2dd5de0274a6896d407b0ff22ff54&role.id=365b9c4c3245430e872f4aa988da3beb => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:14:53.384777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d68bd9-d5f3-45f5-ad3f-155f4c81a025 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:53.385313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d68bd9-d5f3-45f5-ad3f-155f4c81a025 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:53.385443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d68bd9-d5f3-45f5-ad3f-155f4c81a025 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:53.387417 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 473/938] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:14:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:14:53.394094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04121e-a7f7-4e85-9420-82c110d00dfa None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:53.394526 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04121e-a7f7-4e85-9420-82c110d00dfa None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:53.394661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04121e-a7f7-4e85-9420-82c110d00dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:53.413211 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4f04121e-a7f7-4e85-9420-82c110d00dfa None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:14:53.414497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4f04121e-a7f7-4e85-9420-82c110d00dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:14:53.417676 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:53.488128 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 466/939] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:14:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:14:53.764396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d68bd9-d5f3-45f5-ad3f-155f4c81a025 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:53.875616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d68bd9-d5f3-45f5-ad3f-155f4c81a025 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:53.905857 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:53.912768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53af519-a59a-4541-8da5-0392117ec52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:53.913404 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53af519-a59a-4541-8da5-0392117ec52e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:53.913732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53af519-a59a-4541-8da5-0392117ec52e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:53.914021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53af519-a59a-4541-8da5-0392117ec52e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:53.926361 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53af519-a59a-4541-8da5-0392117ec52e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:14:53.932302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e53af519-a59a-4541-8da5-0392117ec52e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:14:53.932302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:53.932302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:53.932302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:53.932302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:53.932302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:53.932302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:53.932302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:53.932302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:53.932302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:53.932302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:53.932302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:53.932302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:14:53.932302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:14:53.932302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:14:53.932302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:14:53.933593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:14:53.933593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:14:53.933593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:14:53.933593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:14:53.933593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:53.933593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:53.933593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:53.933593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:53.933593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:53.933593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:53.933593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:53.933593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:53.933593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:53.933593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:53.933593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:53.933593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:53.935099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:53.935099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:53.935099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:53.935099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:53.935099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:14:53.935099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:14:53.935099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:14:53.935099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:14:53.935099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:14:53.935099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:14:53.935099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:14:53.935099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:14:53.935099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 474/940] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:14:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:53.940696 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04121e-a7f7-4e85-9420-82c110d00dfa None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:54.055467 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04121e-a7f7-4e85-9420-82c110d00dfa None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:54.101083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc61b7c-bd44-46c0-85d1-bf55f33f510f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:54.101697 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc61b7c-bd44-46c0-85d1-bf55f33f510f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:54.101970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc61b7c-bd44-46c0-85d1-bf55f33f510f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:54.102237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc61b7c-bd44-46c0-85d1-bf55f33f510f None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:54.102909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc61b7c-bd44-46c0-85d1-bf55f33f510f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:54.103187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc61b7c-bd44-46c0-85d1-bf55f33f510f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:54.104689 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc61b7c-bd44-46c0-85d1-bf55f33f510f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:54.114114 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 467/941] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:14:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:14:54.120299 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53af519-a59a-4541-8da5-0392117ec52e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:54.223291 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53af519-a59a-4541-8da5-0392117ec52e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:54.262677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9815d-102a-46d3-b45c-68972f98111d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:54.263309 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9815d-102a-46d3-b45c-68972f98111d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:54.263584 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9815d-102a-46d3-b45c-68972f98111d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:54.263856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9815d-102a-46d3-b45c-68972f98111d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:54.274756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9815d-102a-46d3-b45c-68972f98111d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:54.276239 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9815d-102a-46d3-b45c-68972f98111d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:54.295172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-97e9815d-102a-46d3-b45c-68972f98111d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:14:54.295172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:54.295172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:54.295172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:54.295172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:54.295172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:54.295172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:54.295172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:54.295172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:54.295172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:54.295172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:54.295172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:54.295172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:14:54.295172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:14:54.295172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:14:54.295172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:54.296386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:14:54.297454 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:14:54.297454 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:14:54.297454 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:14:54.297454 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 475/942] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:54.302132 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc61b7c-bd44-46c0-85d1-bf55f33f510f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:54.305050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:54.408814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc61b7c-bd44-46c0-85d1-bf55f33f510f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:54.446417 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b26227-f7c7-4a30-80ae-840bde636e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:54.447079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b26227-f7c7-4a30-80ae-840bde636e94 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:54.447356 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b26227-f7c7-4a30-80ae-840bde636e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:54.447578 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b26227-f7c7-4a30-80ae-840bde636e94 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:54.448303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b26227-f7c7-4a30-80ae-840bde636e94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:54.448652 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b26227-f7c7-4a30-80ae-840bde636e94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:54.450584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b26227-f7c7-4a30-80ae-840bde636e94 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:54.470511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 468/943] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:14:54.471769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9815d-102a-46d3-b45c-68972f98111d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:54.515812 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:54.574178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9815d-102a-46d3-b45c-68972f98111d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:54.610681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8708a-9cd5-4e89-9302-04eea99c2f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:54.611310 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8708a-9cd5-4e89-9302-04eea99c2f49 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:54.611590 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8708a-9cd5-4e89-9302-04eea99c2f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:54.611862 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8708a-9cd5-4e89-9302-04eea99c2f49 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:54.619350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8708a-9cd5-4e89-9302-04eea99c2f49 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:54.620831 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8708a-9cd5-4e89-9302-04eea99c2f49 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:54.632545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e5a8708a-9cd5-4e89-9302-04eea99c2f49 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 17 10:14:54.632545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:54.632545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:54.632545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:54.632545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:54.632545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:54.632545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:54.632545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:54.632545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:54.632545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:54.632545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:54.632545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:54.632545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:14:54.632545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:14:54.632545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:14:54.632545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:54.633865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:54.634995 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:54.634995 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:54.634995 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:14:54.634995 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:14:54.634995 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:14:54.634995 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:14:54.634995 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:14:54.634995 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:14:54.634995 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 17 10:14:54.634995 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:14:54.634995 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 476/944] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:14:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:54.640202 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b26227-f7c7-4a30-80ae-840bde636e94 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:54.711587 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:54.756876 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b26227-f7c7-4a30-80ae-840bde636e94 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:54.795263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927ce69-95ad-450f-a99a-06a94c1be967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:54.795841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ce69-95ad-450f-a99a-06a94c1be967 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:54.796148 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ce69-95ad-450f-a99a-06a94c1be967 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:54.796434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ce69-95ad-450f-a99a-06a94c1be967 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:54.797140 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927ce69-95ad-450f-a99a-06a94c1be967 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:54.797467 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927ce69-95ad-450f-a99a-06a94c1be967 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:54.798869 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927ce69-95ad-450f-a99a-06a94c1be967 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:54.817010 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 469/945] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Oct 17 10:14:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:14:54.823425 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8708a-9cd5-4e89-9302-04eea99c2f49 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:54.931019 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8708a-9cd5-4e89-9302-04eea99c2f49 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:54.932605 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:54.969125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e624dc0-415e-4b7e-824a-33f52cbcad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:54.969694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e624dc0-415e-4b7e-824a-33f52cbcad44 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:54.969978 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e624dc0-415e-4b7e-824a-33f52cbcad44 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:54.970245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e624dc0-415e-4b7e-824a-33f52cbcad44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:54.980975 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e624dc0-415e-4b7e-824a-33f52cbcad44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:54.982453 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e624dc0-415e-4b7e-824a-33f52cbcad44 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:54.997961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9e624dc0-415e-4b7e-824a-33f52cbcad44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:14:54.997961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:54.997961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:54.997961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:54.997961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:54.997961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:54.997961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:54.997961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:54.997961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:54.997961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:54.997961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:54.997961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:54.997961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:14:54.997961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:14:54.997961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:14:54.997961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:54.998940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:14:55.000291 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:14:55.000291 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:14:55.000291 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:14:55.000291 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 477/946] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:55.005024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927ce69-95ad-450f-a99a-06a94c1be967 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:55.111076 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927ce69-95ad-450f-a99a-06a94c1be967 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:55.133972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:55.149728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd11c4-e89d-4b57-9293-0bdaf17ec056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:55.150336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd11c4-e89d-4b57-9293-0bdaf17ec056 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:55.150614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd11c4-e89d-4b57-9293-0bdaf17ec056 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:55.150935 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd11c4-e89d-4b57-9293-0bdaf17ec056 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:55.151523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd11c4-e89d-4b57-9293-0bdaf17ec056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:55.151870 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd11c4-e89d-4b57-9293-0bdaf17ec056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:55.153432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd11c4-e89d-4b57-9293-0bdaf17ec056 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:55.165796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 470/947] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:14:55.172201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e624dc0-415e-4b7e-824a-33f52cbcad44 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:55.284148 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e624dc0-415e-4b7e-824a-33f52cbcad44 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:55.318582 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629f55f-0501-4dce-ac84-078882f637a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:55.319135 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f55f-0501-4dce-ac84-078882f637a9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:55.319445 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f55f-0501-4dce-ac84-078882f637a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:55.319736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f55f-0501-4dce-ac84-078882f637a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:55.326742 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629f55f-0501-4dce-ac84-078882f637a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:55.328216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629f55f-0501-4dce-ac84-078882f637a9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:55.340250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8629f55f-0501-4dce-ac84-078882f637a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:14:55.340250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:55.340250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:55.340250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:55.340250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:55.340250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:55.340250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:55.340250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:55.340250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:55.340250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:55.340250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:55.340250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:55.340250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:14:55.340250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:14:55.340250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:55.341331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:55.346793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:14:55.346793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:14:55.346793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:14:55.346793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:14:55.346793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:14:55.346793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:14:55.346793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:14:55.346793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:14:55.346793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 478/948] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:14:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:55.347519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd11c4-e89d-4b57-9293-0bdaf17ec056 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:55.459568 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd11c4-e89d-4b57-9293-0bdaf17ec056 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:55.497747 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140553f5-8a38-4564-a584-beea9175b1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:55.498366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140553f5-8a38-4564-a584-beea9175b1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:55.498654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140553f5-8a38-4564-a584-beea9175b1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:55.498924 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140553f5-8a38-4564-a584-beea9175b1f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:55.499611 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140553f5-8a38-4564-a584-beea9175b1f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:55.499921 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140553f5-8a38-4564-a584-beea9175b1f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:55.501428 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140553f5-8a38-4564-a584-beea9175b1f4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:55.514552 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 471/949] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:14:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:14:55.520681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629f55f-0501-4dce-ac84-078882f637a9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:55.538855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:55.641991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629f55f-0501-4dce-ac84-078882f637a9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:55.682093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed7e5f-0379-43ca-87fd-42ae9f405380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:55.682811 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7e5f-0379-43ca-87fd-42ae9f405380 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:55.683148 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7e5f-0379-43ca-87fd-42ae9f405380 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:55.683413 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7e5f-0379-43ca-87fd-42ae9f405380 None admin] PATH_INFO: `/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/dd52eee25ef347e1ae905cc3cba17284/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:55.685401 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed7e5f-0379-43ca-87fd-42ae9f405380 None admin] RBAC: Authorizing `identity:create_grant(project_id=07b2dd5de0274a6896d407b0ff22ff54, user_id=dd52eee25ef347e1ae905cc3cba17284, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:55.686948 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed7e5f-0379-43ca-87fd-42ae9f405380 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:55.700235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 479/950] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 17 10:14:55 2022] PUT /identity/v3/projects/07b2dd5de0274a6896d407b0ff22ff54/users/dd52eee25ef347e1ae905cc3cba17284/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:14:58.107955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf4278-8652-44b5-bf18-80cebb64b004 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:58.108479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf4278-8652-44b5-bf18-80cebb64b004 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:58.108574 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf4278-8652-44b5-bf18-80cebb64b004 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:58.110283 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 472/951] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:14:58.116384 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680ae2-b1b8-4762-91ed-86c85c182496 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:58.116852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680ae2-b1b8-4762-91ed-86c85c182496 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:58.117059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680ae2-b1b8-4762-91ed-86c85c182496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:58.135559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2c680ae2-b1b8-4762-91ed-86c85c182496 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:14:58.137095 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2c680ae2-b1b8-4762-91ed-86c85c182496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:14:58.210627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 480/952] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:14:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:14:58.500689 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf4278-8652-44b5-bf18-80cebb64b004 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:58.549506 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:58.613272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf4278-8652-44b5-bf18-80cebb64b004 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:58.651579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7355d71-a2eb-40e6-9623-16fd3e8a5697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:58.652236 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7355d71-a2eb-40e6-9623-16fd3e8a5697 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:58.652517 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7355d71-a2eb-40e6-9623-16fd3e8a5697 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:58.653878 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7355d71-a2eb-40e6-9623-16fd3e8a5697 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:58.664330 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7355d71-a2eb-40e6-9623-16fd3e8a5697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 10:14:58.669745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d7355d71-a2eb-40e6-9623-16fd3e8a5697 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:14:58.669745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:58.669745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:58.669745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:58.669745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:58.669745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:58.669745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:58.669745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:58.669745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:58.669745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:58.669745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:58.669745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:58.669745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 10:14:58.669745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 10:14:58.669745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 10:14:58.669745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 10:14:58.671052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 10:14:58.671052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 10:14:58.671052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 10:14:58.671052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 10:14:58.671052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:58.671052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:58.671052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:58.671052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:58.671052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:58.671052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:58.671052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:58.671052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:58.671052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:58.671052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:58.671052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:58.671052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:58.672434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:58.672434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:58.672434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:58.672434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:58.672434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 10:14:58.672434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 10:14:58.672434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 10:14:58.672434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 10:14:58.672434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 10:14:58.672434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 10:14:58.672434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 10:14:58.672434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:14:58.672434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 473/953] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 17 10:14:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:58.677087 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c680ae2-b1b8-4762-91ed-86c85c182496 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:58.680133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:58.790640 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c680ae2-b1b8-4762-91ed-86c85c182496 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:58.830076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c233339-88c1-4b07-abf8-cd041af9224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:58.830779 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c233339-88c1-4b07-abf8-cd041af9224c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:58.831060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c233339-88c1-4b07-abf8-cd041af9224c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:58.831334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c233339-88c1-4b07-abf8-cd041af9224c None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:58.832032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c233339-88c1-4b07-abf8-cd041af9224c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:58.832336 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c233339-88c1-4b07-abf8-cd041af9224c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:58.833715 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c233339-88c1-4b07-abf8-cd041af9224c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:58.843177 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 481/954] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 17 10:14:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:14:58.849103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7355d71-a2eb-40e6-9623-16fd3e8a5697 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:58.956651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:58.959748 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7355d71-a2eb-40e6-9623-16fd3e8a5697 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:59.000874 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb9eee-21ff-4b6d-8dce-a5e33c927b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:59.001529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb9eee-21ff-4b6d-8dce-a5e33c927b5e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:59.001862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb9eee-21ff-4b6d-8dce-a5e33c927b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:59.002133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb9eee-21ff-4b6d-8dce-a5e33c927b5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:59.013159 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb9eee-21ff-4b6d-8dce-a5e33c927b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:59.014674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb9eee-21ff-4b6d-8dce-a5e33c927b5e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:59.029929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3bdb9eee-21ff-4b6d-8dce-a5e33c927b5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:14:59.029929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:59.029929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:59.029929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:59.029929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:59.029929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:59.029929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:59.029929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:59.029929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:59.029929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:59.029929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:59.029929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:59.029929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:14:59.029929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:14:59.029929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:14:59.029929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:59.031451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:14:59.032768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:14:59.032768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:14:59.032768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:14:59.032768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 474/955] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 10:14:59.037308 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c233339-88c1-4b07-abf8-cd041af9224c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:59.110737 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:59.149683 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c233339-88c1-4b07-abf8-cd041af9224c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:59.185363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa05100-dc80-46c0-b1f4-05aba164bb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:59.185982 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa05100-dc80-46c0-b1f4-05aba164bb0a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:59.186258 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa05100-dc80-46c0-b1f4-05aba164bb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:59.186525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa05100-dc80-46c0-b1f4-05aba164bb0a None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:59.187177 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa05100-dc80-46c0-b1f4-05aba164bb0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:59.187488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa05100-dc80-46c0-b1f4-05aba164bb0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:59.188913 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa05100-dc80-46c0-b1f4-05aba164bb0a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:59.202395 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 482/956] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:14:59.208483 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb9eee-21ff-4b6d-8dce-a5e33c927b5e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:59.313491 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb9eee-21ff-4b6d-8dce-a5e33c927b5e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:59.348083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28447db7-c58c-4ee3-aec1-5ce1fbc69a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:59.348633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28447db7-c58c-4ee3-aec1-5ce1fbc69a6b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:59.348908 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28447db7-c58c-4ee3-aec1-5ce1fbc69a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:59.349176 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28447db7-c58c-4ee3-aec1-5ce1fbc69a6b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:59.357359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28447db7-c58c-4ee3-aec1-5ce1fbc69a6b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:59.358813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28447db7-c58c-4ee3-aec1-5ce1fbc69a6b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:59.371255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-28447db7-c58c-4ee3-aec1-5ce1fbc69a6b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 17 10:14:59.371255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:14:59.371255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:14:59.371255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:14:59.371255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:14:59.371255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:14:59.371255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:14:59.371255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:14:59.371255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:14:59.371255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:14:59.371255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:14:59.371255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:14:59.371255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 10:14:59.371255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 10:14:59.371255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 10:14:59.371255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:14:59.372968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:14:59.373923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:14:59.373923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:14:59.373923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 10:14:59.373923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 10:14:59.373923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 10:14:59.373923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 10:14:59.373923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 10:14:59.373923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 10:14:59.373923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 17 10:14:59.373923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:14:59.373923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 475/957] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:14:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:14:59.379357 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa05100-dc80-46c0-b1f4-05aba164bb0a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:59.481009 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa05100-dc80-46c0-b1f4-05aba164bb0a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:59.508005 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:59.517208 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46297e4-e3e7-499e-9567-2ae2909ff6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:59.517884 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46297e4-e3e7-499e-9567-2ae2909ff6ca None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:59.518169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46297e4-e3e7-499e-9567-2ae2909ff6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:59.518443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46297e4-e3e7-499e-9567-2ae2909ff6ca None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:59.519176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46297e4-e3e7-499e-9567-2ae2909ff6ca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:14:59.519483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46297e4-e3e7-499e-9567-2ae2909ff6ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:59.520957 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46297e4-e3e7-499e-9567-2ae2909ff6ca None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:59.538840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 483/958] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Oct 17 10:14:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:14:59.545196 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28447db7-c58c-4ee3-aec1-5ce1fbc69a6b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:59.561412 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:59.646988 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28447db7-c58c-4ee3-aec1-5ce1fbc69a6b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:59.681318 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355542f-444a-44c2-a1c6-9f758cc8a72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:59.681923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355542f-444a-44c2-a1c6-9f758cc8a72b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:59.682201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355542f-444a-44c2-a1c6-9f758cc8a72b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:59.682471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355542f-444a-44c2-a1c6-9f758cc8a72b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:14:59.758764 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355542f-444a-44c2-a1c6-9f758cc8a72b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:14:59.760471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355542f-444a-44c2-a1c6-9f758cc8a72b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:14:59.776475 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:14:59.858234 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 476/959] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 17 10:14:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 17 10:14:59.864324 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46297e4-e3e7-499e-9567-2ae2909ff6ca None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:14:59.959167 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46297e4-e3e7-499e-9567-2ae2909ff6ca None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:14:59.992610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d157c1e-140f-460f-ac7d-35b98166af29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:14:59.993219 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d157c1e-140f-460f-ac7d-35b98166af29 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:14:59.993494 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d157c1e-140f-460f-ac7d-35b98166af29 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:14:59.993764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d157c1e-140f-460f-ac7d-35b98166af29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:00.003852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d157c1e-140f-460f-ac7d-35b98166af29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:15:00.005326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d157c1e-140f-460f-ac7d-35b98166af29 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:15:00.019325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8d157c1e-140f-460f-ac7d-35b98166af29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:15:00.019325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:15:00.019325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:15:00.019325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:15:00.019325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:15:00.019325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:15:00.019325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:15:00.019325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:15:00.019325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:15:00.019325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:15:00.019325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:15:00.019325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:15:00.019325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 10:15:00.019325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 10:15:00.019325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 10:15:00.019325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:15:00.020410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 10:15:00.021288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 10:15:00.021288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 10:15:00.021288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:15:00.021288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 484/960] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:15:00.025914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355542f-444a-44c2-a1c6-9f758cc8a72b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:15:00.121070 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355542f-444a-44c2-a1c6-9f758cc8a72b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:15:00.133481 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:15:00.154223 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07d152-0c36-4848-b186-78ad87fb61d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:15:00.154809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07d152-0c36-4848-b186-78ad87fb61d8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:00.155083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07d152-0c36-4848-b186-78ad87fb61d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:00.155350 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07d152-0c36-4848-b186-78ad87fb61d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:00.156007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07d152-0c36-4848-b186-78ad87fb61d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:15:00.156306 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07d152-0c36-4848-b186-78ad87fb61d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:15:00.157651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07d152-0c36-4848-b186-78ad87fb61d8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:15:00.168476 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 477/961] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 17 10:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:15:00.174812 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d157c1e-140f-460f-ac7d-35b98166af29 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:15:00.208350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:15:00.270831 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d157c1e-140f-460f-ac7d-35b98166af29 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:15:00.302598 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7fbc3-d883-4d2f-a47d-49159cba7759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:15:00.303206 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7fbc3-d883-4d2f-a47d-49159cba7759 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:00.303483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7fbc3-d883-4d2f-a47d-49159cba7759 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:00.303754 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7fbc3-d883-4d2f-a47d-49159cba7759 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:00.310579 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7fbc3-d883-4d2f-a47d-49159cba7759 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:15:00.312040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7fbc3-d883-4d2f-a47d-49159cba7759 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:15:00.322798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-50e7fbc3-d883-4d2f-a47d-49159cba7759 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:15:00.322798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:15:00.322798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:15:00.322798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:15:00.322798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:15:00.322798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:15:00.322798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:15:00.322798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:15:00.322798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:15:00.322798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:15:00.322798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:15:00.322798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:15:00.322798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 10:15:00.322798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 10:15:00.322798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:15:00.323836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:15:00.325718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 10:15:00.325718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 10:15:00.325718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 10:15:00.325718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 10:15:00.325718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 10:15:00.325718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 10:15:00.325718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 10:15:00.325718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Oct 17 10:15:00.325718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 485/962] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 17 10:15:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:15:00.330187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07d152-0c36-4848-b186-78ad87fb61d8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:15:00.425155 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07d152-0c36-4848-b186-78ad87fb61d8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:15:00.457273 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f1af7-f310-41fb-857a-b6a2d151502d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:15:00.457854 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f1af7-f310-41fb-857a-b6a2d151502d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:00.458132 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f1af7-f310-41fb-857a-b6a2d151502d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:00.458403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f1af7-f310-41fb-857a-b6a2d151502d None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:00.459084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f1af7-f310-41fb-857a-b6a2d151502d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:15:00.459389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f1af7-f310-41fb-857a-b6a2d151502d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:15:00.460834 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f1af7-f310-41fb-857a-b6a2d151502d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:15:00.472879 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 478/963] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 17 10:15:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:15:00.478669 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7fbc3-d883-4d2f-a47d-49159cba7759 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:15:00.568462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:15:00.574395 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7fbc3-d883-4d2f-a47d-49159cba7759 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:15:00.607115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc902f-6608-4912-81f7-f8522049c01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:15:00.607700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc902f-6608-4912-81f7-f8522049c01f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:00.608005 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc902f-6608-4912-81f7-f8522049c01f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:00.608282 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc902f-6608-4912-81f7-f8522049c01f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:00.608993 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc902f-6608-4912-81f7-f8522049c01f None admin] RBAC: Adding query filter params (role.id=5e3dfffec8aa470fab9232cc439aec74, scope.project.id=07b2dd5de0274a6896d407b0ff22ff54, user.id=dd52eee25ef347e1ae905cc3cba17284) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:15:00.609296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc902f-6608-4912-81f7-f8522049c01f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:15:00.610959 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc902f-6608-4912-81f7-f8522049c01f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:15:00.616489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 486/964] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 17 10:15:00 2022] GET /identity/v3/role_assignments?user.id=dd52eee25ef347e1ae905cc3cba17284&scope.project.id=07b2dd5de0274a6896d407b0ff22ff54&role.id=5e3dfffec8aa470fab9232cc439aec74 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:15:02.759427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad625aa-7cbf-404b-a6df-733db05cd3c3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:02.760121 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad625aa-7cbf-404b-a6df-733db05cd3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:02.760121 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad625aa-7cbf-404b-a6df-733db05cd3c3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:02.761309 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 479/965] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:15:02.767265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613ad8-9340-4aa5-b195-b37d7564694d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:02.767786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613ad8-9340-4aa5-b195-b37d7564694d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:02.767875 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613ad8-9340-4aa5-b195-b37d7564694d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:02.786714 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b9613ad8-9340-4aa5-b195-b37d7564694d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:15:02.787906 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b9613ad8-9340-4aa5-b195-b37d7564694d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:15:02.851730 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 487/966] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:15:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:15:03.121612 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad625aa-7cbf-404b-a6df-733db05cd3c3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:15:03.152815 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:15:03.221654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad625aa-7cbf-404b-a6df-733db05cd3c3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:15:03.253651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaac3f-cd73-4ace-96c2-bf995e07d0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:15:03.254258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaac3f-cd73-4ace-96c2-bf995e07d0de None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:03.254532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaac3f-cd73-4ace-96c2-bf995e07d0de None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:03.254798 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaac3f-cd73-4ace-96c2-bf995e07d0de None admin] PATH_INFO: `/v3/services/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:03.255366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacaac3f-cd73-4ace-96c2-bf995e07d0de None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:15:03.256731 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacaac3f-cd73-4ace-96c2-bf995e07d0de None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-bacaac3f-cd73-4ace-96c2-bf995e07d0de None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:15:03.265691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:15:03.266861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:15:03.266861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:15:03.266861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:15:03.266861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:15:03.266861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:15:03.266861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:15:03.266861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:15:03.266861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:15:03.266861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:15:03.266861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:15:03.266861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:15:03.266861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:15:03.266861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:15:03.266861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:15:03.266861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:15:03.266861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:15:03.267841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:15:03.267841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:15:03.267841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:15:03.267841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:15:03.267841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:15:03.267841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:15:03.267841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:15:03.267841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:15:03.267841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:15:03.267841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:15:03.267841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:15:03.267841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:15:03.267841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 10:15:03.267841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:15:03.267841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 480/967] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Oct 17 10:15:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:15:03.272800 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9613ad8-9340-4aa5-b195-b37d7564694d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:15:03.357070 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:15:03.367403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9613ad8-9340-4aa5-b195-b37d7564694d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:15:03.400365 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ab6b8-39ea-4a88-9708-2986250e4913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:15:03.400956 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ab6b8-39ea-4a88-9708-2986250e4913 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:03.401233 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ab6b8-39ea-4a88-9708-2986250e4913 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:03.401527 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ab6b8-39ea-4a88-9708-2986250e4913 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:03.402144 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ab6b8-39ea-4a88-9708-2986250e4913 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:15:03.402444 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ab6b8-39ea-4a88-9708-2986250e4913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:15:03.403820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ab6b8-39ea-4a88-9708-2986250e4913 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:15:03.408473 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 488/968] 10.222.0.13 () {56 vars in 1116 bytes} [Mon Oct 17 10:15:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:15:03.414110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaac3f-cd73-4ace-96c2-bf995e07d0de None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:15:03.505552 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:15:03.511628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaac3f-cd73-4ace-96c2-bf995e07d0de None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:15:03.543088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bef4b2-d025-4039-b32a-67f353d22e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:15:03.544215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bef4b2-d025-4039-b32a-67f353d22e4b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:03.544494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bef4b2-d025-4039-b32a-67f353d22e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:03.544763 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bef4b2-d025-4039-b32a-67f353d22e4b None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:03.545376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bef4b2-d025-4039-b32a-67f353d22e4b None admin] RBAC: Adding query filter params (type=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:15:03.545676 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bef4b2-d025-4039-b32a-67f353d22e4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:15:03.547021 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bef4b2-d025-4039-b32a-67f353d22e4b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:15:03.551207 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 481/969] 10.222.0.13 () {56 vars in 1116 bytes} [Mon Oct 17 10:15:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:15:05.657976 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac320459-60f3-43b0-ad93-785e15c52c92 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:05.658504 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac320459-60f3-43b0-ad93-785e15c52c92 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:05.658622 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac320459-60f3-43b0-ad93-785e15c52c92 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:05.659870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 489/970] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:15:05.665197 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dee2e-d5b4-4c9e-8981-0fefcdf70856 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:05.665632 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dee2e-d5b4-4c9e-8981-0fefcdf70856 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:05.665749 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dee2e-d5b4-4c9e-8981-0fefcdf70856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:05.686131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3b6dee2e-d5b4-4c9e-8981-0fefcdf70856 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:15:05.687309 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3b6dee2e-d5b4-4c9e-8981-0fefcdf70856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:15:05.758797 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 482/971] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:15:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:15:06.026016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac320459-60f3-43b0-ad93-785e15c52c92 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:15:06.124727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac320459-60f3-43b0-ad93-785e15c52c92 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:15:06.160201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2244d2-f773-42a8-ad74-401e37005115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:15:06.161199 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2244d2-f773-42a8-ad74-401e37005115 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:06.161521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2244d2-f773-42a8-ad74-401e37005115 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:06.161797 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2244d2-f773-42a8-ad74-401e37005115 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:06.162465 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2244d2-f773-42a8-ad74-401e37005115 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:15:06.163864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2244d2-f773-42a8-ad74-401e37005115 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:15:06.178140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 490/972] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 17 10:15:06 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:15:08.329071 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80223791-79eb-417f-8d63-877a45bbcf59 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:08.329591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80223791-79eb-417f-8d63-877a45bbcf59 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:08.329591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80223791-79eb-417f-8d63-877a45bbcf59 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:08.330862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 483/973] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:15:08.335906 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283394e4-4eb3-4a9b-8161-331a7b3981af None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:08.336361 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283394e4-4eb3-4a9b-8161-331a7b3981af None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:08.336474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283394e4-4eb3-4a9b-8161-331a7b3981af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:08.353903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-283394e4-4eb3-4a9b-8161-331a7b3981af None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:15:08.355073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-283394e4-4eb3-4a9b-8161-331a7b3981af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:15:08.364228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:15:08.425205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 491/974] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:15:08 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:15:08.686859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80223791-79eb-417f-8d63-877a45bbcf59 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:15:08.788173 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:15:08.798344 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80223791-79eb-417f-8d63-877a45bbcf59 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:15:08.830588 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380aa3b4-dbd7-42f9-9b8b-77614158aa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:15:08.831204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380aa3b4-dbd7-42f9-9b8b-77614158aa3c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:08.831478 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380aa3b4-dbd7-42f9-9b8b-77614158aa3c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:08.831747 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380aa3b4-dbd7-42f9-9b8b-77614158aa3c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:08.832347 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380aa3b4-dbd7-42f9-9b8b-77614158aa3c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:15:08.833696 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380aa3b4-dbd7-42f9-9b8b-77614158aa3c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-380aa3b4-dbd7-42f9-9b8b-77614158aa3c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:15:08.842761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:15:08.844065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:15:08.844065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:15:08.844065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:15:08.844065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:15:08.844065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:15:08.844065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:15:08.844065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:15:08.844065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:15:08.844065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:15:08.844065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:15:08.844065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:15:08.844065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:15:08.844065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:15:08.844065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:15:08.844065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:15:08.844065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:15:08.845188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:15:08.845188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:15:08.845188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:15:08.845188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:15:08.845188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:15:08.845188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:15:08.845188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:15:08.845188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:15:08.845188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:15:08.845188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:15:08.845188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:15:08.845188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:15:08.845188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 10:15:08.845188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:15:08.845188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 484/975] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Oct 17 10:15:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:15:08.849812 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283394e4-4eb3-4a9b-8161-331a7b3981af None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:15:08.942420 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283394e4-4eb3-4a9b-8161-331a7b3981af None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:15:08.974894 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c3a37-fd05-47f4-997f-1019a77d0f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:15:08.975480 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c3a37-fd05-47f4-997f-1019a77d0f66 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:08.975755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c3a37-fd05-47f4-997f-1019a77d0f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:08.976050 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c3a37-fd05-47f4-997f-1019a77d0f66 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:08.976669 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c3a37-fd05-47f4-997f-1019a77d0f66 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:15:08.976966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c3a37-fd05-47f4-997f-1019a77d0f66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:15:08.978312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c3a37-fd05-47f4-997f-1019a77d0f66 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:15:08.983314 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 492/976] 10.222.0.13 () {56 vars in 1116 bytes} [Mon Oct 17 10:15:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:15:08.989329 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380aa3b4-dbd7-42f9-9b8b-77614158aa3c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:15:09.085219 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380aa3b4-dbd7-42f9-9b8b-77614158aa3c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:15:09.116597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c06ec-0dd9-4778-9129-fc773aba9f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:15:09.117184 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c06ec-0dd9-4778-9129-fc773aba9f27 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:09.117459 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c06ec-0dd9-4778-9129-fc773aba9f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:09.117727 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c06ec-0dd9-4778-9129-fc773aba9f27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:09.118421 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c06ec-0dd9-4778-9129-fc773aba9f27 None admin] RBAC: Adding query filter params (interface=public, service_id=26efb254828c4b359139b10b37b095af, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:15:09.118727 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c06ec-0dd9-4778-9129-fc773aba9f27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:15:09.120098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c06ec-0dd9-4778-9129-fc773aba9f27 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:15:09.125329 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 485/977] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Oct 17 10:15:08 2022] GET /identity/v3/endpoints?service_id=26efb254828c4b359139b10b37b095af&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:15:09.131004 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c3a37-fd05-47f4-997f-1019a77d0f66 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:15:09.134735 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:15:09.225662 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c3a37-fd05-47f4-997f-1019a77d0f66 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:15:09.258640 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6efd6-d70a-4106-b56a-98f896f5057a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:15:09.259236 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6efd6-d70a-4106-b56a-98f896f5057a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:09.259516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6efd6-d70a-4106-b56a-98f896f5057a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:09.259790 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6efd6-d70a-4106-b56a-98f896f5057a None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:09.260419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6efd6-d70a-4106-b56a-98f896f5057a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:15:09.261776 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6efd6-d70a-4106-b56a-98f896f5057a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:15:09.268950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 493/978] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 17 10:15:09 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:15:11.380121 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c0b4a-e246-4d25-bb75-bcf71a74c9f4 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:11.380639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c0b4a-e246-4d25-bb75-bcf71a74c9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:11.380751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c0b4a-e246-4d25-bb75-bcf71a74c9f4 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:11.381986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 486/979] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:15:11.387406 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42f773-c7c1-44b5-9c84-ba758da818c5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:11.387811 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42f773-c7c1-44b5-9c84-ba758da818c5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:11.387982 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42f773-c7c1-44b5-9c84-ba758da818c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:11.406451 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-aa42f773-c7c1-44b5-9c84-ba758da818c5 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:15:11.407704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-aa42f773-c7c1-44b5-9c84-ba758da818c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:15:11.467134 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:15:11.473103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 494/980] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:15:11 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 10:15:11.743914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c0b4a-e246-4d25-bb75-bcf71a74c9f4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:15:11.772633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:15:11.866041 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c0b4a-e246-4d25-bb75-bcf71a74c9f4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:15:11.903704 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4406133-12c5-488b-a4d3-41286effb310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:15:11.904357 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4406133-12c5-488b-a4d3-41286effb310 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:11.904637 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4406133-12c5-488b-a4d3-41286effb310 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:11.904908 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4406133-12c5-488b-a4d3-41286effb310 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:11.905483 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4406133-12c5-488b-a4d3-41286effb310 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:15:11.906833 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4406133-12c5-488b-a4d3-41286effb310 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e4406133-12c5-488b-a4d3-41286effb310 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 10:15:11.919751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 10:15:11.920964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 10:15:11.920964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 10:15:11.920964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 10:15:11.920964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 10:15:11.920964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 10:15:11.920964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 10:15:11.920964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 10:15:11.920964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 10:15:11.920964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 10:15:11.920964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 10:15:11.920964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 10:15:11.920964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 10:15:11.920964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 10:15:11.920964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 10:15:11.920964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 10:15:11.920964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 10:15:11.922215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 10:15:11.922215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Oct 17 10:15:11.922215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 10:15:11.922215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Oct 17 10:15:11.922215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 10:15:11.922215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 10:15:11.922215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 10:15:11.922215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Oct 17 10:15:11.922215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 10:15:11.922215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Oct 17 10:15:11.922215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 10:15:11.922215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 10:15:11.922215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 10:15:11.922215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Oct 17 10:15:11.922215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 487/981] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Oct 17 10:15:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 10:15:11.926900 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42f773-c7c1-44b5-9c84-ba758da818c5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:15:12.022768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42f773-c7c1-44b5-9c84-ba758da818c5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:15:12.054780 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71538c3-26d6-473c-9972-3df5fdc8c1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:15:12.055389 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71538c3-26d6-473c-9972-3df5fdc8c1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:12.055668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71538c3-26d6-473c-9972-3df5fdc8c1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:12.055967 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71538c3-26d6-473c-9972-3df5fdc8c1a8 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:12.056615 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71538c3-26d6-473c-9972-3df5fdc8c1a8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:15:12.056918 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71538c3-26d6-473c-9972-3df5fdc8c1a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:15:12.058295 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71538c3-26d6-473c-9972-3df5fdc8c1a8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:15:12.064152 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 495/982] 10.222.0.13 () {56 vars in 1116 bytes} [Mon Oct 17 10:15:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:15:12.070060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4406133-12c5-488b-a4d3-41286effb310 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:15:12.152951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:15:12.171082 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4406133-12c5-488b-a4d3-41286effb310 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:15:12.206205 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42b2bb-3ff1-4171-a382-a2811f0eea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:15:12.206803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42b2bb-3ff1-4171-a382-a2811f0eea19 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:15:12.207085 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42b2bb-3ff1-4171-a382-a2811f0eea19 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:15:12.207362 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42b2bb-3ff1-4171-a382-a2811f0eea19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:15:12.208064 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42b2bb-3ff1-4171-a382-a2811f0eea19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:15:12.209436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42b2bb-3ff1-4171-a382-a2811f0eea19 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:15:12.228910 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 488/983] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:15:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:15:22.061696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=69 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:15:22.223760 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:15.187227 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dd567-ecec-4399-adc3-3a0e6bda1b34 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:15.187695 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dd567-ecec-4399-adc3-3a0e6bda1b34 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:15.187786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dd567-ecec-4399-adc3-3a0e6bda1b34 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:15.190095 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 496/984] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:16:15.195115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020887d-00e9-4033-8978-88d4a02d5df0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:15.196341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020887d-00e9-4033-8978-88d4a02d5df0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:15.196643 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020887d-00e9-4033-8978-88d4a02d5df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:15.359218 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9020887d-00e9-4033-8978-88d4a02d5df0 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:16:15.362902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9020887d-00e9-4033-8978-88d4a02d5df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:15.496708 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 489/985] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:16:15.788514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62f8f9-d289-442c-8e40-4960fce45f4f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:15.788961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62f8f9-d289-442c-8e40-4960fce45f4f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:15.789345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62f8f9-d289-442c-8e40-4960fce45f4f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:15.791077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 497/986] 10.222.0.13 () {54 vars in 964 bytes} [Mon Oct 17 10:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:16:15.797570 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613a278-2e7f-4ce0-ab41-a1b93b49b8f9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:15.797853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613a278-2e7f-4ce0-ab41-a1b93b49b8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:15.798125 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613a278-2e7f-4ce0-ab41-a1b93b49b8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:15.880060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9613a278-2e7f-4ce0-ab41-a1b93b49b8f9 None None] MFA Rules not processed for user `98030e60807e44ec928488e904ca24c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:16:15.881499 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9613a278-2e7f-4ce0-ab41-a1b93b49b8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:15.905810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:15.976879 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 490/987] 10.222.0.13 () {58 vars in 1061 bytes} [Mon Oct 17 10:16:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:16:15.985895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62f8f9-d289-442c-8e40-4960fce45f4f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:16:15.988081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ee62f8f9-d289-442c-8e40-4960fce45f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:16.115837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62f8f9-d289-442c-8e40-4960fce45f4f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:16:16.191512 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8346ed-19ef-47cd-8d40-ba7802f49058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:16:16.192187 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8346ed-19ef-47cd-8d40-ba7802f49058 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:16.192462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8346ed-19ef-47cd-8d40-ba7802f49058 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:16.192662 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8346ed-19ef-47cd-8d40-ba7802f49058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:16.194241 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0d8346ed-19ef-47cd-8d40-ba7802f49058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:16.250905 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:16.308203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8346ed-19ef-47cd-8d40-ba7802f49058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:16:16.309653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8346ed-19ef-47cd-8d40-ba7802f49058 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:16:16.333184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 498/988] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:16:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:16:18.818629 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f8c5d-9112-4fc8-a79a-f396ab05de86 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:18.819111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f8c5d-9112-4fc8-a79a-f396ab05de86 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:18.819224 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f8c5d-9112-4fc8-a79a-f396ab05de86 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:18.820533 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 491/989] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:16:18.825753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c017447-52be-4ccb-a9a0-938f7ad771c6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:18.826155 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c017447-52be-4ccb-a9a0-938f7ad771c6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:18.826302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c017447-52be-4ccb-a9a0-938f7ad771c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:18.895961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2c017447-52be-4ccb-a9a0-938f7ad771c6 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:16:18.897113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2c017447-52be-4ccb-a9a0-938f7ad771c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:18.990328 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 499/990] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:16:19.270515 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f8c5d-9112-4fc8-a79a-f396ab05de86 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:16:19.272068 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0e6f8c5d-9112-4fc8-a79a-f396ab05de86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:19.375768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f8c5d-9112-4fc8-a79a-f396ab05de86 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:16:19.445759 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:19.448489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc4dc2-4d29-4482-b17e-519cccc5cbf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:16:19.449330 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc4dc2-4d29-4482-b17e-519cccc5cbf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:19.449787 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc4dc2-4d29-4482-b17e-519cccc5cbf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:19.450244 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc4dc2-4d29-4482-b17e-519cccc5cbf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:19.451892 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-04dc4dc2-4d29-4482-b17e-519cccc5cbf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:19.557488 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc4dc2-4d29-4482-b17e-519cccc5cbf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:16:19.558831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc4dc2-4d29-4482-b17e-519cccc5cbf4 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:16:19.576687 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 492/991] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:16:21.997376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c50e5-b9a3-415d-917a-89d83963419a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:21.997943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c50e5-b9a3-415d-917a-89d83963419a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:21.997943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c50e5-b9a3-415d-917a-89d83963419a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:21.999268 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 500/992] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:16:22.004509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780aea5-380f-4962-aafe-317dab9d89c8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:22.004928 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780aea5-380f-4962-aafe-317dab9d89c8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:22.005038 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780aea5-380f-4962-aafe-317dab9d89c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:22.070458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5780aea5-380f-4962-aafe-317dab9d89c8 None None] MFA Rules not processed for user `126c4d02c86f4cc09f24869db284cd76`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:16:22.071645 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5780aea5-380f-4962-aafe-317dab9d89c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:22.122472 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:22.168280 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 493/993] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:16:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:16:22.464653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c50e5-b9a3-415d-917a-89d83963419a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:16:22.467099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-686c50e5-b9a3-415d-917a-89d83963419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:22.479048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:22.572200 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c50e5-b9a3-415d-917a-89d83963419a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:16:22.642543 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b01b94-f7bf-4f5b-9c54-1e3136adc47b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:16:22.643136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b01b94-f7bf-4f5b-9c54-1e3136adc47b service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:22.643412 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b01b94-f7bf-4f5b-9c54-1e3136adc47b service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:22.643683 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b01b94-f7bf-4f5b-9c54-1e3136adc47b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:22.645278 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-48b01b94-f7bf-4f5b-9c54-1e3136adc47b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:22.704752 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:22.753269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b01b94-f7bf-4f5b-9c54-1e3136adc47b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:16:22.754637 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b01b94-f7bf-4f5b-9c54-1e3136adc47b service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:16:22.773187 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 501/994] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:16:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:16:25.436042 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95a3ae-db96-4d2a-929c-ba943adf0dfc None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:25.436601 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95a3ae-db96-4d2a-929c-ba943adf0dfc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:25.436601 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95a3ae-db96-4d2a-929c-ba943adf0dfc None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:25.437908 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 494/995] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:16:25.443035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f84c6a-0f95-48c7-b4c6-1a992096d353 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:25.443452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f84c6a-0f95-48c7-b4c6-1a992096d353 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:25.443585 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f84c6a-0f95-48c7-b4c6-1a992096d353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:25.508960 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d0f84c6a-0f95-48c7-b4c6-1a992096d353 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:16:25.510162 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d0f84c6a-0f95-48c7-b4c6-1a992096d353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:25.603231 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 502/996] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:16:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:16:25.887190 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95a3ae-db96-4d2a-929c-ba943adf0dfc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:16:25.889294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6e95a3ae-db96-4d2a-929c-ba943adf0dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:25.989998 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95a3ae-db96-4d2a-929c-ba943adf0dfc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:16:26.061910 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32699098-06c2-473e-ab4d-76935e0c7f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:16:26.062509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32699098-06c2-473e-ab4d-76935e0c7f85 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:26.062787 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32699098-06c2-473e-ab4d-76935e0c7f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:26.063058 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32699098-06c2-473e-ab4d-76935e0c7f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:26.064690 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-32699098-06c2-473e-ab4d-76935e0c7f85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:26.071779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:26.173883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32699098-06c2-473e-ab4d-76935e0c7f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:16:26.175245 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32699098-06c2-473e-ab4d-76935e0c7f85 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:16:26.193113 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 495/997] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:16:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:16:28.932552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d26dd-84fd-4358-b3f8-1b6abd316797 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:28.933083 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d26dd-84fd-4358-b3f8-1b6abd316797 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:28.933162 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d26dd-84fd-4358-b3f8-1b6abd316797 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:28.934475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 503/998] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:16:28.939747 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634fde3-316e-4770-8953-1696d38b9419 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:28.940186 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634fde3-316e-4770-8953-1696d38b9419 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:28.940470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634fde3-316e-4770-8953-1696d38b9419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:29.012472 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0634fde3-316e-4770-8953-1696d38b9419 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:16:29.014118 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0634fde3-316e-4770-8953-1696d38b9419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:29.080896 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:29.123883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 496/999] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:16:29.409472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d26dd-84fd-4358-b3f8-1b6abd316797 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:16:29.411124 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-eb1d26dd-84fd-4358-b3f8-1b6abd316797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:29.430816 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:29.514643 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d26dd-84fd-4358-b3f8-1b6abd316797 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:16:29.588267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56e10e-3794-45b4-aeb2-566f2aa736e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:16:29.588875 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56e10e-3794-45b4-aeb2-566f2aa736e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:29.589149 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56e10e-3794-45b4-aeb2-566f2aa736e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:29.589416 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56e10e-3794-45b4-aeb2-566f2aa736e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:29.590991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fd56e10e-3794-45b4-aeb2-566f2aa736e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:29.662486 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:29.700609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56e10e-3794-45b4-aeb2-566f2aa736e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:16:29.702048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56e10e-3794-45b4-aeb2-566f2aa736e9 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:16:29.722255 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 504/1000] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:16:31.906656 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12536afb-ae6b-48d9-90ad-ea5271a37fd4 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:31.907201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12536afb-ae6b-48d9-90ad-ea5271a37fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:31.907289 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12536afb-ae6b-48d9-90ad-ea5271a37fd4 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:31.908643 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 497/1001] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:16:31.913871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3411d-0919-4022-afe5-346626895ef2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:31.914308 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3411d-0919-4022-afe5-346626895ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:31.914404 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3411d-0919-4022-afe5-346626895ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:31.980318 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-edd3411d-0919-4022-afe5-346626895ef2 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:16:31.981530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-edd3411d-0919-4022-afe5-346626895ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:32.089709 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 505/1002] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:16:32.373154 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12536afb-ae6b-48d9-90ad-ea5271a37fd4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:16:32.374788 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-12536afb-ae6b-48d9-90ad-ea5271a37fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:32.476175 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12536afb-ae6b-48d9-90ad-ea5271a37fd4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:16:32.549758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa2cf2-cf24-47e7-9f7d-3dc937c67aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:16:32.550359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa2cf2-cf24-47e7-9f7d-3dc937c67aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:32.550631 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa2cf2-cf24-47e7-9f7d-3dc937c67aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:32.550895 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa2cf2-cf24-47e7-9f7d-3dc937c67aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:32.552508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-65aa2cf2-cf24-47e7-9f7d-3dc937c67aa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:32.569438 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:32.662394 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa2cf2-cf24-47e7-9f7d-3dc937c67aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:16:32.663850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa2cf2-cf24-47e7-9f7d-3dc937c67aa7 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:16:32.682507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 498/1003] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:16:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:16:34.889398 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c6ef9-c121-4eda-817d-e6aa875667c6 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:34.889934 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c6ef9-c121-4eda-817d-e6aa875667c6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:34.889934 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c6ef9-c121-4eda-817d-e6aa875667c6 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:34.891273 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 506/1004] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:16:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:16:34.896522 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35166568-9333-411e-b3d4-189bd276e09e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:34.896917 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35166568-9333-411e-b3d4-189bd276e09e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:34.897078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35166568-9333-411e-b3d4-189bd276e09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:34.964756 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-35166568-9333-411e-b3d4-189bd276e09e None None] MFA Rules not processed for user `126c4d02c86f4cc09f24869db284cd76`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:16:34.966306 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-35166568-9333-411e-b3d4-189bd276e09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:35.036705 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:35.074909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 499/1005] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:16:34 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:16:35.360776 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c6ef9-c121-4eda-817d-e6aa875667c6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:16:35.362314 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-870c6ef9-c121-4eda-817d-e6aa875667c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:35.395891 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:35.469155 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c6ef9-c121-4eda-817d-e6aa875667c6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:16:35.546045 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1eb60-5c3e-4eea-bb95-1b80b94ce25e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:16:35.546654 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1eb60-5c3e-4eea-bb95-1b80b94ce25e service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:35.546932 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1eb60-5c3e-4eea-bb95-1b80b94ce25e service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:35.547201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1eb60-5c3e-4eea-bb95-1b80b94ce25e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:35.548821 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4da1eb60-5c3e-4eea-bb95-1b80b94ce25e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:35.626060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:35.658836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1eb60-5c3e-4eea-bb95-1b80b94ce25e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:16:35.660316 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1eb60-5c3e-4eea-bb95-1b80b94ce25e service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:16:35.678715 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 507/1006] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:16:35 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:16:38.046618 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5c98-3028-4e90-bc67-25e47bd7ece6 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:38.047271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5c98-3028-4e90-bc67-25e47bd7ece6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:38.047271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5c98-3028-4e90-bc67-25e47bd7ece6 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:38.048522 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 500/1007] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:16:38.053666 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb76d19-50a5-44ee-8410-5b497b5b7f41 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:38.054116 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb76d19-50a5-44ee-8410-5b497b5b7f41 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:38.054224 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb76d19-50a5-44ee-8410-5b497b5b7f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:38.119044 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7eb76d19-50a5-44ee-8410-5b497b5b7f41 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:16:38.120299 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7eb76d19-50a5-44ee-8410-5b497b5b7f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:38.214134 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 508/1008] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:16:38.493490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad5c98-3028-4e90-bc67-25e47bd7ece6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:16:38.495027 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-33ad5c98-3028-4e90-bc67-25e47bd7ece6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:38.595540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad5c98-3028-4e90-bc67-25e47bd7ece6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:16:38.669105 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16df96-7f36-4a74-ad7c-db73aabb15ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:16:38.670226 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16df96-7f36-4a74-ad7c-db73aabb15ff service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:38.670500 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16df96-7f36-4a74-ad7c-db73aabb15ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:38.670766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16df96-7f36-4a74-ad7c-db73aabb15ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:38.672383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ea16df96-7f36-4a74-ad7c-db73aabb15ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:38.699099 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:38.780926 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16df96-7f36-4a74-ad7c-db73aabb15ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:16:38.782295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16df96-7f36-4a74-ad7c-db73aabb15ff service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:16:38.800679 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 501/1009] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:16:40.967091 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b00cc1-676c-45cc-a88a-8160d7e404c5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:40.967605 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b00cc1-676c-45cc-a88a-8160d7e404c5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:40.967605 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b00cc1-676c-45cc-a88a-8160d7e404c5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:40.968981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 509/1010] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:16:40.974244 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ddc16-bd45-47f6-bfa5-d4cdbb538056 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:40.974659 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ddc16-bd45-47f6-bfa5-d4cdbb538056 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:40.974795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ddc16-bd45-47f6-bfa5-d4cdbb538056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:41.039243 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-504ddc16-bd45-47f6-bfa5-d4cdbb538056 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:16:41.040457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-504ddc16-bd45-47f6-bfa5-d4cdbb538056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:41.116283 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:41.138029 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 502/1011] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:16:41.419581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b00cc1-676c-45cc-a88a-8160d7e404c5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:16:41.421164 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-65b00cc1-676c-45cc-a88a-8160d7e404c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:41.460687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:41.521653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b00cc1-676c-45cc-a88a-8160d7e404c5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:16:41.592556 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e803d-a481-401e-a799-aebed9394fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:16:41.593150 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e803d-a481-401e-a799-aebed9394fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:41.593424 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e803d-a481-401e-a799-aebed9394fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:41.593690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e803d-a481-401e-a799-aebed9394fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:41.595265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4b4e803d-a481-401e-a799-aebed9394fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:41.678509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:41.704339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e803d-a481-401e-a799-aebed9394fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:16:41.705777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e803d-a481-401e-a799-aebed9394fb5 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:16:41.724209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 510/1012] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:16:44.161267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c2d9c-e0c6-4998-9639-010317d9211c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:44.161810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c2d9c-e0c6-4998-9639-010317d9211c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:44.161911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c2d9c-e0c6-4998-9639-010317d9211c None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:44.163179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 503/1013] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:16:44.168416 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f818f0-940a-4de1-9a8a-1fb1d0deff56 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:44.168813 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f818f0-940a-4de1-9a8a-1fb1d0deff56 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:44.168967 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f818f0-940a-4de1-9a8a-1fb1d0deff56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:44.232667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a2f818f0-940a-4de1-9a8a-1fb1d0deff56 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:16:44.233881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a2f818f0-940a-4de1-9a8a-1fb1d0deff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:44.331894 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 511/1014] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:16:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:16:44.608715 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c2d9c-e0c6-4998-9639-010317d9211c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:16:44.610251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-846c2d9c-e0c6-4998-9639-010317d9211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:44.712797 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c2d9c-e0c6-4998-9639-010317d9211c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:16:44.790849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844b539-61bf-4945-a097-6a200b360d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:16:44.791442 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844b539-61bf-4945-a097-6a200b360d39 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:44.791713 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844b539-61bf-4945-a097-6a200b360d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:44.792006 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844b539-61bf-4945-a097-6a200b360d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:44.793581 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f844b539-61bf-4945-a097-6a200b360d39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:44.828646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:44.901841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844b539-61bf-4945-a097-6a200b360d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:16:44.903284 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844b539-61bf-4945-a097-6a200b360d39 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:16:44.921578 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 504/1015] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:16:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:16:48.929833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5c506-6905-4de3-aaa0-1c3a978b6ed6 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:48.930345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5c506-6905-4de3-aaa0-1c3a978b6ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:48.930345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5c506-6905-4de3-aaa0-1c3a978b6ed6 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:48.931627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 512/1016] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:16:48.937332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab9da7-9e7d-4771-861f-a9ffc5c9bc33 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:48.937754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab9da7-9e7d-4771-861f-a9ffc5c9bc33 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:48.937863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab9da7-9e7d-4771-861f-a9ffc5c9bc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:49.004674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-64ab9da7-9e7d-4771-861f-a9ffc5c9bc33 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:16:49.005842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-64ab9da7-9e7d-4771-861f-a9ffc5c9bc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:49.092054 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:49.103553 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 505/1017] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:16:49.393554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5c506-6905-4de3-aaa0-1c3a978b6ed6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:16:49.395106 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-02a5c506-6905-4de3-aaa0-1c3a978b6ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:49.443173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:49.499349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5c506-6905-4de3-aaa0-1c3a978b6ed6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:16:49.571857 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5623bcc-ddf7-47e7-beaa-efd64bc34582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:16:49.572491 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5623bcc-ddf7-47e7-beaa-efd64bc34582 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:49.572763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5623bcc-ddf7-47e7-beaa-efd64bc34582 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:49.573031 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5623bcc-ddf7-47e7-beaa-efd64bc34582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:49.574608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d5623bcc-ddf7-47e7-beaa-efd64bc34582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:49.668516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:49.684787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5623bcc-ddf7-47e7-beaa-efd64bc34582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:16:49.686783 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5623bcc-ddf7-47e7-beaa-efd64bc34582 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:16:49.705385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 513/1018] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:16:52.495890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226af9b-b846-409a-8b59-c656dbc86d4c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:52.496467 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226af9b-b846-409a-8b59-c656dbc86d4c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:52.496561 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226af9b-b846-409a-8b59-c656dbc86d4c None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:52.498486 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 506/1019] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:16:52.503973 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d5c8-596e-4972-9e03-2d80c9cf3323 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:52.504400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d5c8-596e-4972-9e03-2d80c9cf3323 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:52.504537 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d5c8-596e-4972-9e03-2d80c9cf3323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:52.571761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f5c2d5c8-596e-4972-9e03-2d80c9cf3323 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:16:52.572997 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f5c2d5c8-596e-4972-9e03-2d80c9cf3323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:52.671045 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 514/1020] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:16:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:16:52.970378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226af9b-b846-409a-8b59-c656dbc86d4c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:16:52.972039 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e226af9b-b846-409a-8b59-c656dbc86d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:53.084594 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226af9b-b846-409a-8b59-c656dbc86d4c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:16:53.159837 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1287293-9e6a-45fd-8d4a-bf6061336c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:16:53.160378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1287293-9e6a-45fd-8d4a-bf6061336c2c service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:53.160655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1287293-9e6a-45fd-8d4a-bf6061336c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:53.160925 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1287293-9e6a-45fd-8d4a-bf6061336c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:53.162505 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f1287293-9e6a-45fd-8d4a-bf6061336c2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:53.206735 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:53.274530 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1287293-9e6a-45fd-8d4a-bf6061336c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:16:53.275952 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1287293-9e6a-45fd-8d4a-bf6061336c2c service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:16:53.296081 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 507/1021] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:16:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:16:57.371276 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f8777-284d-4a23-aee6-f6ca2c1ecc16 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:57.371797 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f8777-284d-4a23-aee6-f6ca2c1ecc16 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:57.371797 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f8777-284d-4a23-aee6-f6ca2c1ecc16 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:57.373763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 515/1022] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:16:57.379268 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4a7bc-b388-4f96-86f9-7cdc9e19b07e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:57.379699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4a7bc-b388-4f96-86f9-7cdc9e19b07e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:57.379810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4a7bc-b388-4f96-86f9-7cdc9e19b07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:57.447393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b3d4a7bc-b388-4f96-86f9-7cdc9e19b07e None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:16:57.448636 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b3d4a7bc-b388-4f96-86f9-7cdc9e19b07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:57.540629 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:57.542838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 508/1023] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:16:57.822279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f8777-284d-4a23-aee6-f6ca2c1ecc16 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:16:57.823846 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f07f8777-284d-4a23-aee6-f6ca2c1ecc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:57.881526 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:57.926658 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f8777-284d-4a23-aee6-f6ca2c1ecc16 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:16:57.997837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678f4bc-2566-4402-88c0-9598f5114995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:16:57.998435 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678f4bc-2566-4402-88c0-9598f5114995 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:16:57.998711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678f4bc-2566-4402-88c0-9598f5114995 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:16:57.998982 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678f4bc-2566-4402-88c0-9598f5114995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:16:58.000603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b678f4bc-2566-4402-88c0-9598f5114995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:16:58.104606 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:16:58.108743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678f4bc-2566-4402-88c0-9598f5114995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:16:58.110662 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678f4bc-2566-4402-88c0-9598f5114995 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:16:58.129444 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 516/1024] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:17:03.030313 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5633c7e-1081-4f3e-9cff-c3aa4feada5f None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:03.030850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5633c7e-1081-4f3e-9cff-c3aa4feada5f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:03.030850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5633c7e-1081-4f3e-9cff-c3aa4feada5f None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:03.048434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 509/1025] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 17 10:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:03.048615 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a082ca4-17ec-4ca7-9aab-569f5073436d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:03.048615 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a082ca4-17ec-4ca7-9aab-569f5073436d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:03.048615 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a082ca4-17ec-4ca7-9aab-569f5073436d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:03.179191 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4a082ca4-17ec-4ca7-9aab-569f5073436d None None] MFA Rules not processed for user `dd52eee25ef347e1ae905cc3cba17284`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:03.180789 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4a082ca4-17ec-4ca7-9aab-569f5073436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:03.322224 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 517/1026] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 17 10:17:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:07.302775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab63c28-d4ff-4a0e-9187-f7a9b2d6413e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:07.303764 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab63c28-d4ff-4a0e-9187-f7a9b2d6413e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:07.304284 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab63c28-d4ff-4a0e-9187-f7a9b2d6413e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:07.306136 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 510/1027] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 17 10:17:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:07.310977 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5be48c-c41c-4f56-b4f2-8d5ce4b60b60 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:07.311781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5be48c-c41c-4f56-b4f2-8d5ce4b60b60 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:07.312284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5be48c-c41c-4f56-b4f2-8d5ce4b60b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:07.368734 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:07.393947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6f5be48c-c41c-4f56-b4f2-8d5ce4b60b60 None None] MFA Rules not processed for user `dd52eee25ef347e1ae905cc3cba17284`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:07.395178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6f5be48c-c41c-4f56-b4f2-8d5ce4b60b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:07.506503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 518/1028] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 17 10:17:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:08.899888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433024f-4790-436b-a23a-2676cb858fa8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:08.902285 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433024f-4790-436b-a23a-2676cb858fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:08.902640 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433024f-4790-436b-a23a-2676cb858fa8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:08.906134 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 511/1029] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 17 10:17:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:08.911835 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb11316-6a1e-49ac-b15a-3a409cb3b605 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:08.912365 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb11316-6a1e-49ac-b15a-3a409cb3b605 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:08.912466 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb11316-6a1e-49ac-b15a-3a409cb3b605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:08.989917 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fcb11316-6a1e-49ac-b15a-3a409cb3b605 None None] MFA Rules not processed for user `dd52eee25ef347e1ae905cc3cba17284`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:08.991079 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fcb11316-6a1e-49ac-b15a-3a409cb3b605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:09.032048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:09.099689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 519/1030] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 17 10:17:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:12.654463 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7501ac-0d3a-4d24-9079-66277d1af531 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:12.655016 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7501ac-0d3a-4d24-9079-66277d1af531 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:12.655016 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7501ac-0d3a-4d24-9079-66277d1af531 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:12.656365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 512/1031] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:12.662072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d8a18-4e5d-4705-a033-2a238597223e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:12.662492 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d8a18-4e5d-4705-a033-2a238597223e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:12.662590 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d8a18-4e5d-4705-a033-2a238597223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:12.737183 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-084d8a18-4e5d-4705-a033-2a238597223e None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:12.738635 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-084d8a18-4e5d-4705-a033-2a238597223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:12.844031 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 520/1032] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:17:13.148643 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e562159-397f-4f7f-b942-d3bc757995ff None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:13.149232 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e562159-397f-4f7f-b942-d3bc757995ff None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:13.149821 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e562159-397f-4f7f-b942-d3bc757995ff None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:13.151374 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 513/1033] 10.222.0.13 () {54 vars in 961 bytes} [Mon Oct 17 10:17:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:17:13.160755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4b0ff-82e0-4e55-9743-52cb750a898a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:13.161408 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4b0ff-82e0-4e55-9743-52cb750a898a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:13.162646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4b0ff-82e0-4e55-9743-52cb750a898a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:13.183476 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:13.252269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-16c4b0ff-82e0-4e55-9743-52cb750a898a None None] MFA Rules not processed for user `a80cc7ec3d2d49f88c81403f918a6900`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:13.254034 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-16c4b0ff-82e0-4e55-9743-52cb750a898a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:13.387715 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 521/1034] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Oct 17 10:17:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:13.396148 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e562159-397f-4f7f-b942-d3bc757995ff None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:17:13.397649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8e562159-397f-4f7f-b942-d3bc757995ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:13.551312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e562159-397f-4f7f-b942-d3bc757995ff None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:17:13.634417 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:13.679129 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b841957-c3af-44c9-b6a6-c74564ed1556 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:17:13.679783 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b841957-c3af-44c9-b6a6-c74564ed1556 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:13.680037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b841957-c3af-44c9-b6a6-c74564ed1556 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:13.680290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b841957-c3af-44c9-b6a6-c74564ed1556 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:13.681868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3b841957-c3af-44c9-b6a6-c74564ed1556 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:13.792650 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b841957-c3af-44c9-b6a6-c74564ed1556 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:17:13.794239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b841957-c3af-44c9-b6a6-c74564ed1556 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:17:13.813868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 514/1035] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:17:16.202132 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6752e-ca2f-466e-95a9-75c1a2190e93 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:16.202616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6752e-ca2f-466e-95a9-75c1a2190e93 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:16.202616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6752e-ca2f-466e-95a9-75c1a2190e93 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:16.209173 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c6932-fbaf-4399-8759-279b63aa81f3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:16.209607 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c6932-fbaf-4399-8759-279b63aa81f3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:16.209607 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c6932-fbaf-4399-8759-279b63aa81f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:16.214388 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 522/1036] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:17:16 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:16.278061 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-eb4c6932-fbaf-4399-8759-279b63aa81f3 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:16.279306 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-eb4c6932-fbaf-4399-8759-279b63aa81f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:16.320778 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:16.384482 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 515/1037] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:17:16.674284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6752e-ca2f-466e-95a9-75c1a2190e93 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:17:16.675810 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c7d6752e-ca2f-466e-95a9-75c1a2190e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:16.744021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:16.851412 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6752e-ca2f-466e-95a9-75c1a2190e93 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:17:16.994441 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82683963-9eb5-4c49-a82f-1605151a33c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:17:16.995889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82683963-9eb5-4c49-a82f-1605151a33c7 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:16.996218 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82683963-9eb5-4c49-a82f-1605151a33c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:16.996507 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82683963-9eb5-4c49-a82f-1605151a33c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:16.998134 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-82683963-9eb5-4c49-a82f-1605151a33c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:17.021956 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:17.100379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82683963-9eb5-4c49-a82f-1605151a33c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:17:17.102088 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82683963-9eb5-4c49-a82f-1605151a33c7 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:17:17.120906 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 523/1038] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:17:19.623591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea2741-5c61-4fd0-bd44-3ea77974c601 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:19.624305 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea2741-5c61-4fd0-bd44-3ea77974c601 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:19.624305 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea2741-5c61-4fd0-bd44-3ea77974c601 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:19.625685 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 516/1039] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:19.630675 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4b567-5eb7-4920-8a96-1213eebd7f17 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:19.631164 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4b567-5eb7-4920-8a96-1213eebd7f17 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:19.631325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4b567-5eb7-4920-8a96-1213eebd7f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:19.698419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-93e4b567-5eb7-4920-8a96-1213eebd7f17 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:19.699610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-93e4b567-5eb7-4920-8a96-1213eebd7f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:19.803488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:19.812297 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 524/1040] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:20.099535 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8bb88-d9c5-4e1e-966e-500723cbb663 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:20.099833 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8bb88-d9c5-4e1e-966e-500723cbb663 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:20.100111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8bb88-d9c5-4e1e-966e-500723cbb663 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:20.101443 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 517/1041] 10.222.0.13 () {54 vars in 961 bytes} [Mon Oct 17 10:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:20.107142 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a08cd-88ad-405f-9f4c-7740b53e5915 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:20.107587 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a08cd-88ad-405f-9f4c-7740b53e5915 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:20.107985 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a08cd-88ad-405f-9f4c-7740b53e5915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:20.187287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0c0a08cd-88ad-405f-9f4c-7740b53e5915 None None] MFA Rules not processed for user `a80cc7ec3d2d49f88c81403f918a6900`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:20.188670 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0c0a08cd-88ad-405f-9f4c-7740b53e5915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:20.309426 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 525/1042] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Oct 17 10:17:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:20.317253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8bb88-d9c5-4e1e-966e-500723cbb663 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:17:20.318849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5aa8bb88-d9c5-4e1e-966e-500723cbb663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:20.471195 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8bb88-d9c5-4e1e-966e-500723cbb663 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:17:20.493947 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:20.595095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f2bde-25b1-4391-b517-262d45ccf3a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:17:20.595860 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f2bde-25b1-4391-b517-262d45ccf3a0 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:20.596260 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f2bde-25b1-4391-b517-262d45ccf3a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:20.596627 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f2bde-25b1-4391-b517-262d45ccf3a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:20.598486 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-285f2bde-25b1-4391-b517-262d45ccf3a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:20.700207 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f2bde-25b1-4391-b517-262d45ccf3a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:17:20.701985 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f2bde-25b1-4391-b517-262d45ccf3a0 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:17:20.726123 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 518/1043] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:17:20.758579 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666cd86-25b8-45f5-840d-2003095fc425 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:20.759171 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666cd86-25b8-45f5-840d-2003095fc425 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:20.759266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666cd86-25b8-45f5-840d-2003095fc425 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:20.760619 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 526/1044] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:20.766221 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06ecff-3737-4adf-b0fd-dfd381413383 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:20.766673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06ecff-3737-4adf-b0fd-dfd381413383 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:20.767024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06ecff-3737-4adf-b0fd-dfd381413383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:20.800978 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:20.846422 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0c06ecff-3737-4adf-b0fd-dfd381413383 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:20.847785 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0c06ecff-3737-4adf-b0fd-dfd381413383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:20.968222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 519/1045] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:21.299756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c15e9-cb47-4c9e-8130-f1c3f0fb38ca None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:21.300071 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c15e9-cb47-4c9e-8130-f1c3f0fb38ca None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:21.300346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c15e9-cb47-4c9e-8130-f1c3f0fb38ca None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:21.301868 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 527/1046] 10.222.0.13 () {54 vars in 963 bytes} [Mon Oct 17 10:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:21.306746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc807e-383e-4f83-9161-60f8b736b9b9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:21.307242 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc807e-383e-4f83-9161-60f8b736b9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:21.307644 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc807e-383e-4f83-9161-60f8b736b9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:21.394113 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-cefc807e-383e-4f83-9161-60f8b736b9b9 None None] MFA Rules not processed for user `6099c38837b44101a17470322916c82e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:21.395483 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cefc807e-383e-4f83-9161-60f8b736b9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:21.443504 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:21.478558 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 520/1047] 10.222.0.13 () {58 vars in 1060 bytes} [Mon Oct 17 10:17:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:21.486953 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c15e9-cb47-4c9e-8130-f1c3f0fb38ca None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:17:21.488705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-577c15e9-cb47-4c9e-8130-f1c3f0fb38ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:21.544753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:21.605632 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c15e9-cb47-4c9e-8130-f1c3f0fb38ca None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:17:21.682326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e236e09-df94-45a8-8a9f-91d592f2b751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:17:21.682834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e236e09-df94-45a8-8a9f-91d592f2b751 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:21.683112 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e236e09-df94-45a8-8a9f-91d592f2b751 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:21.683398 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e236e09-df94-45a8-8a9f-91d592f2b751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:21.684996 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9e236e09-df94-45a8-8a9f-91d592f2b751 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:21.808097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:21.827660 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e236e09-df94-45a8-8a9f-91d592f2b751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:17:21.829629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e236e09-df94-45a8-8a9f-91d592f2b751 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:17:21.856636 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 528/1048] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:17:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:17:22.988422 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687fef1-9a76-4fa6-9f72-066837e1083b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:22.988960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687fef1-9a76-4fa6-9f72-066837e1083b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:22.988960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687fef1-9a76-4fa6-9f72-066837e1083b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:22.990575 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 521/1049] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:22.995838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95407332-0be3-4d0a-8597-745320445d5d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:22.996273 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95407332-0be3-4d0a-8597-745320445d5d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:22.996428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95407332-0be3-4d0a-8597-745320445d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:23.070380 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-95407332-0be3-4d0a-8597-745320445d5d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:23.071624 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-95407332-0be3-4d0a-8597-745320445d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:23.170166 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 529/1050] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:23.467896 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687fef1-9a76-4fa6-9f72-066837e1083b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:17:23.469467 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e687fef1-9a76-4fa6-9f72-066837e1083b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:23.621320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687fef1-9a76-4fa6-9f72-066837e1083b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:17:23.674758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:23.737299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc00f51-1149-4a1f-8155-bfa3c456e92c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:17:23.737914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc00f51-1149-4a1f-8155-bfa3c456e92c service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:23.738188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc00f51-1149-4a1f-8155-bfa3c456e92c service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:23.738453 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc00f51-1149-4a1f-8155-bfa3c456e92c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:23.740380 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ebc00f51-1149-4a1f-8155-bfa3c456e92c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:23.833362 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc00f51-1149-4a1f-8155-bfa3c456e92c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:17:23.834954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc00f51-1149-4a1f-8155-bfa3c456e92c service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:17:23.853013 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 522/1051] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:17:26.070329 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d7678-2d01-4c1c-83d2-ce70b2114a19 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:26.070746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d7678-2d01-4c1c-83d2-ce70b2114a19 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:26.070861 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d7678-2d01-4c1c-83d2-ce70b2114a19 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:26.072239 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 530/1052] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:26.078157 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536d19d-145e-4b84-8067-47aa8ae06be8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:26.078610 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536d19d-145e-4b84-8067-47aa8ae06be8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:26.078690 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536d19d-145e-4b84-8067-47aa8ae06be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:26.152132 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6536d19d-145e-4b84-8067-47aa8ae06be8 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:26.153326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6536d19d-145e-4b84-8067-47aa8ae06be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:26.161205 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:26.255327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 523/1053] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:26.548243 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d7678-2d01-4c1c-83d2-ce70b2114a19 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:17:26.549887 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9a9d7678-2d01-4c1c-83d2-ce70b2114a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:26.613446 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:26.701866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d7678-2d01-4c1c-83d2-ce70b2114a19 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:17:26.827693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a712d-58a2-4a14-a6b0-b6167d92f771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:17:26.828250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a712d-58a2-4a14-a6b0-b6167d92f771 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:26.828519 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a712d-58a2-4a14-a6b0-b6167d92f771 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:26.828793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a712d-58a2-4a14-a6b0-b6167d92f771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:26.830353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c08a712d-58a2-4a14-a6b0-b6167d92f771 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:26.849776 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:26.927855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a712d-58a2-4a14-a6b0-b6167d92f771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:17:26.929509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a712d-58a2-4a14-a6b0-b6167d92f771 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:17:26.948964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 531/1054] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:17:29.155253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928f339-04e5-4345-87f2-dbc9bf50f588 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:29.155706 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928f339-04e5-4345-87f2-dbc9bf50f588 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:29.155955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928f339-04e5-4345-87f2-dbc9bf50f588 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:29.157774 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 524/1055] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:29.162768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c0729-9305-4286-956a-2314df5d2e69 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:29.163216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c0729-9305-4286-956a-2314df5d2e69 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:29.163466 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c0729-9305-4286-956a-2314df5d2e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:29.291829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e43c0729-9305-4286-956a-2314df5d2e69 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:29.293248 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e43c0729-9305-4286-956a-2314df5d2e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:29.392111 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:29.398831 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 532/1056] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:29.704925 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928f339-04e5-4345-87f2-dbc9bf50f588 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:17:29.706426 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c928f339-04e5-4345-87f2-dbc9bf50f588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:29.847816 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:29.859617 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928f339-04e5-4345-87f2-dbc9bf50f588 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:17:29.973513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8530b9-0476-4204-ae3e-b9c305790ca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:17:29.973995 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8530b9-0476-4204-ae3e-b9c305790ca1 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:29.974271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8530b9-0476-4204-ae3e-b9c305790ca1 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:29.974535 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8530b9-0476-4204-ae3e-b9c305790ca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:29.976153 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2a8530b9-0476-4204-ae3e-b9c305790ca1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:30.069205 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8530b9-0476-4204-ae3e-b9c305790ca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:17:30.070795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8530b9-0476-4204-ae3e-b9c305790ca1 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:17:30.081573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:30.090844 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 525/1057] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:17:32.302711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020a522-c1b5-4e6d-a64a-939307c1fdbb None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:32.303248 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020a522-c1b5-4e6d-a64a-939307c1fdbb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:32.303366 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020a522-c1b5-4e6d-a64a-939307c1fdbb None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:32.304678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 533/1058] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:32.310158 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00079f6-ee2b-4bba-a996-d3b418d8f7eb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:32.311273 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00079f6-ee2b-4bba-a996-d3b418d8f7eb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:32.311273 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00079f6-ee2b-4bba-a996-d3b418d8f7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:32.380263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c00079f6-ee2b-4bba-a996-d3b418d8f7eb None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:32.381482 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c00079f6-ee2b-4bba-a996-d3b418d8f7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:32.486925 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 526/1059] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:32.777496 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020a522-c1b5-4e6d-a64a-939307c1fdbb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:17:32.779020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e020a522-c1b5-4e6d-a64a-939307c1fdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:32.927139 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020a522-c1b5-4e6d-a64a-939307c1fdbb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:17:33.012692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:33.062400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbce4e2-cd72-4ad0-831a-183421910103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:17:33.063106 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbce4e2-cd72-4ad0-831a-183421910103 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:33.063462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbce4e2-cd72-4ad0-831a-183421910103 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:33.063798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbce4e2-cd72-4ad0-831a-183421910103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:33.065453 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2bbce4e2-cd72-4ad0-831a-183421910103 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:33.157868 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbce4e2-cd72-4ad0-831a-183421910103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:17:33.159474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbce4e2-cd72-4ad0-831a-183421910103 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:17:33.177461 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 534/1060] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:17:35.308621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb8e7f-64f1-4a4b-8deb-f1f933946110 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:35.309217 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb8e7f-64f1-4a4b-8deb-f1f933946110 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:35.309217 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb8e7f-64f1-4a4b-8deb-f1f933946110 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:35.310538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 527/1061] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:35.316563 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f92f6-0d21-4126-9b23-ee5659401ff2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:35.317006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f92f6-0d21-4126-9b23-ee5659401ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:35.317189 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f92f6-0d21-4126-9b23-ee5659401ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:35.382877 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f45f92f6-0d21-4126-9b23-ee5659401ff2 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:35.384093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f45f92f6-0d21-4126-9b23-ee5659401ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:35.416636 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:35.479207 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 535/1062] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:35.765248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb8e7f-64f1-4a4b-8deb-f1f933946110 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:17:35.766780 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dcfb8e7f-64f1-4a4b-8deb-f1f933946110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:35.843084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:35.911936 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb8e7f-64f1-4a4b-8deb-f1f933946110 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:17:36.025332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41ff50-b775-431c-93ba-d588b0be02aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:17:36.025883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41ff50-b775-431c-93ba-d588b0be02aa service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:36.026160 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41ff50-b775-431c-93ba-d588b0be02aa service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:36.026427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41ff50-b775-431c-93ba-d588b0be02aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:36.028043 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-af41ff50-b775-431c-93ba-d588b0be02aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:36.066729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:36.118803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41ff50-b775-431c-93ba-d588b0be02aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:17:36.120419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41ff50-b775-431c-93ba-d588b0be02aa service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:17:36.139985 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 528/1063] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:17:37.050113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9783f-d33d-45a5-8680-b92f42be939f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:37.050643 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9783f-d33d-45a5-8680-b92f42be939f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:37.050643 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9783f-d33d-45a5-8680-b92f42be939f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:37.051910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 536/1064] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:37.057341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd0e75-0840-4716-9959-60715582a4f1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:37.058106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd0e75-0840-4716-9959-60715582a4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:37.058388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd0e75-0840-4716-9959-60715582a4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:37.125487 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-73dd0e75-0840-4716-9959-60715582a4f1 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:37.126684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-73dd0e75-0840-4716-9959-60715582a4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:37.223328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 529/1065] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:37.526388 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488b54-000b-455d-a75c-fac8077302fd None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:37.526665 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488b54-000b-455d-a75c-fac8077302fd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:37.526933 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488b54-000b-455d-a75c-fac8077302fd None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:37.528344 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 537/1066] 10.222.0.13 () {54 vars in 962 bytes} [Mon Oct 17 10:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:37.534170 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c66e1-eba1-40ea-9375-a10fd5948c53 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:37.534459 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c66e1-eba1-40ea-9375-a10fd5948c53 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:37.534786 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c66e1-eba1-40ea-9375-a10fd5948c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:37.554631 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:37.614194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1b9c66e1-eba1-40ea-9375-a10fd5948c53 None None] MFA Rules not processed for user `2bd5d41f6a16403f990a4cd5922a2644`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:37.615375 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1b9c66e1-eba1-40ea-9375-a10fd5948c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:37.690718 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 530/1067] 10.222.0.13 () {58 vars in 1059 bytes} [Mon Oct 17 10:17:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:37.699644 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16488b54-000b-455d-a75c-fac8077302fd None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:17:37.701175 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-16488b54-000b-455d-a75c-fac8077302fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:37.803618 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16488b54-000b-455d-a75c-fac8077302fd None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:17:37.862198 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:37.877887 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14d488-044f-48a7-ae6a-11bcd2d4a411 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd5d41f6a16403f990a4cd5922a2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:17:37.878491 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14d488-044f-48a7-ae6a-11bcd2d4a411 service glance] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:37.878765 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14d488-044f-48a7-ae6a-11bcd2d4a411 service glance] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:37.879032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14d488-044f-48a7-ae6a-11bcd2d4a411 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:37.880638 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1f14d488-044f-48a7-ae6a-11bcd2d4a411 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:37.988312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14d488-044f-48a7-ae6a-11bcd2d4a411 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:17:37.989741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14d488-044f-48a7-ae6a-11bcd2d4a411 service glance] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:17:38.008459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 538/1068] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:17:38.331783 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb9a2b-5af9-4ffe-9fad-c7ef5476760b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:38.332354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb9a2b-5af9-4ffe-9fad-c7ef5476760b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:38.332354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb9a2b-5af9-4ffe-9fad-c7ef5476760b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:38.333745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 531/1069] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:17:38.339057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a4924-06e2-47cd-93dc-7e7322043923 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:38.339505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a4924-06e2-47cd-93dc-7e7322043923 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:38.339875 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a4924-06e2-47cd-93dc-7e7322043923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:38.415579 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-bd4a4924-06e2-47cd-93dc-7e7322043923 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:38.416795 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bd4a4924-06e2-47cd-93dc-7e7322043923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:38.459919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:38.517032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 539/1070] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:17:38.746261 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807afc64-3341-4e90-85e3-9404111b76d9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:38.746545 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807afc64-3341-4e90-85e3-9404111b76d9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:38.746822 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807afc64-3341-4e90-85e3-9404111b76d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:38.807609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a4924-06e2-47cd-93dc-7e7322043923 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:17:38.808853 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bd4a4924-06e2-47cd-93dc-7e7322043923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:38.814804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-807afc64-3341-4e90-85e3-9404111b76d9 None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:38.816031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-807afc64-3341-4e90-85e3-9404111b76d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:38.876711 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:38.909703 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 532/1071] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 17 10:17:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:38.928708 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a4924-06e2-47cd-93dc-7e7322043923 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:17:38.955164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19e3a1-9d57-4295-964f-369249bb1a88 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:38.955448 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19e3a1-9d57-4295-964f-369249bb1a88 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:38.955717 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19e3a1-9d57-4295-964f-369249bb1a88 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:38.957118 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 533/1072] 10.222.0.13 () {54 vars in 943 bytes} [Mon Oct 17 10:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:17:38.964478 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f2e88-7f47-429a-b696-8af46bfcbfc5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:38.964762 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f2e88-7f47-429a-b696-8af46bfcbfc5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:38.965035 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f2e88-7f47-429a-b696-8af46bfcbfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:38.985680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:39.041920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-261f2e88-7f47-429a-b696-8af46bfcbfc5 None None] MFA Rules not processed for user `e2969c098a154afcba382c707122598d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:39.043118 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-261f2e88-7f47-429a-b696-8af46bfcbfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:39.049611 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a7d4f-d407-4c57-a534-99a5461b3a3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:17:39.050459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a7d4f-d407-4c57-a534-99a5461b3a3d service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:39.050459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a7d4f-d407-4c57-a534-99a5461b3a3d service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:39.050735 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a7d4f-d407-4c57-a534-99a5461b3a3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:39.052345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-472a7d4f-d407-4c57-a534-99a5461b3a3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:39.147321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a7d4f-d407-4c57-a534-99a5461b3a3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:17:39.148940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a7d4f-d407-4c57-a534-99a5461b3a3d service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:17:39.155282 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 534/1073] 10.222.0.13 () {58 vars in 1040 bytes} [Mon Oct 17 10:17:38 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:17:39.165277 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f2e88-7f47-429a-b696-8af46bfcbfc5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:17:39.167342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 540/1074] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:17:39.175031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f2e88-7f47-429a-b696-8af46bfcbfc5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:17:39.208492 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:39.328962 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28013600-18a0-48a9-9be3-ca89dc92ba51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:17:39.329750 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013600-18a0-48a9-9be3-ca89dc92ba51 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:39.330122 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013600-18a0-48a9-9be3-ca89dc92ba51 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:39.332087 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013600-18a0-48a9-9be3-ca89dc92ba51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:39.332665 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-28013600-18a0-48a9-9be3-ca89dc92ba51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:39.456827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28013600-18a0-48a9-9be3-ca89dc92ba51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:17:39.458513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28013600-18a0-48a9-9be3-ca89dc92ba51 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:17:39.466404 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 535/1075] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:17:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 17 10:17:41.380624 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186bf8-759a-4173-bdcb-7bb3e700db39 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:41.381164 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186bf8-759a-4173-bdcb-7bb3e700db39 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:41.381164 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186bf8-759a-4173-bdcb-7bb3e700db39 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:41.382510 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 541/1076] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:41.387845 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4202fb-4601-4490-9cd4-ddacb95fbee5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:41.388324 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4202fb-4601-4490-9cd4-ddacb95fbee5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:41.388409 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4202fb-4601-4490-9cd4-ddacb95fbee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:41.459297 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bc4202fb-4601-4490-9cd4-ddacb95fbee5 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:41.460710 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bc4202fb-4601-4490-9cd4-ddacb95fbee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:41.468516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:41.568154 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 536/1077] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:41.860487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46186bf8-759a-4173-bdcb-7bb3e700db39 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:17:41.864937 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-46186bf8-759a-4173-bdcb-7bb3e700db39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:41.938369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:42.039901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46186bf8-759a-4173-bdcb-7bb3e700db39 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:17:42.171616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19886f2-5e62-444a-9357-5193ca20cc39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:17:42.172247 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19886f2-5e62-444a-9357-5193ca20cc39 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:42.172525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19886f2-5e62-444a-9357-5193ca20cc39 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:42.172792 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19886f2-5e62-444a-9357-5193ca20cc39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:42.174414 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c19886f2-5e62-444a-9357-5193ca20cc39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:42.204871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:42.276510 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19886f2-5e62-444a-9357-5193ca20cc39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:17:42.278465 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19886f2-5e62-444a-9357-5193ca20cc39 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:17:42.299215 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 542/1078] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:17:44.492764 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304160e-711a-4c26-9582-f5ccf75f75a1 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:44.493309 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304160e-711a-4c26-9582-f5ccf75f75a1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:44.493309 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304160e-711a-4c26-9582-f5ccf75f75a1 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:44.494668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 537/1079] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:44.500409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa84ed-320d-4f78-aa10-6aee6b47e4c0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:44.500807 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa84ed-320d-4f78-aa10-6aee6b47e4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:44.500977 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa84ed-320d-4f78-aa10-6aee6b47e4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:44.569443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-91fa84ed-320d-4f78-aa10-6aee6b47e4c0 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:44.570657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-91fa84ed-320d-4f78-aa10-6aee6b47e4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:44.744733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 543/1080] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:17:45.030259 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304160e-711a-4c26-9582-f5ccf75f75a1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:17:45.031771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5304160e-711a-4c26-9582-f5ccf75f75a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:45.187204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:45.199228 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304160e-711a-4c26-9582-f5ccf75f75a1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:17:45.329275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73124aa-2c80-4ded-ad93-d3fbb94d07a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:17:45.329801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73124aa-2c80-4ded-ad93-d3fbb94d07a6 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:45.330084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73124aa-2c80-4ded-ad93-d3fbb94d07a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:45.330504 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73124aa-2c80-4ded-ad93-d3fbb94d07a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:45.332295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d73124aa-2c80-4ded-ad93-d3fbb94d07a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:45.433929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73124aa-2c80-4ded-ad93-d3fbb94d07a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:17:45.435843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73124aa-2c80-4ded-ad93-d3fbb94d07a6 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:17:45.445961 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:45.464108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 538/1081] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:17:47.646345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b9099-75a1-4cc4-b4bb-a12d360bac4b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:47.646917 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b9099-75a1-4cc4-b4bb-a12d360bac4b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:47.646917 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b9099-75a1-4cc4-b4bb-a12d360bac4b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:47.652066 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 544/1082] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:17:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:17:47.653680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89396e8-fefd-4448-adeb-5eb4d16205b7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:47.654117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89396e8-fefd-4448-adeb-5eb4d16205b7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:47.654301 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89396e8-fefd-4448-adeb-5eb4d16205b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:47.728624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f89396e8-fefd-4448-adeb-5eb4d16205b7 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:17:47.730145 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f89396e8-fefd-4448-adeb-5eb4d16205b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:47.834298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 539/1083] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:17:48.119335 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b9099-75a1-4cc4-b4bb-a12d360bac4b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:17:48.120902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-049b9099-75a1-4cc4-b4bb-a12d360bac4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:48.123822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:48.283917 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b9099-75a1-4cc4-b4bb-a12d360bac4b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:17:48.363006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:48.410388 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01ff64-3105-4552-b163-2fc3aa43eefc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:17:48.411341 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01ff64-3105-4552-b163-2fc3aa43eefc service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:17:48.411628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01ff64-3105-4552-b163-2fc3aa43eefc service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:17:48.411906 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01ff64-3105-4552-b163-2fc3aa43eefc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:17:48.416188 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-eb01ff64-3105-4552-b163-2fc3aa43eefc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:17:48.509587 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01ff64-3105-4552-b163-2fc3aa43eefc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:17:48.511172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01ff64-3105-4552-b163-2fc3aa43eefc service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:17:48.531026 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 545/1084] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:17:57.832761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=67 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:58.527561 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=61 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:02.285557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1e9b5-79bb-4bdf-868a-529d9e7933a4 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:02.286139 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1e9b5-79bb-4bdf-868a-529d9e7933a4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:02.286139 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1e9b5-79bb-4bdf-868a-529d9e7933a4 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:02.287449 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 540/1085] 10.222.0.13 () {54 vars in 918 bytes} [Mon Oct 17 10:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:02.292586 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28add04c-7477-4d97-ae5d-5a88718dc1b3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:02.293028 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28add04c-7477-4d97-ae5d-5a88718dc1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:02.293124 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28add04c-7477-4d97-ae5d-5a88718dc1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:02.366759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-28add04c-7477-4d97-ae5d-5a88718dc1b3 None None] MFA Rules not processed for user `dd52eee25ef347e1ae905cc3cba17284`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:02.367874 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-28add04c-7477-4d97-ae5d-5a88718dc1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:02.472042 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 546/1086] 10.222.0.13 () {58 vars in 1015 bytes} [Mon Oct 17 10:18:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:02.485884 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d451d9-71c6-492a-94b0-ea9d3d2d3535 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:02.486235 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d451d9-71c6-492a-94b0-ea9d3d2d3535 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:02.486513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d451d9-71c6-492a-94b0-ea9d3d2d3535 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:02.487822 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 541/1087] 10.222.0.13 () {54 vars in 918 bytes} [Mon Oct 17 10:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:02.492616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64833a9-b137-4eed-9c84-5bc10ff615a9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:02.492902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64833a9-b137-4eed-9c84-5bc10ff615a9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:02.493170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64833a9-b137-4eed-9c84-5bc10ff615a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:02.564794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:02.567859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f64833a9-b137-4eed-9c84-5bc10ff615a9 None None] MFA Rules not processed for user `a80cc7ec3d2d49f88c81403f918a6900`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:02.569597 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f64833a9-b137-4eed-9c84-5bc10ff615a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:02.681704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 547/1088] 10.222.0.13 () {58 vars in 1015 bytes} [Mon Oct 17 10:18:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:05.251172 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667549b-ca4c-4e13-b48e-3aa6c5651e1a None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:05.251809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667549b-ca4c-4e13-b48e-3aa6c5651e1a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:05.251809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667549b-ca4c-4e13-b48e-3aa6c5651e1a None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:05.253086 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 542/1089] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 10:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:05.258325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374a436-9421-4e04-88f1-767421527dc6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:05.258749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374a436-9421-4e04-88f1-767421527dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:05.258853 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374a436-9421-4e04-88f1-767421527dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:05.323660 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5374a436-9421-4e04-88f1-767421527dc6 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:05.324824 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5374a436-9421-4e04-88f1-767421527dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:05.378822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:05.420237 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 548/1090] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 10:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:05.706931 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667549b-ca4c-4e13-b48e-3aa6c5651e1a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:05.708674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9667549b-ca4c-4e13-b48e-3aa6c5651e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:05.853051 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667549b-ca4c-4e13-b48e-3aa6c5651e1a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:05.924937 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:05.964711 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce6085-701b-49e1-9e6d-5a86304e0b6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:05.965230 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce6085-701b-49e1-9e6d-5a86304e0b6d service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:05.965508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce6085-701b-49e1-9e6d-5a86304e0b6d service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:05.965775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce6085-701b-49e1-9e6d-5a86304e0b6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:05.967365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-54ce6085-701b-49e1-9e6d-5a86304e0b6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:06.055699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce6085-701b-49e1-9e6d-5a86304e0b6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:06.057368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce6085-701b-49e1-9e6d-5a86304e0b6d service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:06.075178 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 543/1091] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:07.199415 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f3fd4-625b-4e12-ad8b-493bab988413 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:07.200001 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f3fd4-625b-4e12-ad8b-493bab988413 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:07.200001 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f3fd4-625b-4e12-ad8b-493bab988413 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:07.201334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 549/1092] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 10:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:07.207800 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52a08b-fdeb-4a5d-84af-5e335634e446 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:07.208255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52a08b-fdeb-4a5d-84af-5e335634e446 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:07.208373 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52a08b-fdeb-4a5d-84af-5e335634e446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:07.282481 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6e52a08b-fdeb-4a5d-84af-5e335634e446 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:07.283670 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6e52a08b-fdeb-4a5d-84af-5e335634e446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:07.310200 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:07.378185 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 544/1093] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 10:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:07.526967 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f3fd4-625b-4e12-ad8b-493bab988413 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:07.528543 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cb6f3fd4-625b-4e12-ad8b-493bab988413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:07.674246 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f3fd4-625b-4e12-ad8b-493bab988413 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:07.712990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:07.786796 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3459f8a-47b1-4ac8-a661-a531a2bd69ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:07.787403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3459f8a-47b1-4ac8-a661-a531a2bd69ef service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:07.787683 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3459f8a-47b1-4ac8-a661-a531a2bd69ef service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:07.787980 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3459f8a-47b1-4ac8-a661-a531a2bd69ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:07.789594 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b3459f8a-47b1-4ac8-a661-a531a2bd69ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:07.877260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3459f8a-47b1-4ac8-a661-a531a2bd69ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:07.878879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3459f8a-47b1-4ac8-a661-a531a2bd69ef service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:07.896970 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 550/1094] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:09.028047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14513-f743-4201-9f56-aa6cbc583604 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:09.028606 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14513-f743-4201-9f56-aa6cbc583604 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:09.028606 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14513-f743-4201-9f56-aa6cbc583604 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:09.029951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 545/1095] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 10:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:09.036047 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac4f58-8f25-458d-8fbe-c98d41559832 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:09.036503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac4f58-8f25-458d-8fbe-c98d41559832 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:09.036610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac4f58-8f25-458d-8fbe-c98d41559832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:09.089823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:09.111440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-11ac4f58-8f25-458d-8fbe-c98d41559832 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:09.112657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-11ac4f58-8f25-458d-8fbe-c98d41559832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:09.206482 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 551/1096] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 10:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:09.356526 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c14513-f743-4201-9f56-aa6cbc583604 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:09.357973 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-77c14513-f743-4201-9f56-aa6cbc583604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:09.502157 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c14513-f743-4201-9f56-aa6cbc583604 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:09.513889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:09.613645 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518984e4-dda0-4d7c-91f1-0fb0620ef743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:09.614172 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518984e4-dda0-4d7c-91f1-0fb0620ef743 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:09.614453 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518984e4-dda0-4d7c-91f1-0fb0620ef743 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:09.614718 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518984e4-dda0-4d7c-91f1-0fb0620ef743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:09.616333 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-518984e4-dda0-4d7c-91f1-0fb0620ef743 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:09.703062 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518984e4-dda0-4d7c-91f1-0fb0620ef743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:09.704669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518984e4-dda0-4d7c-91f1-0fb0620ef743 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:09.722316 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 546/1097] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:10.815189 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587d5a-8ad3-4e11-b00f-d41928e58db0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:10.815627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587d5a-8ad3-4e11-b00f-d41928e58db0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:10.815740 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587d5a-8ad3-4e11-b00f-d41928e58db0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:10.817098 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 552/1098] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 10:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:10.823291 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf70109-f9b4-468c-9568-6a03f20fc990 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:10.823719 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf70109-f9b4-468c-9568-6a03f20fc990 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:10.823839 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf70109-f9b4-468c-9568-6a03f20fc990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:10.843686 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:10.899821 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-faf70109-f9b4-468c-9568-6a03f20fc990 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:10.901042 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-faf70109-f9b4-468c-9568-6a03f20fc990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:10.995302 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 547/1099] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 10:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:11.143446 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79587d5a-8ad3-4e11-b00f-d41928e58db0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:11.145023 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-79587d5a-8ad3-4e11-b00f-d41928e58db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:11.255521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:11.291703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79587d5a-8ad3-4e11-b00f-d41928e58db0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:11.402139 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25439c49-54ab-4188-ac11-79c2baf1bbeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:11.402738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25439c49-54ab-4188-ac11-79c2baf1bbeb service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:11.403070 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25439c49-54ab-4188-ac11-79c2baf1bbeb service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:11.403347 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25439c49-54ab-4188-ac11-79c2baf1bbeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:11.405466 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-25439c49-54ab-4188-ac11-79c2baf1bbeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:11.479129 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:11.493879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25439c49-54ab-4188-ac11-79c2baf1bbeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:11.495468 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25439c49-54ab-4188-ac11-79c2baf1bbeb service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:11.513397 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 553/1100] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:12.620800 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32aad6a-5c9a-485b-a6e3-d364e95374bd None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:12.621349 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32aad6a-5c9a-485b-a6e3-d364e95374bd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:12.621349 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32aad6a-5c9a-485b-a6e3-d364e95374bd None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:12.622781 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 548/1101] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 10:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:12.630027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432fbbc-00e7-4391-8e73-4334dfd4e459 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:12.630523 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432fbbc-00e7-4391-8e73-4334dfd4e459 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:12.630620 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432fbbc-00e7-4391-8e73-4334dfd4e459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:12.707681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6432fbbc-00e7-4391-8e73-4334dfd4e459 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:12.708927 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6432fbbc-00e7-4391-8e73-4334dfd4e459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:12.808920 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 554/1102] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 10:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:12.964898 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32aad6a-5c9a-485b-a6e3-d364e95374bd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:12.966399 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b32aad6a-5c9a-485b-a6e3-d364e95374bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:13.051524 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:13.114232 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32aad6a-5c9a-485b-a6e3-d364e95374bd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:13.228408 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd861869-818c-4ba0-8534-1c82d3badf5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:13.228946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd861869-818c-4ba0-8534-1c82d3badf5d service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:13.229217 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd861869-818c-4ba0-8534-1c82d3badf5d service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:13.229484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd861869-818c-4ba0-8534-1c82d3badf5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:13.231062 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dd861869-818c-4ba0-8534-1c82d3badf5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:13.280850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:13.321786 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd861869-818c-4ba0-8534-1c82d3badf5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:13.323418 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd861869-818c-4ba0-8534-1c82d3badf5d service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:13.340887 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 549/1103] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:14.386105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75922c97-5de5-4328-8d8e-d90246c4454e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:14.386621 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75922c97-5de5-4328-8d8e-d90246c4454e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:14.386732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75922c97-5de5-4328-8d8e-d90246c4454e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:14.388024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 555/1104] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 10:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:14.394166 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dffbc9-0158-43ca-bcad-d2b616bf6aa6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:14.394579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dffbc9-0158-43ca-bcad-d2b616bf6aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:14.394712 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dffbc9-0158-43ca-bcad-d2b616bf6aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:14.470115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f1dffbc9-0158-43ca-bcad-d2b616bf6aa6 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:14.472231 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f1dffbc9-0158-43ca-bcad-d2b616bf6aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:14.570599 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 550/1105] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 10:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:14.717468 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75922c97-5de5-4328-8d8e-d90246c4454e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:14.719405 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-75922c97-5de5-4328-8d8e-d90246c4454e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:14.767496 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:14.863899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75922c97-5de5-4328-8d8e-d90246c4454e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:14.972734 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5da0fc-884e-4606-bcbf-986c2e225115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:14.973265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5da0fc-884e-4606-bcbf-986c2e225115 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:14.973539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5da0fc-884e-4606-bcbf-986c2e225115 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:14.973805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5da0fc-884e-4606-bcbf-986c2e225115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:14.975410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6a5da0fc-884e-4606-bcbf-986c2e225115 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:14.982158 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:15.063209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5da0fc-884e-4606-bcbf-986c2e225115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:15.064841 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5da0fc-884e-4606-bcbf-986c2e225115 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:15.082338 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 556/1106] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:16.138551 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e021c-6315-4694-a693-a40267da15fd None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:16.139103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e021c-6315-4694-a693-a40267da15fd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:16.139103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e021c-6315-4694-a693-a40267da15fd None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:16.141067 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 551/1107] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 10:18:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:16.147253 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a070b0e-d319-410b-b5a4-e78aa2a0d7b6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:16.147732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a070b0e-d319-410b-b5a4-e78aa2a0d7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:16.147830 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a070b0e-d319-410b-b5a4-e78aa2a0d7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:16.222021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2a070b0e-d319-410b-b5a4-e78aa2a0d7b6 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:16.223227 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2a070b0e-d319-410b-b5a4-e78aa2a0d7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:16.290748 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:16.320283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 557/1108] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 10:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:16.468369 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e021c-6315-4694-a693-a40267da15fd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:16.469933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-723e021c-6315-4694-a693-a40267da15fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:16.488357 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:16.619295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e021c-6315-4694-a693-a40267da15fd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:16.704747 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:16.731098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e2b9d-7572-4b03-852f-a1737bbc7219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:16.731701 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e2b9d-7572-4b03-852f-a1737bbc7219 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:16.732004 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e2b9d-7572-4b03-852f-a1737bbc7219 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:16.732277 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e2b9d-7572-4b03-852f-a1737bbc7219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:16.734443 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a92e2b9d-7572-4b03-852f-a1737bbc7219 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:16.821860 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e2b9d-7572-4b03-852f-a1737bbc7219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:16.823459 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e2b9d-7572-4b03-852f-a1737bbc7219 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:16.841029 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 552/1109] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:17.897506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366642ff-4b75-41ef-9877-e049ca62906e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:17.898113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366642ff-4b75-41ef-9877-e049ca62906e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:17.898113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366642ff-4b75-41ef-9877-e049ca62906e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:17.899513 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 558/1110] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 10:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:17.906359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8620f-733e-4b6e-9614-11588c242d86 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:17.906810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8620f-733e-4b6e-9614-11588c242d86 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:17.906913 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8620f-733e-4b6e-9614-11588c242d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:17.981619 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-47b8620f-733e-4b6e-9614-11588c242d86 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:17.982849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-47b8620f-733e-4b6e-9614-11588c242d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:18.025926 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:18.080141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 553/1111] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 10:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:18.228673 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366642ff-4b75-41ef-9877-e049ca62906e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:18.230106 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-366642ff-4b75-41ef-9877-e049ca62906e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:18.372598 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366642ff-4b75-41ef-9877-e049ca62906e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:18.425776 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:18.484103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca065b-8c7c-4ac7-b5aa-3186295d1986 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:18.484640 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca065b-8c7c-4ac7-b5aa-3186295d1986 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:18.484919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca065b-8c7c-4ac7-b5aa-3186295d1986 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:18.485190 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca065b-8c7c-4ac7-b5aa-3186295d1986 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:18.486793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7aca065b-8c7c-4ac7-b5aa-3186295d1986 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:18.576213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca065b-8c7c-4ac7-b5aa-3186295d1986 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:18.577840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca065b-8c7c-4ac7-b5aa-3186295d1986 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:18.595383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 559/1112] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:19.638255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f9301-89eb-4981-ba8f-7fdd05ee86b2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:19.638798 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f9301-89eb-4981-ba8f-7fdd05ee86b2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:19.638798 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f9301-89eb-4981-ba8f-7fdd05ee86b2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:19.640781 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 554/1113] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 10:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:19.647012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d755b5-d14d-4778-a9e3-0e4bd01bd039 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:19.647486 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d755b5-d14d-4778-a9e3-0e4bd01bd039 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:19.647597 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d755b5-d14d-4778-a9e3-0e4bd01bd039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:19.721882 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f9d755b5-d14d-4778-a9e3-0e4bd01bd039 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:19.723070 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f9d755b5-d14d-4778-a9e3-0e4bd01bd039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:19.725042 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:19.818258 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 560/1114] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 10:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:19.965940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f9301-89eb-4981-ba8f-7fdd05ee86b2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:19.967467 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c39f9301-89eb-4981-ba8f-7fdd05ee86b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:20.111496 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f9301-89eb-4981-ba8f-7fdd05ee86b2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:20.138477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:20.222910 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a47e6-8732-4eab-bb08-0dc203c5d99b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:20.223436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a47e6-8732-4eab-bb08-0dc203c5d99b service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:20.223712 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a47e6-8732-4eab-bb08-0dc203c5d99b service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:20.224019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a47e6-8732-4eab-bb08-0dc203c5d99b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:20.225616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ec0a47e6-8732-4eab-bb08-0dc203c5d99b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:20.313849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a47e6-8732-4eab-bb08-0dc203c5d99b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:20.315438 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a47e6-8732-4eab-bb08-0dc203c5d99b service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:20.332825 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 555/1115] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:22.393066 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a3a21-0146-463c-88e4-795938a9aada None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:22.393646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a3a21-0146-463c-88e4-795938a9aada None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:22.393646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a3a21-0146-463c-88e4-795938a9aada None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:22.394971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 561/1116] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 10:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:22.400241 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0fc9-9197-4f49-b547-5226cc658be6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:22.400652 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0fc9-9197-4f49-b547-5226cc658be6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:22.400794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0fc9-9197-4f49-b547-5226cc658be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:22.441114 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:22.466967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ec3d0fc9-9197-4f49-b547-5226cc658be6 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:22.468739 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ec3d0fc9-9197-4f49-b547-5226cc658be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:22.564943 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 556/1117] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 10:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:22.849269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a3a21-0146-463c-88e4-795938a9aada None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:22.850784 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-595a3a21-0146-463c-88e4-795938a9aada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:22.952842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a3a21-0146-463c-88e4-795938a9aada None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:22.984224 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:23.031766 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f21672-f25a-4408-8b4e-b4611cbc90b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:23.032424 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21672-f25a-4408-8b4e-b4611cbc90b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:23.032706 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21672-f25a-4408-8b4e-b4611cbc90b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:23.032978 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21672-f25a-4408-8b4e-b4611cbc90b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:23.034639 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-98f21672-f25a-4408-8b4e-b4611cbc90b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:23.143704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f21672-f25a-4408-8b4e-b4611cbc90b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:23.145178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f21672-f25a-4408-8b4e-b4611cbc90b8 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:23.162556 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 562/1118] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:25.433614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139774-07db-4bba-9cd9-aedc2680dad4 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:25.434168 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139774-07db-4bba-9cd9-aedc2680dad4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:25.434168 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139774-07db-4bba-9cd9-aedc2680dad4 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:25.435487 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 557/1119] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 10:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:18:25.440818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba1472-6b55-4506-a6b9-c435d0864cd3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:25.441247 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba1472-6b55-4506-a6b9-c435d0864cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:25.441361 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba1472-6b55-4506-a6b9-c435d0864cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:25.507163 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-49ba1472-6b55-4506-a6b9-c435d0864cd3 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:25.508476 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-49ba1472-6b55-4506-a6b9-c435d0864cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:25.521490 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:25.603165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 563/1120] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 10:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:25.883443 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0139774-07db-4bba-9cd9-aedc2680dad4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:25.885025 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f0139774-07db-4bba-9cd9-aedc2680dad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:25.986847 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0139774-07db-4bba-9cd9-aedc2680dad4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:25.999691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:26.060094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67a4a2-2fe8-454d-8211-f868c6dbd51f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:26.060702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67a4a2-2fe8-454d-8211-f868c6dbd51f service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:26.060980 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67a4a2-2fe8-454d-8211-f868c6dbd51f service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:26.061276 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67a4a2-2fe8-454d-8211-f868c6dbd51f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:26.062878 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1e67a4a2-2fe8-454d-8211-f868c6dbd51f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:26.170743 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67a4a2-2fe8-454d-8211-f868c6dbd51f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:26.172126 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67a4a2-2fe8-454d-8211-f868c6dbd51f service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:26.189559 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 558/1121] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:28.603322 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7c8cf-b536-4910-9059-9b1a949dcaf8 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:28.603862 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7c8cf-b536-4910-9059-9b1a949dcaf8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:28.604010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7c8cf-b536-4910-9059-9b1a949dcaf8 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:28.605312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 564/1122] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 10:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:28.610612 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e28a0-aa7a-4da7-b494-c1615e522245 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:28.611046 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e28a0-aa7a-4da7-b494-c1615e522245 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:28.611163 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e28a0-aa7a-4da7-b494-c1615e522245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:28.659194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:28.676867 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-402e28a0-aa7a-4da7-b494-c1615e522245 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:28.678049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-402e28a0-aa7a-4da7-b494-c1615e522245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:28.772325 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 559/1123] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 10:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:29.050849 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7c8cf-b536-4910-9059-9b1a949dcaf8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:29.052415 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b0c7c8cf-b536-4910-9059-9b1a949dcaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:29.155143 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7c8cf-b536-4910-9059-9b1a949dcaf8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:29.195126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:29.228729 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d430c6-ec53-4b27-8e05-fcfbdd67c359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:29.229333 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d430c6-ec53-4b27-8e05-fcfbdd67c359 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:29.229608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d430c6-ec53-4b27-8e05-fcfbdd67c359 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:29.229878 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d430c6-ec53-4b27-8e05-fcfbdd67c359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:29.231534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-48d430c6-ec53-4b27-8e05-fcfbdd67c359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:29.338109 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d430c6-ec53-4b27-8e05-fcfbdd67c359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:29.339466 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d430c6-ec53-4b27-8e05-fcfbdd67c359 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:29.357491 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 565/1124] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:31.600219 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff6a8a-9f5d-4c25-a120-5c1d0d5eaf5b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:31.600752 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff6a8a-9f5d-4c25-a120-5c1d0d5eaf5b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:31.600752 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff6a8a-9f5d-4c25-a120-5c1d0d5eaf5b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:31.602099 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 560/1125] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 10:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:31.607543 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25f45c-713f-4f02-8b73-6ce9ce4d0c60 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:31.608014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25f45c-713f-4f02-8b73-6ce9ce4d0c60 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:31.608128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25f45c-713f-4f02-8b73-6ce9ce4d0c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:31.673519 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ca25f45c-713f-4f02-8b73-6ce9ce4d0c60 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:31.674725 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ca25f45c-713f-4f02-8b73-6ce9ce4d0c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:31.695255 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:31.774168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 566/1126] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 10:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:32.057313 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff6a8a-9f5d-4c25-a120-5c1d0d5eaf5b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:32.058833 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-41ff6a8a-9f5d-4c25-a120-5c1d0d5eaf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:32.160909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff6a8a-9f5d-4c25-a120-5c1d0d5eaf5b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:32.180727 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:32.234826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7262a2a-bbf2-41a4-8a37-60e21b59d1f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:32.235429 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7262a2a-bbf2-41a4-8a37-60e21b59d1f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:32.235705 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7262a2a-bbf2-41a4-8a37-60e21b59d1f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:32.235999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7262a2a-bbf2-41a4-8a37-60e21b59d1f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:32.237590 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e7262a2a-bbf2-41a4-8a37-60e21b59d1f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:32.344663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7262a2a-bbf2-41a4-8a37-60e21b59d1f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:32.346035 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7262a2a-bbf2-41a4-8a37-60e21b59d1f0 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:32.364494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 561/1127] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:34.562471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f2bdc-1df2-4f91-87d0-e1f1beb614cf None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:34.563035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f2bdc-1df2-4f91-87d0-e1f1beb614cf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:34.563035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f2bdc-1df2-4f91-87d0-e1f1beb614cf None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:34.564399 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 567/1128] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 10:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:34.569800 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85b859-c8b8-49c2-b7ab-80cedbbd37b0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:34.570236 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85b859-c8b8-49c2-b7ab-80cedbbd37b0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:34.570376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85b859-c8b8-49c2-b7ab-80cedbbd37b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:34.633218 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:34.636135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3a85b859-c8b8-49c2-b7ab-80cedbbd37b0 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:34.637845 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3a85b859-c8b8-49c2-b7ab-80cedbbd37b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:34.733858 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 562/1129] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 10:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:35.030703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89668013-84d5-4396-b0d7-357b5672ee03 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:35.030988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89668013-84d5-4396-b0d7-357b5672ee03 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:35.031265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89668013-84d5-4396-b0d7-357b5672ee03 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:35.032640 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 568/1130] 10.222.0.13 () {54 vars in 964 bytes} [Mon Oct 17 10:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:35.038533 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8973a4e-8fb7-44f7-8a8b-4dfeae82e570 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:35.038816 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8973a4e-8fb7-44f7-8a8b-4dfeae82e570 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:35.039116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8973a4e-8fb7-44f7-8a8b-4dfeae82e570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:35.114769 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e8973a4e-8fb7-44f7-8a8b-4dfeae82e570 None None] MFA Rules not processed for user `98030e60807e44ec928488e904ca24c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:35.115984 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e8973a4e-8fb7-44f7-8a8b-4dfeae82e570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:35.183724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:35.190283 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 563/1131] 10.222.0.13 () {58 vars in 1061 bytes} [Mon Oct 17 10:18:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:35.199417 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89668013-84d5-4396-b0d7-357b5672ee03 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:35.200985 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-89668013-84d5-4396-b0d7-357b5672ee03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:35.302508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89668013-84d5-4396-b0d7-357b5672ee03 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:35.350058 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:35.375093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc063ad-8b5f-45de-832c-4d00bb16eb7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:35.375686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc063ad-8b5f-45de-832c-4d00bb16eb7c service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:35.375982 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc063ad-8b5f-45de-832c-4d00bb16eb7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:35.376250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc063ad-8b5f-45de-832c-4d00bb16eb7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:35.377826 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bdc063ad-8b5f-45de-832c-4d00bb16eb7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:35.483573 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc063ad-8b5f-45de-832c-4d00bb16eb7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:35.485075 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc063ad-8b5f-45de-832c-4d00bb16eb7c service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:35.502830 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 569/1132] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:38.138454 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1442231-9740-41e7-96b0-f4fde386d35c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:38.139045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1442231-9740-41e7-96b0-f4fde386d35c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:38.139045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1442231-9740-41e7-96b0-f4fde386d35c None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:38.140393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 564/1133] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 10:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:38.145713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1289dc2-e411-4571-b955-dde67de968c0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:38.146167 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1289dc2-e411-4571-b955-dde67de968c0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:38.146277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1289dc2-e411-4571-b955-dde67de968c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:38.210399 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c1289dc2-e411-4571-b955-dde67de968c0 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:38.211592 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c1289dc2-e411-4571-b955-dde67de968c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:38.239506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:38.306385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 570/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 10:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:38.588642 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1442231-9740-41e7-96b0-f4fde386d35c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:38.590187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c1442231-9740-41e7-96b0-f4fde386d35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:38.693644 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1442231-9740-41e7-96b0-f4fde386d35c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:38.766550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a09ba-b4cd-44cd-bde6-42f404bd9e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:38.767151 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a09ba-b4cd-44cd-bde6-42f404bd9e50 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:38.767427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a09ba-b4cd-44cd-bde6-42f404bd9e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:38.767695 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a09ba-b4cd-44cd-bde6-42f404bd9e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:38.769314 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a19a09ba-b4cd-44cd-bde6-42f404bd9e50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:38.817419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:38.878887 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a09ba-b4cd-44cd-bde6-42f404bd9e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:38.880358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a09ba-b4cd-44cd-bde6-42f404bd9e50 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:38.899673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 565/1135] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:41.185312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7aa32-3963-4fb2-9c98-d34fe2c2bdc9 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:41.185893 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7aa32-3963-4fb2-9c98-d34fe2c2bdc9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:41.185893 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7aa32-3963-4fb2-9c98-d34fe2c2bdc9 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:41.187238 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 571/1136] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 10:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:41.192927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e27002-0b86-43dd-bb70-7c4835f2a7ba None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:41.193366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e27002-0b86-43dd-bb70-7c4835f2a7ba None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:41.193639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e27002-0b86-43dd-bb70-7c4835f2a7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:41.259126 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c6e27002-0b86-43dd-bb70-7c4835f2a7ba None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:41.260397 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c6e27002-0b86-43dd-bb70-7c4835f2a7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:41.355252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 566/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 10:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:41.639012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7aa32-3963-4fb2-9c98-d34fe2c2bdc9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:41.640595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8bc7aa32-3963-4fb2-9c98-d34fe2c2bdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:41.745647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7aa32-3963-4fb2-9c98-d34fe2c2bdc9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:41.800013 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:41.818331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6143f84-22cc-42a6-aad6-1dfd4629479b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:41.818935 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6143f84-22cc-42a6-aad6-1dfd4629479b service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:41.819213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6143f84-22cc-42a6-aad6-1dfd4629479b service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:41.819480 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6143f84-22cc-42a6-aad6-1dfd4629479b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:41.821106 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a6143f84-22cc-42a6-aad6-1dfd4629479b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:41.926284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6143f84-22cc-42a6-aad6-1dfd4629479b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:41.927637 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6143f84-22cc-42a6-aad6-1dfd4629479b service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:41.945496 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 572/1138] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:44.128831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f01abe-106c-4664-8370-186e6885f622 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:44.129347 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f01abe-106c-4664-8370-186e6885f622 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:44.129347 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f01abe-106c-4664-8370-186e6885f622 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:44.130744 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 567/1139] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 10:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:44.136158 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a296c1-0f98-461e-bf5d-39355e1aaad8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:44.136597 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a296c1-0f98-461e-bf5d-39355e1aaad8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:44.136695 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a296c1-0f98-461e-bf5d-39355e1aaad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:44.202475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f8a296c1-0f98-461e-bf5d-39355e1aaad8 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:44.203696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f8a296c1-0f98-461e-bf5d-39355e1aaad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:44.241470 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:44.299325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 573/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 10:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:44.581262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f01abe-106c-4664-8370-186e6885f622 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:44.582789 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-86f01abe-106c-4664-8370-186e6885f622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:44.586704 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:44.686551 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f01abe-106c-4664-8370-186e6885f622 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:44.757826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992aca1-adc1-45a6-8d5d-fed7ff429523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:44.758456 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992aca1-adc1-45a6-8d5d-fed7ff429523 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:44.758733 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992aca1-adc1-45a6-8d5d-fed7ff429523 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:44.759002 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992aca1-adc1-45a6-8d5d-fed7ff429523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:44.760641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8992aca1-adc1-45a6-8d5d-fed7ff429523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:44.818421 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:44.868322 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992aca1-adc1-45a6-8d5d-fed7ff429523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:44.869684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992aca1-adc1-45a6-8d5d-fed7ff429523 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:44.887540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 568/1141] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:47.029953 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3887-cac2-41f4-88cb-94ceb1c8c8c5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:47.030487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3887-cac2-41f4-88cb-94ceb1c8c8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:47.030487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3887-cac2-41f4-88cb-94ceb1c8c8c5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:47.031820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 574/1142] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 10:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:47.037088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdec0c-a4a2-4ce1-a2c8-5efc3c783b05 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:47.037542 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdec0c-a4a2-4ce1-a2c8-5efc3c783b05 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:47.037653 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdec0c-a4a2-4ce1-a2c8-5efc3c783b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:47.108488 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d7fdec0c-a4a2-4ce1-a2c8-5efc3c783b05 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:47.109692 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d7fdec0c-a4a2-4ce1-a2c8-5efc3c783b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:47.204789 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 569/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 10:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:47.486249 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d3887-cac2-41f4-88cb-94ceb1c8c8c5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:47.487778 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bd6d3887-cac2-41f4-88cb-94ceb1c8c8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:47.589800 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d3887-cac2-41f4-88cb-94ceb1c8c8c5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:47.657137 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:47.664161 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffdffb-9897-4729-b992-c25e8165f20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:47.664760 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffdffb-9897-4729-b992-c25e8165f20c service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:47.665034 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffdffb-9897-4729-b992-c25e8165f20c service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:47.665298 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffdffb-9897-4729-b992-c25e8165f20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:47.666879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-07ffdffb-9897-4729-b992-c25e8165f20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:47.773315 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ffdffb-9897-4729-b992-c25e8165f20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:47.774669 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ffdffb-9897-4729-b992-c25e8165f20c service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:47.792398 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 575/1144] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:49.939501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53750c9d-a552-42cc-836e-288489ec4585 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:49.940097 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53750c9d-a552-42cc-836e-288489ec4585 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:49.940097 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53750c9d-a552-42cc-836e-288489ec4585 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:49.941417 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 570/1145] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 10:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:18:49.946747 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4cfc7-e96c-4240-9991-6b93fe88af80 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:49.947139 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4cfc7-e96c-4240-9991-6b93fe88af80 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:49.947301 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4cfc7-e96c-4240-9991-6b93fe88af80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:50.013080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1be4cfc7-e96c-4240-9991-6b93fe88af80 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:18:50.014290 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1be4cfc7-e96c-4240-9991-6b93fe88af80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:50.061160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:50.111898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 576/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 10:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:18:50.391521 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53750c9d-a552-42cc-836e-288489ec4585 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:18:50.393103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-53750c9d-a552-42cc-836e-288489ec4585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:50.407480 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:50.496928 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53750c9d-a552-42cc-836e-288489ec4585 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:18:50.569472 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b830843-5c4c-4ecf-a822-3b1d9ff842ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:18:50.570066 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830843-5c4c-4ecf-a822-3b1d9ff842ef service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:18:50.570337 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830843-5c4c-4ecf-a822-3b1d9ff842ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:18:50.570603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830843-5c4c-4ecf-a822-3b1d9ff842ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:18:50.572294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2b830843-5c4c-4ecf-a822-3b1d9ff842ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:18:50.639679 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:50.680601 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b830843-5c4c-4ecf-a822-3b1d9ff842ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:18:50.682538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b830843-5c4c-4ecf-a822-3b1d9ff842ef service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:18:50.700423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 571/1147] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:19:00.110369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=22 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:00.698190 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=25 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:10.539175 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d1de8-db25-4e8c-a501-475abfb448d0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:10.539795 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d1de8-db25-4e8c-a501-475abfb448d0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:10.539795 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d1de8-db25-4e8c-a501-475abfb448d0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:10.541184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 577/1148] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:19:10.546475 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055afdf-300a-4e7f-8c86-f28ddf8852f8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:10.546922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055afdf-300a-4e7f-8c86-f28ddf8852f8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:10.547027 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055afdf-300a-4e7f-8c86-f28ddf8852f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:10.611802 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1055afdf-300a-4e7f-8c86-f28ddf8852f8 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:19:10.613007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1055afdf-300a-4e7f-8c86-f28ddf8852f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:10.707545 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 572/1149] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:19:11.006928 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f24d52-e40c-4ab7-837c-16949aef620d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:11.007216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f24d52-e40c-4ab7-837c-16949aef620d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:11.007489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f24d52-e40c-4ab7-837c-16949aef620d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:11.008856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 578/1150] 10.222.0.13 () {54 vars in 962 bytes} [Mon Oct 17 10:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:19:11.013773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b89c1-7bcb-40d7-acbf-645d125c539b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:11.014058 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b89c1-7bcb-40d7-acbf-645d125c539b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:11.014329 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b89c1-7bcb-40d7-acbf-645d125c539b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:11.088946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a64b89c1-7bcb-40d7-acbf-645d125c539b None None] MFA Rules not processed for user `2bd5d41f6a16403f990a4cd5922a2644`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:19:11.090183 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a64b89c1-7bcb-40d7-acbf-645d125c539b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:11.110561 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:11.164732 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 573/1151] 10.222.0.13 () {58 vars in 1059 bytes} [Mon Oct 17 10:19:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:19:11.172856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f24d52-e40c-4ab7-837c-16949aef620d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:19:11.174361 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-13f24d52-e40c-4ab7-837c-16949aef620d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:11.275464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f24d52-e40c-4ab7-837c-16949aef620d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:19:11.348626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722e062-d058-477b-a3db-6c4890c85d9e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd5d41f6a16403f990a4cd5922a2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:19:11.349155 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722e062-d058-477b-a3db-6c4890c85d9e service glance] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:11.349428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722e062-d058-477b-a3db-6c4890c85d9e service glance] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:11.349697 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722e062-d058-477b-a3db-6c4890c85d9e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:11.351264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c722e062-d058-477b-a3db-6c4890c85d9e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:11.406420 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:11.460280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722e062-d058-477b-a3db-6c4890c85d9e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:19:11.461705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722e062-d058-477b-a3db-6c4890c85d9e service glance] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:19:11.480583 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 579/1152] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:19:13.706496 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b326e-6b8d-4c6e-96f9-201ad863e573 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:13.707052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b326e-6b8d-4c6e-96f9-201ad863e573 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:13.707052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b326e-6b8d-4c6e-96f9-201ad863e573 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:13.708422 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 574/1153] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:19:13.713743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d3844-e1a6-4fbb-8f7f-6aa16dc489f6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:13.714645 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d3844-e1a6-4fbb-8f7f-6aa16dc489f6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:13.714815 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d3844-e1a6-4fbb-8f7f-6aa16dc489f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:13.781498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-330d3844-e1a6-4fbb-8f7f-6aa16dc489f6 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:19:13.782711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-330d3844-e1a6-4fbb-8f7f-6aa16dc489f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:13.880836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 580/1154] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:19:14.155117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b326e-6b8d-4c6e-96f9-201ad863e573 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:19:14.156687 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f53b326e-6b8d-4c6e-96f9-201ad863e573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:14.280010 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b326e-6b8d-4c6e-96f9-201ad863e573 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:19:14.332682 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:14.376733 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7115c0-7ddf-4123-bca9-cfbc685791ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:19:14.377342 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7115c0-7ddf-4123-bca9-cfbc685791ac admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:14.377621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7115c0-7ddf-4123-bca9-cfbc685791ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:14.377895 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7115c0-7ddf-4123-bca9-cfbc685791ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:14.378530 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7115c0-7ddf-4123-bca9-cfbc685791ac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:19:14.379540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-6e7115c0-7ddf-4123-bca9-cfbc685791ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:19:14.379540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: warnings.warn(msg) Oct 17 10:19:14.379540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: Oct 17 10:19:14.380702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7115c0-7ddf-4123-bca9-cfbc685791ac admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:19:14.400758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 575/1155] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 17 10:19:14 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:19:16.566085 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7b045-3cbc-4976-9dc5-a407ab6ce30a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:16.566625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7b045-3cbc-4976-9dc5-a407ab6ce30a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:16.566625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7b045-3cbc-4976-9dc5-a407ab6ce30a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:16.568034 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 581/1156] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:19:16.573352 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af018e9f-cff0-48a3-ac5a-4c2b20f654bd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:16.573781 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af018e9f-cff0-48a3-ac5a-4c2b20f654bd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:16.573927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af018e9f-cff0-48a3-ac5a-4c2b20f654bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:16.639261 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-af018e9f-cff0-48a3-ac5a-4c2b20f654bd None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:19:16.640492 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-af018e9f-cff0-48a3-ac5a-4c2b20f654bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:16.735678 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 576/1157] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:19:17.028240 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7b045-3cbc-4976-9dc5-a407ab6ce30a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:19:17.029755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1cf7b045-3cbc-4976-9dc5-a407ab6ce30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:17.039362 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:17.179255 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7b045-3cbc-4976-9dc5-a407ab6ce30a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:19:17.257775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:17.289807 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5095d3-6313-4b12-9b0f-8e4226b579c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:19:17.290399 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5095d3-6313-4b12-9b0f-8e4226b579c9 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:17.290671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5095d3-6313-4b12-9b0f-8e4226b579c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:17.290937 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5095d3-6313-4b12-9b0f-8e4226b579c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:17.292561 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8b5095d3-6313-4b12-9b0f-8e4226b579c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:17.378599 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5095d3-6313-4b12-9b0f-8e4226b579c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:19:17.380325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5095d3-6313-4b12-9b0f-8e4226b579c9 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:19:17.398493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 582/1158] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:19:19.693434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093832a5-14b1-4c86-b719-f9ba0a8535ae None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:19.694018 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093832a5-14b1-4c86-b719-f9ba0a8535ae None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:19.694018 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093832a5-14b1-4c86-b719-f9ba0a8535ae None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:19.695330 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 577/1159] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:19:19.701042 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70a47f-b243-482d-ab74-6e42b2dcd1f6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:19.701483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70a47f-b243-482d-ab74-6e42b2dcd1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:19.701580 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70a47f-b243-482d-ab74-6e42b2dcd1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:19.767492 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ea70a47f-b243-482d-ab74-6e42b2dcd1f6 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:19:19.768717 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ea70a47f-b243-482d-ab74-6e42b2dcd1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:19.814244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:19.864194 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 583/1160] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:19:20.151530 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093832a5-14b1-4c86-b719-f9ba0a8535ae None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:19:20.153119 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-093832a5-14b1-4c86-b719-f9ba0a8535ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:20.177007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:20.255449 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093832a5-14b1-4c86-b719-f9ba0a8535ae None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:19:20.327739 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287c90a-6c8c-4012-8217-9fd088f85d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:19:20.328298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287c90a-6c8c-4012-8217-9fd088f85d81 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:20.328575 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287c90a-6c8c-4012-8217-9fd088f85d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:20.328842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287c90a-6c8c-4012-8217-9fd088f85d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:20.330420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5287c90a-6c8c-4012-8217-9fd088f85d81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:20.404382 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:20.438263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287c90a-6c8c-4012-8217-9fd088f85d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:19:20.439684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287c90a-6c8c-4012-8217-9fd088f85d81 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:19:20.457452 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 578/1161] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:19:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:19:22.637404 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6039b7-f9af-4f41-997e-bf15d8b29128 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:22.637981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6039b7-f9af-4f41-997e-bf15d8b29128 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:22.637981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6039b7-f9af-4f41-997e-bf15d8b29128 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:22.639296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 584/1162] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:19:22.644625 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd77ece-d0fa-44e3-be79-b6bdc83c6f41 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:22.645030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd77ece-d0fa-44e3-be79-b6bdc83c6f41 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:22.645169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd77ece-d0fa-44e3-be79-b6bdc83c6f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:22.709996 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0cd77ece-d0fa-44e3-be79-b6bdc83c6f41 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:19:22.711198 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0cd77ece-d0fa-44e3-be79-b6bdc83c6f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:22.806709 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 579/1163] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:19:23.093779 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6039b7-f9af-4f41-997e-bf15d8b29128 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:19:23.095313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ff6039b7-f9af-4f41-997e-bf15d8b29128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:23.196838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6039b7-f9af-4f41-997e-bf15d8b29128 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:19:23.268386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:23.270083 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225e67d-c27f-4df8-a553-a0a86bb0bcb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:19:23.270840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225e67d-c27f-4df8-a553-a0a86bb0bcb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:23.271306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225e67d-c27f-4df8-a553-a0a86bb0bcb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:23.271802 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225e67d-c27f-4df8-a553-a0a86bb0bcb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:23.273668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1225e67d-c27f-4df8-a553-a0a86bb0bcb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:23.379667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225e67d-c27f-4df8-a553-a0a86bb0bcb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:19:23.381135 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225e67d-c27f-4df8-a553-a0a86bb0bcb9 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:19:23.398606 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 585/1164] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:19:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:19:25.630372 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae3c20-e7d3-45e6-8b71-292cbb32732e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:25.630951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae3c20-e7d3-45e6-8b71-292cbb32732e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:25.630951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae3c20-e7d3-45e6-8b71-292cbb32732e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:25.632336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 580/1165] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:19:25.638449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6d49b-eafc-4c95-921e-c3aa441f211a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:25.638879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6d49b-eafc-4c95-921e-c3aa441f211a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:25.639027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6d49b-eafc-4c95-921e-c3aa441f211a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:25.704172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-80e6d49b-eafc-4c95-921e-c3aa441f211a None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:19:25.705381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-80e6d49b-eafc-4c95-921e-c3aa441f211a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:25.757029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:25.800842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 586/1166] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:19:26.093910 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae3c20-e7d3-45e6-8b71-292cbb32732e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:19:26.095523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9dae3c20-e7d3-45e6-8b71-292cbb32732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:26.131213 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:26.199777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae3c20-e7d3-45e6-8b71-292cbb32732e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:19:26.273143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d9ff3-7d11-43b3-a84f-0e3009bce8f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:19:26.273748 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d9ff3-7d11-43b3-a84f-0e3009bce8f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:26.274029 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d9ff3-7d11-43b3-a84f-0e3009bce8f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:26.274303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d9ff3-7d11-43b3-a84f-0e3009bce8f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:26.275897 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d71d9ff3-7d11-43b3-a84f-0e3009bce8f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:26.355605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:26.387502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d9ff3-7d11-43b3-a84f-0e3009bce8f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:19:26.388970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d9ff3-7d11-43b3-a84f-0e3009bce8f5 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:19:26.407060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 581/1167] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:19:28.693448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd2eab-e628-4e55-aa9b-888059da72d1 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:28.694013 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd2eab-e628-4e55-aa9b-888059da72d1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:28.694013 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd2eab-e628-4e55-aa9b-888059da72d1 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:28.695338 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 587/1168] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 17 10:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:19:28.701072 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4d52c-36db-44e8-9797-e15df56a3bcc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:28.701497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4d52c-36db-44e8-9797-e15df56a3bcc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:28.701640 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4d52c-36db-44e8-9797-e15df56a3bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:28.768699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d7f4d52c-36db-44e8-9797-e15df56a3bcc None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:19:28.769896 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d7f4d52c-36db-44e8-9797-e15df56a3bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:28.865679 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 582/1169] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 17 10:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:19:29.151373 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd2eab-e628-4e55-aa9b-888059da72d1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:19:29.152970 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-06fd2eab-e628-4e55-aa9b-888059da72d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:29.254840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd2eab-e628-4e55-aa9b-888059da72d1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:19:29.328402 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93689b82-fa40-43e3-bf4c-4dfa8ba6d08f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:19:29.328941 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93689b82-fa40-43e3-bf4c-4dfa8ba6d08f service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:19:29.329217 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93689b82-fa40-43e3-bf4c-4dfa8ba6d08f service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:19:29.329487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93689b82-fa40-43e3-bf4c-4dfa8ba6d08f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:19:29.331080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-93689b82-fa40-43e3-bf4c-4dfa8ba6d08f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:19:29.339732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:29.437838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93689b82-fa40-43e3-bf4c-4dfa8ba6d08f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:19:29.439271 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93689b82-fa40-43e3-bf4c-4dfa8ba6d08f service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:19:29.457511 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 588/1170] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:19:38.863871 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=82 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:39.455292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=50 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:20:51.251025 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a91f8-c8fe-457b-9e05-0c3fab1ddf6f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:51.251601 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a91f8-c8fe-457b-9e05-0c3fab1ddf6f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:51.251601 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a91f8-c8fe-457b-9e05-0c3fab1ddf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:51.325898 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-943a91f8-c8fe-457b-9e05-0c3fab1ddf6f None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:20:51.327083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-943a91f8-c8fe-457b-9e05-0c3fab1ddf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:20:51.419385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 583/1171] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:20:51.427362 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b4c7-98e2-48c0-b7cf-c67054706b23 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:51.428405 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b4c7-98e2-48c0-b7cf-c67054706b23 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:51.428559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b4c7-98e2-48c0-b7cf-c67054706b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:51.503280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-24b5b4c7-98e2-48c0-b7cf-c67054706b23 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:20:51.504460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-24b5b4c7-98e2-48c0-b7cf-c67054706b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:20:51.598545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 589/1172] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:20:51.603254 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a91f8-c8fe-457b-9e05-0c3fab1ddf6f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:20:51.604528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-943a91f8-c8fe-457b-9e05-0c3fab1ddf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:20:51.616711 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a91f8-c8fe-457b-9e05-0c3fab1ddf6f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:20:51.678989 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:20:51.712038 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6385f8-9bd5-41bd-a644-03214524c87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:20:51.712636 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6385f8-9bd5-41bd-a644-03214524c87c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:51.712914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6385f8-9bd5-41bd-a644-03214524c87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:51.713186 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6385f8-9bd5-41bd-a644-03214524c87c admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:51.713819 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6385f8-9bd5-41bd-a644-03214524c87c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:20:51.714126 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6385f8-9bd5-41bd-a644-03214524c87c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:20:51.715130 dv-cinder-860209-5-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-7d6385f8-9bd5-41bd-a644-03214524c87c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:20:51.715130 dv-cinder-860209-5-smb devstack@keystone.service[81386]: warnings.warn(msg) Oct 17 10:20:51.715130 dv-cinder-860209-5-smb devstack@keystone.service[81386]: Oct 17 10:20:51.716040 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6385f8-9bd5-41bd-a644-03214524c87c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:20:51.728368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 584/1173] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:20:51.737864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5b4c7-98e2-48c0-b7cf-c67054706b23 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:20:51.747164 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5b4c7-98e2-48c0-b7cf-c67054706b23 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:20:51.807081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:20:51.840475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0af1e-ec08-412f-8b9f-2dd872faf79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:20:51.841078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0af1e-ec08-412f-8b9f-2dd872faf79f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:51.841354 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0af1e-ec08-412f-8b9f-2dd872faf79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:51.841623 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0af1e-ec08-412f-8b9f-2dd872faf79f admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:51.842241 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0af1e-ec08-412f-8b9f-2dd872faf79f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:20:51.843341 dv-cinder-860209-5-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-94d0af1e-ec08-412f-8b9f-2dd872faf79f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:20:51.843341 dv-cinder-860209-5-smb devstack@keystone.service[81385]: warnings.warn(msg) Oct 17 10:20:51.843341 dv-cinder-860209-5-smb devstack@keystone.service[81385]: Oct 17 10:20:51.844633 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0af1e-ec08-412f-8b9f-2dd872faf79f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:20:51.901366 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 590/1174] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:20:51 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:20:51.905677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6385f8-9bd5-41bd-a644-03214524c87c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:20:51.907174 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7d6385f8-9bd5-41bd-a644-03214524c87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:20:51.939098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6385f8-9bd5-41bd-a644-03214524c87c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:20:52.030409 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b4924-f481-4574-93a9-53eeab58c6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:20:52.031000 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b4924-f481-4574-93a9-53eeab58c6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:52.031274 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b4924-f481-4574-93a9-53eeab58c6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:52.031539 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b4924-f481-4574-93a9-53eeab58c6a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:52.032195 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b4924-f481-4574-93a9-53eeab58c6a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:20:52.033187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-979b4924-f481-4574-93a9-53eeab58c6a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:20:52.033187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: warnings.warn(msg) Oct 17 10:20:52.033187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: Oct 17 10:20:52.034371 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b4924-f481-4574-93a9-53eeab58c6a0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:20:52.076371 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 585/1175] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:20:51 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:20:52.080534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0af1e-ec08-412f-8b9f-2dd872faf79f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:20:52.082087 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-94d0af1e-ec08-412f-8b9f-2dd872faf79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:20:52.142757 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0af1e-ec08-412f-8b9f-2dd872faf79f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:20:52.223991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:20:52.234580 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6a4c9-d729-4ba0-a340-05df8ff617a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:20:52.235182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6a4c9-d729-4ba0-a340-05df8ff617a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:52.235464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6a4c9-d729-4ba0-a340-05df8ff617a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:52.235732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6a4c9-d729-4ba0-a340-05df8ff617a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:52.236400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6a4c9-d729-4ba0-a340-05df8ff617a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:20:52.237993 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6a4c9-d729-4ba0-a340-05df8ff617a7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:20:52.250723 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 591/1176] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:20:52.254715 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b4924-f481-4574-93a9-53eeab58c6a0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:20:52.256283 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-979b4924-f481-4574-93a9-53eeab58c6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:20:52.268426 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b4924-f481-4574-93a9-53eeab58c6a0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:20:52.292661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:20:52.361946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e1f9b-f894-4f31-9b99-2bf673abb64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:20:52.362483 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e1f9b-f894-4f31-9b99-2bf673abb64c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:52.362780 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e1f9b-f894-4f31-9b99-2bf673abb64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:52.363046 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e1f9b-f894-4f31-9b99-2bf673abb64c admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:52.363998 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e1f9b-f894-4f31-9b99-2bf673abb64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:20:52.366070 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e1f9b-f894-4f31-9b99-2bf673abb64c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:20:52.378078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 586/1177] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:20:52.383006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6a4c9-d729-4ba0-a340-05df8ff617a7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:20:52.384570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cea6a4c9-d729-4ba0-a340-05df8ff617a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:20:52.417326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6a4c9-d729-4ba0-a340-05df8ff617a7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:20:52.509785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa688430-369e-4733-8a99-4173c539d34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:20:52.510466 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa688430-369e-4733-8a99-4173c539d34f admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:52.510704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa688430-369e-4733-8a99-4173c539d34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:52.510973 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa688430-369e-4733-8a99-4173c539d34f admin admin] PATH_INFO: `/v3/projects/75f91089a0124d3b9aaf00cc6f5e8a30/users/6fdcec54968e4229b40c2628bc23436a/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:52.533034 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa688430-369e-4733-8a99-4173c539d34f admin admin] RBAC: Authorizing `identity:create_grant(project_id=75f91089a0124d3b9aaf00cc6f5e8a30, user_id=6fdcec54968e4229b40c2628bc23436a, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:20:52.535673 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa688430-369e-4733-8a99-4173c539d34f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:20:52.560614 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 592/1178] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:20:52 2022] PUT /identity/v3/projects/75f91089a0124d3b9aaf00cc6f5e8a30/users/6fdcec54968e4229b40c2628bc23436a/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:20:52.571526 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ca4d6-61b0-43b2-b919-fab3088c5999 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:52.571814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ca4d6-61b0-43b2-b919-fab3088c5999 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:52.572119 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ca4d6-61b0-43b2-b919-fab3088c5999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:52.628249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-790ca4d6-61b0-43b2-b919-fab3088c5999 None None] MFA Rules not processed for user `6fdcec54968e4229b40c2628bc23436a`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:20:52.629545 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-790ca4d6-61b0-43b2-b919-fab3088c5999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:20:52.706364 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 587/1179] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:20:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:20:52.719482 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8132a-eb3c-4c06-a519-05e5a5a435f2 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:52.719771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8132a-eb3c-4c06-a519-05e5a5a435f2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:52.720080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8132a-eb3c-4c06-a519-05e5a5a435f2 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:52.721432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 593/1180] 10.222.0.13 () {54 vars in 963 bytes} [Mon Oct 17 10:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:20:52.726741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fad3d-1c38-4d5b-aa3b-5ffa25596d9e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:52.727024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fad3d-1c38-4d5b-aa3b-5ffa25596d9e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:52.727327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fad3d-1c38-4d5b-aa3b-5ffa25596d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:52.758847 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:20:52.802130 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f81fad3d-1c38-4d5b-aa3b-5ffa25596d9e None None] MFA Rules not processed for user `6099c38837b44101a17470322916c82e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:20:52.803323 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f81fad3d-1c38-4d5b-aa3b-5ffa25596d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:20:52.877040 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 588/1181] 10.222.0.13 () {58 vars in 1060 bytes} [Mon Oct 17 10:20:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:20:52.885369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8132a-eb3c-4c06-a519-05e5a5a435f2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:20:52.886822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d7e8132a-eb3c-4c06-a519-05e5a5a435f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:20:52.935997 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:20:52.988938 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8132a-eb3c-4c06-a519-05e5a5a435f2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:20:53.065482 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abdd72-625a-49f8-a680-913e6c3b9d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:20:53.066087 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abdd72-625a-49f8-a680-913e6c3b9d34 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:53.066365 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abdd72-625a-49f8-a680-913e6c3b9d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:53.066633 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abdd72-625a-49f8-a680-913e6c3b9d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:53.068258 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-69abdd72-625a-49f8-a680-913e6c3b9d34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:20:53.164299 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abdd72-625a-49f8-a680-913e6c3b9d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:20:53.165657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abdd72-625a-49f8-a680-913e6c3b9d34 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:20:53.169045 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:20:53.183990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 594/1182] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:20:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:20:53.230190 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd10af-664c-4602-a876-f3de3b207017 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:53.230506 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd10af-664c-4602-a876-f3de3b207017 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:53.230784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd10af-664c-4602-a876-f3de3b207017 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:53.232078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 589/1183] 10.222.0.13 () {52 vars in 830 bytes} [Mon Oct 17 10:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:20:53.235614 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abdd72-625a-49f8-a680-913e6c3b9d34 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:20:53.236837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-69abdd72-625a-49f8-a680-913e6c3b9d34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:20:53.333352 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abdd72-625a-49f8-a680-913e6c3b9d34 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:20:53.424330 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589a557-bfb8-4e9b-993d-70b27bdb02eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:20:53.424881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589a557-bfb8-4e9b-993d-70b27bdb02eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:53.425154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589a557-bfb8-4e9b-993d-70b27bdb02eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:53.425419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589a557-bfb8-4e9b-993d-70b27bdb02eb admin admin] PATH_INFO: `/v3/users/6fdcec54968e4229b40c2628bc23436a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:53.438045 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589a557-bfb8-4e9b-993d-70b27bdb02eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fdcec54968e4229b40c2628bc23436a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:20:53.439101 dv-cinder-860209-5-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-8589a557-bfb8-4e9b-993d-70b27bdb02eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:20:53.439101 dv-cinder-860209-5-smb devstack@keystone.service[81385]: warnings.warn(msg) Oct 17 10:20:53.439101 dv-cinder-860209-5-smb devstack@keystone.service[81385]: Oct 17 10:20:53.440339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589a557-bfb8-4e9b-993d-70b27bdb02eb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:20:53.450596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:20:53.505764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8589a557-bfb8-4e9b-993d-70b27bdb02eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fdcec54968e4229b40c2628bc23436a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:20:53.506825 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8589a557-bfb8-4e9b-993d-70b27bdb02eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fdcec54968e4229b40c2628bc23436a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:20:53.520318 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8589a557-bfb8-4e9b-993d-70b27bdb02eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fdcec54968e4229b40c2628bc23436a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:20:53.520882 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8589a557-bfb8-4e9b-993d-70b27bdb02eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fdcec54968e4229b40c2628bc23436a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:20:53.530816 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8589a557-bfb8-4e9b-993d-70b27bdb02eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fdcec54968e4229b40c2628bc23436a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:20:53.558769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 595/1184] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:20:53 2022] DELETE /identity/v3/users/6fdcec54968e4229b40c2628bc23436a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:20:53.563303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48174408-f683-4fdb-aa1f-623951494a02 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:53.563769 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48174408-f683-4fdb-aa1f-623951494a02 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:53.563869 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48174408-f683-4fdb-aa1f-623951494a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:53.621443 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-48174408-f683-4fdb-aa1f-623951494a02 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:20:53.622637 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-48174408-f683-4fdb-aa1f-623951494a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:20:53.697619 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:20:53.710662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 590/1185] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:20:53.721241 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589a557-bfb8-4e9b-993d-70b27bdb02eb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:20:53.722491 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8589a557-bfb8-4e9b-993d-70b27bdb02eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:20:53.821548 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589a557-bfb8-4e9b-993d-70b27bdb02eb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:20:53.874461 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:20:53.895220 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83311f77-2ccf-48b1-ab1d-4a9d8e832070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:20:53.895824 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83311f77-2ccf-48b1-ab1d-4a9d8e832070 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:53.896127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83311f77-2ccf-48b1-ab1d-4a9d8e832070 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:53.896689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83311f77-2ccf-48b1-ab1d-4a9d8e832070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:53.897987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-83311f77-2ccf-48b1-ab1d-4a9d8e832070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:20:54.002612 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83311f77-2ccf-48b1-ab1d-4a9d8e832070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:20:54.004001 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83311f77-2ccf-48b1-ab1d-4a9d8e832070 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:20:54.022771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 596/1186] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:20:54.364959 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48174408-f683-4fdb-aa1f-623951494a02 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:20:54.366813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-48174408-f683-4fdb-aa1f-623951494a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:20:54.378282 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48174408-f683-4fdb-aa1f-623951494a02 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:20:54.476779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbde61-3689-4bba-8c4d-f5196c4d1052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:20:54.477403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbde61-3689-4bba-8c4d-f5196c4d1052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:20:54.477683 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbde61-3689-4bba-8c4d-f5196c4d1052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:20:54.477959 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbde61-3689-4bba-8c4d-f5196c4d1052 admin admin] PATH_INFO: `/v3/projects/75f91089a0124d3b9aaf00cc6f5e8a30` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:20:54.487691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbde61-3689-4bba-8c4d-f5196c4d1052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75f91089a0124d3b9aaf00cc6f5e8a30)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:20:54.489019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-fcfbde61-3689-4bba-8c4d-f5196c4d1052 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:20:54.489019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: warnings.warn(msg) Oct 17 10:20:54.489019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: Oct 17 10:20:54.490242 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbde61-3689-4bba-8c4d-f5196c4d1052 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:20:54.551347 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fcfbde61-3689-4bba-8c4d-f5196c4d1052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75f91089a0124d3b9aaf00cc6f5e8a30', 'request_id': 'req-fcfbde61-3689-4bba-8c4d-f5196c4d1052'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:20:54.560915 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fcfbde61-3689-4bba-8c4d-f5196c4d1052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75f91089a0124d3b9aaf00cc6f5e8a30', 'request_id': 'req-fcfbde61-3689-4bba-8c4d-f5196c4d1052'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:20:54.574193 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fcfbde61-3689-4bba-8c4d-f5196c4d1052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75f91089a0124d3b9aaf00cc6f5e8a30', 'request_id': 'req-fcfbde61-3689-4bba-8c4d-f5196c4d1052'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:20:54.596314 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fcfbde61-3689-4bba-8c4d-f5196c4d1052 admin admin] The token cache is being invalidate because project 75f91089a0124d3b9aaf00cc6f5e8a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:20:54.596594 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fcfbde61-3689-4bba-8c4d-f5196c4d1052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:20:54.597112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fcfbde61-3689-4bba-8c4d-f5196c4d1052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:20:54.598411 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 591/1187] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:20:54 2022] DELETE /identity/v3/projects/75f91089a0124d3b9aaf00cc6f5e8a30 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:21:04.020396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=62 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:21:04.594328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:22:31.069568 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaeac8d-774d-4439-96de-8997ad9cb55f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:31.070150 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaeac8d-774d-4439-96de-8997ad9cb55f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:31.070150 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaeac8d-774d-4439-96de-8997ad9cb55f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:31.071668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 597/1188] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 10:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:22:31.076890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31aa5f0-dd70-4a7d-aed0-883d647a53b6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:31.077304 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31aa5f0-dd70-4a7d-aed0-883d647a53b6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:31.077480 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31aa5f0-dd70-4a7d-aed0-883d647a53b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:31.159208 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f31aa5f0-dd70-4a7d-aed0-883d647a53b6 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:22:31.160572 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f31aa5f0-dd70-4a7d-aed0-883d647a53b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:22:31.262444 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 592/1189] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 10:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:22:31.416350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaeac8d-774d-4439-96de-8997ad9cb55f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:22:31.418379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-eeaeac8d-774d-4439-96de-8997ad9cb55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:22:31.534349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaeac8d-774d-4439-96de-8997ad9cb55f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:22:31.540331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332e4dc-2182-4c13-976f-840c79c0c5fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:22:31.540930 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332e4dc-2182-4c13-976f-840c79c0c5fd service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:31.541206 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332e4dc-2182-4c13-976f-840c79c0c5fd service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:31.541477 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332e4dc-2182-4c13-976f-840c79c0c5fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:31.549416 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332e4dc-2182-4c13-976f-840c79c0c5fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:22:31.551582 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332e4dc-2182-4c13-976f-840c79c0c5fd service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:22:31.560642 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 598/1190] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:22:32.623299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfa405-1b23-4543-a337-4a78ff99286d None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:32.623874 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfa405-1b23-4543-a337-4a78ff99286d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:32.623874 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfa405-1b23-4543-a337-4a78ff99286d None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:32.625200 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 593/1191] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 10:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:22:32.632001 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510c481-0673-4776-88d3-30ae182fc43e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:32.632452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510c481-0673-4776-88d3-30ae182fc43e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:32.632700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510c481-0673-4776-88d3-30ae182fc43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:32.652199 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2510c481-0673-4776-88d3-30ae182fc43e None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:22:32.653404 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2510c481-0673-4776-88d3-30ae182fc43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:22:32.661237 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 599/1192] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 10:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:22:32.811961 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfa405-1b23-4543-a337-4a78ff99286d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:22:32.826976 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfa405-1b23-4543-a337-4a78ff99286d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:22:32.832367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2755752-7d73-4c59-a5c1-c674b0ee4ed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:22:32.832955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2755752-7d73-4c59-a5c1-c674b0ee4ed4 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:32.833228 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2755752-7d73-4c59-a5c1-c674b0ee4ed4 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:32.833499 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2755752-7d73-4c59-a5c1-c674b0ee4ed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:32.841315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2755752-7d73-4c59-a5c1-c674b0ee4ed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:22:32.842880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2755752-7d73-4c59-a5c1-c674b0ee4ed4 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:22:32.851992 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 594/1193] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:22:33.086305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137dc8d-b483-4537-830f-185bf9447901 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:33.086588 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137dc8d-b483-4537-830f-185bf9447901 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:33.086885 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137dc8d-b483-4537-830f-185bf9447901 None None] PATH_INFO: `/v3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:33.088220 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 600/1194] 10.222.0.40 () {54 vars in 925 bytes} [Mon Oct 17 10:22:33 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:22:33.094651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e8995-e06b-4722-b58a-ce120406ff0f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:33.094943 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e8995-e06b-4722-b58a-ce120406ff0f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:33.095249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e8995-e06b-4722-b58a-ce120406ff0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:33.154854 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-737e8995-e06b-4722-b58a-ce120406ff0f None None] MFA Rules not processed for user `dd52eee25ef347e1ae905cc3cba17284`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:22:33.156408 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-737e8995-e06b-4722-b58a-ce120406ff0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:22:33.173265 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:22:33.228343 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 595/1195] 10.222.0.40 () {58 vars in 1015 bytes} [Mon Oct 17 10:22:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:22:42.070682 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8c061-e4ab-4fce-aef0-8630ae69f98b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:42.071105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8c061-e4ab-4fce-aef0-8630ae69f98b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:42.071230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8c061-e4ab-4fce-aef0-8630ae69f98b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:42.072593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 601/1196] 10.222.0.13 () {54 vars in 961 bytes} [Mon Oct 17 10:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:22:42.077709 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eefe10-ae39-4189-8ff3-5293b85afade None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:42.078147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eefe10-ae39-4189-8ff3-5293b85afade None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:42.078279 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eefe10-ae39-4189-8ff3-5293b85afade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:42.097446 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-46eefe10-ae39-4189-8ff3-5293b85afade None None] MFA Rules not processed for user `dd52eee25ef347e1ae905cc3cba17284`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:22:42.099146 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-46eefe10-ae39-4189-8ff3-5293b85afade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:22:42.107625 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 596/1197] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Oct 17 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:22:42.116170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8c061-e4ab-4fce-aef0-8630ae69f98b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:22:42.129257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8c061-e4ab-4fce-aef0-8630ae69f98b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:22:42.134179 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ca9bd-ff34-41cd-8afc-822d0105c878 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd52eee25ef347e1ae905cc3cba17284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:22:42.134759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca9bd-ff34-41cd-8afc-822d0105c878 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:42.135036 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca9bd-ff34-41cd-8afc-822d0105c878 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:42.135307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca9bd-ff34-41cd-8afc-822d0105c878 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:42.143490 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ca9bd-ff34-41cd-8afc-822d0105c878 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:22:42.145151 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ca9bd-ff34-41cd-8afc-822d0105c878 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:22:42.154919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 602/1198] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:22:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:22:44.246039 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba763ae-fe5e-4324-aba0-eb9ae900607e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:44.246605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba763ae-fe5e-4324-aba0-eb9ae900607e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:44.246605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba763ae-fe5e-4324-aba0-eb9ae900607e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:44.247967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 597/1199] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 10:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:22:44.254078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86068f71-7894-4926-a1d1-d89445b3ca34 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:44.254553 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86068f71-7894-4926-a1d1-d89445b3ca34 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:44.254651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86068f71-7894-4926-a1d1-d89445b3ca34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:44.273650 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-86068f71-7894-4926-a1d1-d89445b3ca34 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:22:44.274829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-86068f71-7894-4926-a1d1-d89445b3ca34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:22:44.282580 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 603/1200] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 10:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:22:44.437124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba763ae-fe5e-4324-aba0-eb9ae900607e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:22:44.451528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba763ae-fe5e-4324-aba0-eb9ae900607e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:22:44.457213 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00975b53-f9b9-4af7-9907-fd988508bbb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:22:44.457801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00975b53-f9b9-4af7-9907-fd988508bbb4 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:44.458076 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00975b53-f9b9-4af7-9907-fd988508bbb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:44.458342 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00975b53-f9b9-4af7-9907-fd988508bbb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:44.466460 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00975b53-f9b9-4af7-9907-fd988508bbb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:22:44.468126 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00975b53-f9b9-4af7-9907-fd988508bbb4 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:22:44.478028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 598/1201] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:22:45.552029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606e028-0297-4518-b6d7-0f36d8506e4a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:45.552599 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606e028-0297-4518-b6d7-0f36d8506e4a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:45.552599 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606e028-0297-4518-b6d7-0f36d8506e4a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:45.553939 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 604/1202] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 10:22:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:22:45.560225 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72f1dc-4202-4514-93a9-0e8809e4c0a1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:45.560688 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72f1dc-4202-4514-93a9-0e8809e4c0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:45.560790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72f1dc-4202-4514-93a9-0e8809e4c0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:45.580306 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2b72f1dc-4202-4514-93a9-0e8809e4c0a1 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:22:45.581493 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2b72f1dc-4202-4514-93a9-0e8809e4c0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:22:45.589319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 599/1203] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 10:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:22:45.741439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606e028-0297-4518-b6d7-0f36d8506e4a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:22:45.756838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606e028-0297-4518-b6d7-0f36d8506e4a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:22:45.762361 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ac64d-17fa-467a-8dbb-36011f3cfe49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:22:45.762956 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ac64d-17fa-467a-8dbb-36011f3cfe49 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:45.763237 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ac64d-17fa-467a-8dbb-36011f3cfe49 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:45.763508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ac64d-17fa-467a-8dbb-36011f3cfe49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:45.771527 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ac64d-17fa-467a-8dbb-36011f3cfe49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:22:45.773129 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ac64d-17fa-467a-8dbb-36011f3cfe49 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:22:45.782222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 605/1204] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:22:49.706979 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdfa81-ca8b-4d18-83cb-48ffbbdff565 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:49.707542 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdfa81-ca8b-4d18-83cb-48ffbbdff565 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:49.707542 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdfa81-ca8b-4d18-83cb-48ffbbdff565 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:49.708926 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 600/1205] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 10:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:22:49.713987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12a67a-58eb-4e81-b9a5-f2cbfc467fe6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:49.714442 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12a67a-58eb-4e81-b9a5-f2cbfc467fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:49.714550 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12a67a-58eb-4e81-b9a5-f2cbfc467fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:49.734054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ad12a67a-58eb-4e81-b9a5-f2cbfc467fe6 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:22:49.735236 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ad12a67a-58eb-4e81-b9a5-f2cbfc467fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:22:49.743905 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 606/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 10:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:22:50.034196 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdfa81-ca8b-4d18-83cb-48ffbbdff565 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:22:50.036462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e6fdfa81-ca8b-4d18-83cb-48ffbbdff565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:22:50.114252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdfa81-ca8b-4d18-83cb-48ffbbdff565 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:22:50.117902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0006b-36bc-4310-bca4-b2dfc55da03f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:22:50.118509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0006b-36bc-4310-bca4-b2dfc55da03f service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:50.118791 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0006b-36bc-4310-bca4-b2dfc55da03f service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:50.119062 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0006b-36bc-4310-bca4-b2dfc55da03f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:50.127815 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0006b-36bc-4310-bca4-b2dfc55da03f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:22:50.129304 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0006b-36bc-4310-bca4-b2dfc55da03f service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:22:50.138592 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 601/1207] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:22:52.279916 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7479102-48df-4f46-8ff2-deb9d55e2768 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:52.280513 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7479102-48df-4f46-8ff2-deb9d55e2768 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:52.280513 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7479102-48df-4f46-8ff2-deb9d55e2768 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:52.281837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 607/1208] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 10:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:22:52.287848 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad3dcc-0189-4a56-afd6-6c3a95094dd5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:52.288301 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad3dcc-0189-4a56-afd6-6c3a95094dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:52.288420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad3dcc-0189-4a56-afd6-6c3a95094dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:52.308260 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fdad3dcc-0189-4a56-afd6-6c3a95094dd5 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:22:52.309446 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fdad3dcc-0189-4a56-afd6-6c3a95094dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:22:52.317225 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 602/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 10:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:22:52.604899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7479102-48df-4f46-8ff2-deb9d55e2768 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:22:52.606585 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f7479102-48df-4f46-8ff2-deb9d55e2768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:22:52.620158 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7479102-48df-4f46-8ff2-deb9d55e2768 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:22:52.623696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04349ca0-96f8-4e7f-b7b1-ce5a70a79a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:22:52.624310 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04349ca0-96f8-4e7f-b7b1-ce5a70a79a77 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:52.624586 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04349ca0-96f8-4e7f-b7b1-ce5a70a79a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:52.624853 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04349ca0-96f8-4e7f-b7b1-ce5a70a79a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:52.633727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04349ca0-96f8-4e7f-b7b1-ce5a70a79a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:22:52.635159 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04349ca0-96f8-4e7f-b7b1-ce5a70a79a77 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:22:52.644891 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 608/1210] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:22:56.267620 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1613f-bd3f-4fac-b393-0551b30016f8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:56.268191 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1613f-bd3f-4fac-b393-0551b30016f8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:56.268191 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1613f-bd3f-4fac-b393-0551b30016f8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:56.269519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 603/1211] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 10:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:22:56.274681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac56e2b-0a9a-46ff-a93e-6ad1df928fe6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:56.275114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac56e2b-0a9a-46ff-a93e-6ad1df928fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:56.275229 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac56e2b-0a9a-46ff-a93e-6ad1df928fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:56.282836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=81 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:22:56.296855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-aac56e2b-0a9a-46ff-a93e-6ad1df928fe6 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:22:56.298047 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-aac56e2b-0a9a-46ff-a93e-6ad1df928fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:22:56.306557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 609/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 10:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:22:56.610420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1613f-bd3f-4fac-b393-0551b30016f8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:22:56.612066 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b7b1613f-bd3f-4fac-b393-0551b30016f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:22:56.677498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:22:56.690771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1613f-bd3f-4fac-b393-0551b30016f8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:22:56.694892 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade02e2-91f9-41a0-a2e5-f009f90745c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:22:56.695490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade02e2-91f9-41a0-a2e5-f009f90745c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:56.695768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade02e2-91f9-41a0-a2e5-f009f90745c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:56.696077 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade02e2-91f9-41a0-a2e5-f009f90745c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:56.704761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade02e2-91f9-41a0-a2e5-f009f90745c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:22:56.706185 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade02e2-91f9-41a0-a2e5-f009f90745c0 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:22:56.715379 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 604/1213] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:22:58.850833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47891d3-b733-435d-b6f4-47718bfd7b88 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:58.851406 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47891d3-b733-435d-b6f4-47718bfd7b88 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:58.851406 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47891d3-b733-435d-b6f4-47718bfd7b88 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:58.852772 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 610/1214] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 10:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:22:58.858016 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8a669-83c0-492b-b0e9-4b413ae7dcd1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:58.858460 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8a669-83c0-492b-b0e9-4b413ae7dcd1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:58.858557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8a669-83c0-492b-b0e9-4b413ae7dcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:58.880143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6ce8a669-83c0-492b-b0e9-4b413ae7dcd1 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:22:58.881423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6ce8a669-83c0-492b-b0e9-4b413ae7dcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:22:58.889457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 605/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 10:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:22:59.191028 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47891d3-b733-435d-b6f4-47718bfd7b88 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:22:59.193422 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d47891d3-b733-435d-b6f4-47718bfd7b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:22:59.206203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47891d3-b733-435d-b6f4-47718bfd7b88 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:22:59.209774 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56411531-4795-4eb0-ab18-e75d47351ce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:22:59.210362 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56411531-4795-4eb0-ab18-e75d47351ce2 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:22:59.210652 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56411531-4795-4eb0-ab18-e75d47351ce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:22:59.210926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56411531-4795-4eb0-ab18-e75d47351ce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:22:59.220511 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56411531-4795-4eb0-ab18-e75d47351ce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:22:59.221980 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56411531-4795-4eb0-ab18-e75d47351ce2 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:22:59.231757 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 611/1216] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:23:08.874326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=11 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:23:09.227922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=8 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:32.820447 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c34ad-ab29-4deb-8161-576ee2d6edb7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:32.822210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c34ad-ab29-4deb-8161-576ee2d6edb7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:32.822210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c34ad-ab29-4deb-8161-576ee2d6edb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:32.846551 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7d1c34ad-ab29-4deb-8161-576ee2d6edb7 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:32.847891 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7d1c34ad-ab29-4deb-8161-576ee2d6edb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:32.860284 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 606/1217] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:32.869973 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c8f4d-652c-48a2-b03b-3dd62a7214f4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:32.870526 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c8f4d-652c-48a2-b03b-3dd62a7214f4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:32.870526 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c8f4d-652c-48a2-b03b-3dd62a7214f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:32.901530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a57c8f4d-652c-48a2-b03b-3dd62a7214f4 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:32.902742 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a57c8f4d-652c-48a2-b03b-3dd62a7214f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:32.918546 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 612/1218] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:32.923375 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c34ad-ab29-4deb-8161-576ee2d6edb7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:32.937869 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c34ad-ab29-4deb-8161-576ee2d6edb7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:32.948627 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d48d58-73be-4238-9e35-2f7811f697cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:32.949344 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d48d58-73be-4238-9e35-2f7811f697cf admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:32.949761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d48d58-73be-4238-9e35-2f7811f697cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:32.950046 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d48d58-73be-4238-9e35-2f7811f697cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:32.950701 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d48d58-73be-4238-9e35-2f7811f697cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:24:32.951264 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d48d58-73be-4238-9e35-2f7811f697cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:32.952736 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d48d58-73be-4238-9e35-2f7811f697cf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:32.972465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 607/1219] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:24:32.981202 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c8f4d-652c-48a2-b03b-3dd62a7214f4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:32.992455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c8f4d-652c-48a2-b03b-3dd62a7214f4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:33.000657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550070d-66be-4b4c-9e1c-a8f7036b9752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:33.001282 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550070d-66be-4b4c-9e1c-a8f7036b9752 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:33.001562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550070d-66be-4b4c-9e1c-a8f7036b9752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:33.001836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550070d-66be-4b4c-9e1c-a8f7036b9752 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:33.002488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550070d-66be-4b4c-9e1c-a8f7036b9752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:33.004431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550070d-66be-4b4c-9e1c-a8f7036b9752 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:33.062336 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 613/1220] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:32 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:33.066808 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d48d58-73be-4238-9e35-2f7811f697cf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:33.080820 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d48d58-73be-4238-9e35-2f7811f697cf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:33.174023 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cbe4b-3000-47c2-9f6d-26ef35b48d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:33.174665 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cbe4b-3000-47c2-9f6d-26ef35b48d4c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:33.174959 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cbe4b-3000-47c2-9f6d-26ef35b48d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:33.175215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cbe4b-3000-47c2-9f6d-26ef35b48d4c admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:33.176046 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cbe4b-3000-47c2-9f6d-26ef35b48d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:33.178814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cbe4b-3000-47c2-9f6d-26ef35b48d4c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:33.208069 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 608/1221] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:33 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:33.212398 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550070d-66be-4b4c-9e1c-a8f7036b9752 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:33.224115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550070d-66be-4b4c-9e1c-a8f7036b9752 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:33.232693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc4dd6-7beb-46c7-9b67-5a2549f123da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:33.233326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc4dd6-7beb-46c7-9b67-5a2549f123da admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:33.233605 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc4dd6-7beb-46c7-9b67-5a2549f123da admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:33.233876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc4dd6-7beb-46c7-9b67-5a2549f123da admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:33.234673 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc4dd6-7beb-46c7-9b67-5a2549f123da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:33.236477 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc4dd6-7beb-46c7-9b67-5a2549f123da admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:33.254956 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 614/1222] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:33.258752 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cbe4b-3000-47c2-9f6d-26ef35b48d4c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:33.271202 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cbe4b-3000-47c2-9f6d-26ef35b48d4c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:33.277235 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738eb4d-f58b-400b-8b95-1bf649c7502d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:33.278085 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738eb4d-f58b-400b-8b95-1bf649c7502d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:33.278371 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738eb4d-f58b-400b-8b95-1bf649c7502d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:33.278647 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738eb4d-f58b-400b-8b95-1bf649c7502d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:33.279299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738eb4d-f58b-400b-8b95-1bf649c7502d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:33.281093 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738eb4d-f58b-400b-8b95-1bf649c7502d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:33.295980 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 609/1223] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:33.300200 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc4dd6-7beb-46c7-9b67-5a2549f123da admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:33.311359 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc4dd6-7beb-46c7-9b67-5a2549f123da admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:33.320367 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91990ef6-58ae-4c93-8f72-675b306b724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:33.321176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91990ef6-58ae-4c93-8f72-675b306b724c admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:33.321464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91990ef6-58ae-4c93-8f72-675b306b724c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:33.321739 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91990ef6-58ae-4c93-8f72-675b306b724c admin admin] PATH_INFO: `/v3/projects/acb50eedf34b4fd69f28420746e82184/users/99383ed742b943ecb45b0b86ceae051e/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:33.343073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91990ef6-58ae-4c93-8f72-675b306b724c admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb50eedf34b4fd69f28420746e82184, user_id=99383ed742b943ecb45b0b86ceae051e, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:33.345722 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91990ef6-58ae-4c93-8f72-675b306b724c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:33.365285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 615/1224] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:33 2022] PUT /identity/v3/projects/acb50eedf34b4fd69f28420746e82184/users/99383ed742b943ecb45b0b86ceae051e/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:33.379122 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a87533-b92c-4bae-a5d9-c80ca8112def None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:33.379485 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a87533-b92c-4bae-a5d9-c80ca8112def None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:33.379829 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a87533-b92c-4bae-a5d9-c80ca8112def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:33.420266 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-28a87533-b92c-4bae-a5d9-c80ca8112def None None] MFA Rules not processed for user `99383ed742b943ecb45b0b86ceae051e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:33.421536 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-28a87533-b92c-4bae-a5d9-c80ca8112def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:33.509364 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 610/1225] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:33.541383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a064223-6ee9-424a-845f-0049169e4c68 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:33.541708 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a064223-6ee9-424a-845f-0049169e4c68 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:33.541926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a064223-6ee9-424a-845f-0049169e4c68 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:33.543316 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 616/1226] 10.222.0.13 () {54 vars in 961 bytes} [Mon Oct 17 10:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:24:33.563359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d7f7d-fb45-47b2-ad14-540c91680df9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:33.563680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d7f7d-fb45-47b2-ad14-540c91680df9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:33.564121 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d7f7d-fb45-47b2-ad14-540c91680df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:33.637415 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ef2d7f7d-fb45-47b2-ad14-540c91680df9 None None] MFA Rules not processed for user `a80cc7ec3d2d49f88c81403f918a6900`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:33.638483 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ef2d7f7d-fb45-47b2-ad14-540c91680df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:33.638774 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03755-64e4-4701-97db-c13ad190e5f4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:33.639067 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03755-64e4-4701-97db-c13ad190e5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:33.639343 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03755-64e4-4701-97db-c13ad190e5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:33.677187 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9ed03755-64e4-4701-97db-c13ad190e5f4 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:33.678399 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9ed03755-64e4-4701-97db-c13ad190e5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:33.742788 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:33.850103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 611/1227] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Oct 17 10:24:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:33.856015 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834d382-8006-448b-8155-4e62eb44c6c4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:33.856303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834d382-8006-448b-8155-4e62eb44c6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:33.856578 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834d382-8006-448b-8155-4e62eb44c6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:33.870213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 617/1228] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:24:33.870995 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed03755-64e4-4701-97db-c13ad190e5f4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:33.901289 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed03755-64e4-4701-97db-c13ad190e5f4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:33.912056 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a834d382-8006-448b-8155-4e62eb44c6c4 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:33.912056 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a834d382-8006-448b-8155-4e62eb44c6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:33.928041 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e847ba-0283-44ee-be82-9193d0f7bc10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:33.928041 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e847ba-0283-44ee-be82-9193d0f7bc10 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:33.928041 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e847ba-0283-44ee-be82-9193d0f7bc10 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:33.928041 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e847ba-0283-44ee-be82-9193d0f7bc10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:33.944353 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 612/1229] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:33.945465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21048a4c-224c-4b33-a111-b0f4d489ce6f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:33.945746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21048a4c-224c-4b33-a111-b0f4d489ce6f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:33.946018 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21048a4c-224c-4b33-a111-b0f4d489ce6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:33.951203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e847ba-0283-44ee-be82-9193d0f7bc10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:33.952354 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e847ba-0283-44ee-be82-9193d0f7bc10 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:33.973099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 618/1230] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:33.975526 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5eb95-b738-4539-a911-a86dea53a424 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:33.975820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5eb95-b738-4539-a911-a86dea53a424 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:33.976144 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5eb95-b738-4539-a911-a86dea53a424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:33.978396 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-21048a4c-224c-4b33-a111-b0f4d489ce6f None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:33.980107 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-21048a4c-224c-4b33-a111-b0f4d489ce6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:33.997920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 613/1231] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:34.005583 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f15bf-3988-4da4-a1eb-bc99e68e2c1a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.005890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f15bf-3988-4da4-a1eb-bc99e68e2c1a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.006135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f15bf-3988-4da4-a1eb-bc99e68e2c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.029307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-63f5eb95-b738-4539-a911-a86dea53a424 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:34.030889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-63f5eb95-b738-4539-a911-a86dea53a424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:34.036763 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e38f15bf-3988-4da4-a1eb-bc99e68e2c1a None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:34.037933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e38f15bf-3988-4da4-a1eb-bc99e68e2c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:34.039896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 619/1232] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:34.041126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176f7d3-95a0-4ead-88f6-fbc39b169fd5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.041411 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176f7d3-95a0-4ead-88f6-fbc39b169fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.041685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176f7d3-95a0-4ead-88f6-fbc39b169fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.053808 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 614/1233] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:34.056702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32a3f5-4ce4-48d4-8e25-944cab643f47 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.057216 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32a3f5-4ce4-48d4-8e25-944cab643f47 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.057697 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32a3f5-4ce4-48d4-8e25-944cab643f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.075258 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1176f7d3-95a0-4ead-88f6-fbc39b169fd5 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:34.076660 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1176f7d3-95a0-4ead-88f6-fbc39b169fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:34.079916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2c32a3f5-4ce4-48d4-8e25-944cab643f47 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:34.081097 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2c32a3f5-4ce4-48d4-8e25-944cab643f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:34.085485 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 620/1234] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:34.088975 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176f7d3-95a0-4ead-88f6-fbc39b169fd5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.090074 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 615/1235] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:34.091330 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aef7b2-6b07-43b5-91da-fc57b37f2c3d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.091610 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aef7b2-6b07-43b5-91da-fc57b37f2c3d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.091886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aef7b2-6b07-43b5-91da-fc57b37f2c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.103611 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176f7d3-95a0-4ead-88f6-fbc39b169fd5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.109077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f950e1b-33c3-4818-bef1-cc7e03b0f5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.109690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f950e1b-33c3-4818-bef1-cc7e03b0f5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.109967 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f950e1b-33c3-4818-bef1-cc7e03b0f5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.110240 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f950e1b-33c3-4818-bef1-cc7e03b0f5b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.110995 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f950e1b-33c3-4818-bef1-cc7e03b0f5b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:24:34.111300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f950e1b-33c3-4818-bef1-cc7e03b0f5b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.111778 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-99aef7b2-6b07-43b5-91da-fc57b37f2c3d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:34.112347 dv-cinder-860209-5-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-3f950e1b-33c3-4818-bef1-cc7e03b0f5b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:24:34.112347 dv-cinder-860209-5-smb devstack@keystone.service[81385]: warnings.warn(msg) Oct 17 10:24:34.112347 dv-cinder-860209-5-smb devstack@keystone.service[81385]: Oct 17 10:24:34.113017 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-99aef7b2-6b07-43b5-91da-fc57b37f2c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:34.113232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f950e1b-33c3-4818-bef1-cc7e03b0f5b2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.124462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 616/1236] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:34.124462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2557-885e-41f5-b50c-c76546704c7b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.124462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2557-885e-41f5-b50c-c76546704c7b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.124462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2557-885e-41f5-b50c-c76546704c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.128169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 621/1237] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:24:34.129655 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc23cf6-d83b-4248-af4b-72a827d0444b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.130609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc23cf6-d83b-4248-af4b-72a827d0444b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.131086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc23cf6-d83b-4248-af4b-72a827d0444b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.153088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-69fc2557-885e-41f5-b50c-c76546704c7b None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:34.153267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-acc23cf6-d83b-4248-af4b-72a827d0444b None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:34.154200 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-acc23cf6-d83b-4248-af4b-72a827d0444b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:34.154344 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-69fc2557-885e-41f5-b50c-c76546704c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:34.162213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 622/1238] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:34.163277 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 617/1239] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:34.164009 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc2557-885e-41f5-b50c-c76546704c7b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.173721 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa7711-6df2-499e-9bdc-aee5d51136a9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.173925 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc2557-885e-41f5-b50c-c76546704c7b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.174440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa7711-6df2-499e-9bdc-aee5d51136a9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.175397 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa7711-6df2-499e-9bdc-aee5d51136a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.179460 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea28b18-313b-44ec-8136-845857496a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.180098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea28b18-313b-44ec-8136-845857496a47 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.180378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea28b18-313b-44ec-8136-845857496a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.180648 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea28b18-313b-44ec-8136-845857496a47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.181288 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea28b18-313b-44ec-8136-845857496a47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:24:34.181590 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea28b18-313b-44ec-8136-845857496a47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.183179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea28b18-313b-44ec-8136-845857496a47 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.201149 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 618/1240] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:24:34.201149 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f1ef-2c85-41e4-b97f-1b9fbf055da3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.201149 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f1ef-2c85-41e4-b97f-1b9fbf055da3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.201149 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f1ef-2c85-41e4-b97f-1b9fbf055da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.202481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-02aa7711-6df2-499e-9bdc-aee5d51136a9 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:34.204277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-02aa7711-6df2-499e-9bdc-aee5d51136a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:34.212458 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 623/1241] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:34.213640 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161c6a3-e9f6-476c-b5b1-493a37389915 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.213928 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161c6a3-e9f6-476c-b5b1-493a37389915 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.214207 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161c6a3-e9f6-476c-b5b1-493a37389915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.225534 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9dd7f1ef-2c85-41e4-b97f-1b9fbf055da3 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:34.226970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9dd7f1ef-2c85-41e4-b97f-1b9fbf055da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:34.233403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b161c6a3-e9f6-476c-b5b1-493a37389915 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:34.234556 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b161c6a3-e9f6-476c-b5b1-493a37389915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:34.236087 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 619/1242] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:34.237647 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7f1ef-2c85-41e4-b97f-1b9fbf055da3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.243492 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 624/1243] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:34.244462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161c6a3-e9f6-476c-b5b1-493a37389915 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.251410 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7f1ef-2c85-41e4-b97f-1b9fbf055da3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.255421 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161c6a3-e9f6-476c-b5b1-493a37389915 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.256463 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a49b0b-4c17-4b5a-b235-07f241dafb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.257058 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a49b0b-4c17-4b5a-b235-07f241dafb3f admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.257336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a49b0b-4c17-4b5a-b235-07f241dafb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.257603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a49b0b-4c17-4b5a-b235-07f241dafb3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.258231 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a49b0b-4c17-4b5a-b235-07f241dafb3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.259259 dv-cinder-860209-5-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-29a49b0b-4c17-4b5a-b235-07f241dafb3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:24:34.259259 dv-cinder-860209-5-smb devstack@keystone.service[81386]: warnings.warn(msg) Oct 17 10:24:34.259259 dv-cinder-860209-5-smb devstack@keystone.service[81386]: Oct 17 10:24:34.260152 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941adb71-feba-4c43-8f79-ae2cafa93fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.260464 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a49b0b-4c17-4b5a-b235-07f241dafb3f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.260734 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941adb71-feba-4c43-8f79-ae2cafa93fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.261015 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941adb71-feba-4c43-8f79-ae2cafa93fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.261290 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941adb71-feba-4c43-8f79-ae2cafa93fd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.261932 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941adb71-feba-4c43-8f79-ae2cafa93fd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:24:34.262235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941adb71-feba-4c43-8f79-ae2cafa93fd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.263825 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941adb71-feba-4c43-8f79-ae2cafa93fd9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.275081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 625/1244] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:24:34.275081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc6a2a-e85f-4c18-a255-0023ea2eccea None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.275081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc6a2a-e85f-4c18-a255-0023ea2eccea None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.275081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc6a2a-e85f-4c18-a255-0023ea2eccea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.295978 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 620/1245] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:34.296713 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a49b0b-4c17-4b5a-b235-07f241dafb3f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.299601 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-90fc6a2a-e85f-4c18-a255-0023ea2eccea None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:34.300827 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-90fc6a2a-e85f-4c18-a255-0023ea2eccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:34.311540 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:34.363481 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a49b0b-4c17-4b5a-b235-07f241dafb3f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.371354 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 626/1246] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:34.371354 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc6a2a-e85f-4c18-a255-0023ea2eccea None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.372997 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da701b3-c200-47c2-a3c1-72d02c94e1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.373678 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da701b3-c200-47c2-a3c1-72d02c94e1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.374077 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da701b3-c200-47c2-a3c1-72d02c94e1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.374412 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da701b3-c200-47c2-a3c1-72d02c94e1f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.375142 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da701b3-c200-47c2-a3c1-72d02c94e1f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.377356 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da701b3-c200-47c2-a3c1-72d02c94e1f2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.382089 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc6a2a-e85f-4c18-a255-0023ea2eccea None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.387422 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb87f7f-4542-472e-a3ec-4eea069c84ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.387856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb87f7f-4542-472e-a3ec-4eea069c84ff admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.388168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb87f7f-4542-472e-a3ec-4eea069c84ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.388440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb87f7f-4542-472e-a3ec-4eea069c84ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.389368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb87f7f-4542-472e-a3ec-4eea069c84ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:24:34.389528 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb87f7f-4542-472e-a3ec-4eea069c84ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.391251 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb87f7f-4542-472e-a3ec-4eea069c84ff admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.404727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 627/1247] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:24:34.408372 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 621/1248] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:34.408500 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250e38a-aad1-4084-8869-3869e924539c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.408581 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da701b3-c200-47c2-a3c1-72d02c94e1f2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.408676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250e38a-aad1-4084-8869-3869e924539c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.408676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250e38a-aad1-4084-8869-3869e924539c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.408676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 628/1249] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 17 10:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:24:34.408676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250e38a-aad1-4084-8869-3869e924539c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.452417 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:34.484785 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da701b3-c200-47c2-a3c1-72d02c94e1f2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.485298 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250e38a-aad1-4084-8869-3869e924539c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.489673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45db0e-caf9-4a84-bf41-a055ba0a7109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.490118 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0d640-8ec6-4aee-876c-c5e4ec1f6e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.490257 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45db0e-caf9-4a84-bf41-a055ba0a7109 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.490540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45db0e-caf9-4a84-bf41-a055ba0a7109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.490739 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0d640-8ec6-4aee-876c-c5e4ec1f6e47 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.490860 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45db0e-caf9-4a84-bf41-a055ba0a7109 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.491008 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0d640-8ec6-4aee-876c-c5e4ec1f6e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.491278 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0d640-8ec6-4aee-876c-c5e4ec1f6e47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.491437 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45db0e-caf9-4a84-bf41-a055ba0a7109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:24:34.491741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45db0e-caf9-4a84-bf41-a055ba0a7109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.492079 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0d640-8ec6-4aee-876c-c5e4ec1f6e47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:24:34.492381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0d640-8ec6-4aee-876c-c5e4ec1f6e47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.493362 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45db0e-caf9-4a84-bf41-a055ba0a7109 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.493973 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0d640-8ec6-4aee-876c-c5e4ec1f6e47 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.505127 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 622/1250] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:24:34.505914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45db0e-caf9-4a84-bf41-a055ba0a7109 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.513327 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 629/1251] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:24:34.513327 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0d640-8ec6-4aee-876c-c5e4ec1f6e47 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.521039 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0d640-8ec6-4aee-876c-c5e4ec1f6e47 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.521226 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45db0e-caf9-4a84-bf41-a055ba0a7109 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.527354 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf125c-ef1c-42f8-84b1-f9aba9041cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.527991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf125c-ef1c-42f8-84b1-f9aba9041cba admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.528421 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf125c-ef1c-42f8-84b1-f9aba9041cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.528523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f62c82-9521-4db5-ba5f-0bbdd0fd9d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.528697 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf125c-ef1c-42f8-84b1-f9aba9041cba admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.529045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f62c82-9521-4db5-ba5f-0bbdd0fd9d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.529329 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf125c-ef1c-42f8-84b1-f9aba9041cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.529436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f62c82-9521-4db5-ba5f-0bbdd0fd9d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.529603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f62c82-9521-4db5-ba5f-0bbdd0fd9d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.530240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f62c82-9521-4db5-ba5f-0bbdd0fd9d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.530350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-0acf125c-ef1c-42f8-84b1-f9aba9041cba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:24:34.530350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: warnings.warn(msg) Oct 17 10:24:34.530350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: Oct 17 10:24:34.531552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf125c-ef1c-42f8-84b1-f9aba9041cba admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.532164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f62c82-9521-4db5-ba5f-0bbdd0fd9d99 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.555183 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 630/1252] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/users => generated 282 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:34.556251 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf125c-ef1c-42f8-84b1-f9aba9041cba admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.565098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 623/1253] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:34.565098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f62c82-9521-4db5-ba5f-0bbdd0fd9d99 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.565944 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf125c-ef1c-42f8-84b1-f9aba9041cba admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.622723 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d8387-eb99-4a98-87b9-ecf1848f7826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.623331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d8387-eb99-4a98-87b9-ecf1848f7826 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.623716 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d8387-eb99-4a98-87b9-ecf1848f7826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.623887 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d8387-eb99-4a98-87b9-ecf1848f7826 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.624574 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d8387-eb99-4a98-87b9-ecf1848f7826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:24:34.624876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d8387-eb99-4a98-87b9-ecf1848f7826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.625046 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f62c82-9521-4db5-ba5f-0bbdd0fd9d99 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.626491 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d8387-eb99-4a98-87b9-ecf1848f7826 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.629972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3404c3e-2845-42c2-b06e-fd409ae293ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.630599 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3404c3e-2845-42c2-b06e-fd409ae293ec admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.630979 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3404c3e-2845-42c2-b06e-fd409ae293ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.631347 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3404c3e-2845-42c2-b06e-fd409ae293ec admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.632010 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3404c3e-2845-42c2-b06e-fd409ae293ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.633961 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3404c3e-2845-42c2-b06e-fd409ae293ec admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.638372 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 631/1254] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:24:34.639290 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d8387-eb99-4a98-87b9-ecf1848f7826 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.648982 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d8387-eb99-4a98-87b9-ecf1848f7826 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.654131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9d943-8f53-4c11-9251-9d15a2848cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.654817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9d943-8f53-4c11-9251-9d15a2848cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.655041 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9d943-8f53-4c11-9251-9d15a2848cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.655311 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9d943-8f53-4c11-9251-9d15a2848cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.655961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9d943-8f53-4c11-9251-9d15a2848cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.657943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9d943-8f53-4c11-9251-9d15a2848cb6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.659691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 624/1255] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:34.661528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61e01d-e6f4-4406-a5c8-c6c2290373b2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.661807 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61e01d-e6f4-4406-a5c8-c6c2290373b2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.662078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61e01d-e6f4-4406-a5c8-c6c2290373b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.670450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:34.682707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9a61e01d-e6f4-4406-a5c8-c6c2290373b2 None None] MFA Rules not processed for user `a80cc7ec3d2d49f88c81403f918a6900`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:34.684086 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9a61e01d-e6f4-4406-a5c8-c6c2290373b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:34.692987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 632/1256] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:34.693869 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9d943-8f53-4c11-9251-9d15a2848cb6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.752704 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 625/1257] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:34.753603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61e01d-e6f4-4406-a5c8-c6c2290373b2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.758193 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9d943-8f53-4c11-9251-9d15a2848cb6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.763175 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31207d99-60c7-4e4f-8d6e-0ca959d79336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.763788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31207d99-60c7-4e4f-8d6e-0ca959d79336 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.764112 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31207d99-60c7-4e4f-8d6e-0ca959d79336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.764245 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61e01d-e6f4-4406-a5c8-c6c2290373b2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.764383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31207d99-60c7-4e4f-8d6e-0ca959d79336 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.765020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31207d99-60c7-4e4f-8d6e-0ca959d79336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.766924 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31207d99-60c7-4e4f-8d6e-0ca959d79336 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.768870 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f4cbd-1dae-4778-86c0-e3274bf599b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.769462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f4cbd-1dae-4778-86c0-e3274bf599b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.769798 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f4cbd-1dae-4778-86c0-e3274bf599b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.770009 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f4cbd-1dae-4778-86c0-e3274bf599b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.770835 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f4cbd-1dae-4778-86c0-e3274bf599b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.772765 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f4cbd-1dae-4778-86c0-e3274bf599b1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.795320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 633/1258] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:34.796414 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31207d99-60c7-4e4f-8d6e-0ca959d79336 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.799400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 626/1259] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:34.800326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f4cbd-1dae-4778-86c0-e3274bf599b1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.806291 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:34.861016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31207d99-60c7-4e4f-8d6e-0ca959d79336 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.865810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f4cbd-1dae-4778-86c0-e3274bf599b1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.866419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19269c80-c3a7-4cfa-9447-9bc60d533b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.867137 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19269c80-c3a7-4cfa-9447-9bc60d533b9f admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.867422 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19269c80-c3a7-4cfa-9447-9bc60d533b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.867695 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19269c80-c3a7-4cfa-9447-9bc60d533b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.868373 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19269c80-c3a7-4cfa-9447-9bc60d533b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.869985 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19269c80-c3a7-4cfa-9447-9bc60d533b9f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.870464 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e50d5b-f7a1-4927-8c09-34d0160aeddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.871067 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e50d5b-f7a1-4927-8c09-34d0160aeddc admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.871345 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e50d5b-f7a1-4927-8c09-34d0160aeddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.871614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e50d5b-f7a1-4927-8c09-34d0160aeddc admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.872273 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e50d5b-f7a1-4927-8c09-34d0160aeddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.874166 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e50d5b-f7a1-4927-8c09-34d0160aeddc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.880661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 634/1260] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:34.881503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19269c80-c3a7-4cfa-9447-9bc60d533b9f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.891714 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19269c80-c3a7-4cfa-9447-9bc60d533b9f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.899464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472cb5c-7828-4733-a510-03b1b30c6d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.899657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 627/1261] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:34.899761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472cb5c-7828-4733-a510-03b1b30c6d38 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.899851 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e50d5b-f7a1-4927-8c09-34d0160aeddc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.899977 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472cb5c-7828-4733-a510-03b1b30c6d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.899977 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472cb5c-7828-4733-a510-03b1b30c6d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.899977 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472cb5c-7828-4733-a510-03b1b30c6d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.900328 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472cb5c-7828-4733-a510-03b1b30c6d38 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.907023 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e50d5b-f7a1-4927-8c09-34d0160aeddc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.911634 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a0d29-16be-4118-94fb-f497e1120258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.912242 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a0d29-16be-4118-94fb-f497e1120258 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.912516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a0d29-16be-4118-94fb-f497e1120258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.912782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a0d29-16be-4118-94fb-f497e1120258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.913411 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a0d29-16be-4118-94fb-f497e1120258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:34.914977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a0d29-16be-4118-94fb-f497e1120258 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:34.926319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 628/1262] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:34.927604 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a0d29-16be-4118-94fb-f497e1120258 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.930300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 635/1263] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:34.931132 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472cb5c-7828-4733-a510-03b1b30c6d38 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:34.937889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a0d29-16be-4118-94fb-f497e1120258 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.986762 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472cb5c-7828-4733-a510-03b1b30c6d38 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:34.991054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf62daa-3ea6-47af-9a62-e86436718dcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.991766 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf62daa-3ea6-47af-9a62-e86436718dcd service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.992171 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf62daa-3ea6-47af-9a62-e86436718dcd service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.992551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf62daa-3ea6-47af-9a62-e86436718dcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.996293 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a3c6a-cca3-4fd9-a9cb-350ec686aad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:34.996730 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:34.996905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a3c6a-cca3-4fd9-a9cb-350ec686aad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:34.997189 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a3c6a-cca3-4fd9-a9cb-350ec686aad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:34.997458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a3c6a-cca3-4fd9-a9cb-350ec686aad4 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:34.998118 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a3c6a-cca3-4fd9-a9cb-350ec686aad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.000066 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a3c6a-cca3-4fd9-a9cb-350ec686aad4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.021530 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 629/1264] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:34 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:35.022455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a3c6a-cca3-4fd9-a9cb-350ec686aad4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.032227 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a3c6a-cca3-4fd9-a9cb-350ec686aad4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.037094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d181bfc-1c1e-4e04-8c74-1464cc30eab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.037690 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d181bfc-1c1e-4e04-8c74-1464cc30eab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.037972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d181bfc-1c1e-4e04-8c74-1464cc30eab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.038248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d181bfc-1c1e-4e04-8c74-1464cc30eab7 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.038874 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d181bfc-1c1e-4e04-8c74-1464cc30eab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.040863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d181bfc-1c1e-4e04-8c74-1464cc30eab7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.062795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 630/1265] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:35 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:35.064928 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d181bfc-1c1e-4e04-8c74-1464cc30eab7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.067820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf62daa-3ea6-47af-9a62-e86436718dcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.069371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf62daa-3ea6-47af-9a62-e86436718dcd service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.077680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d181bfc-1c1e-4e04-8c74-1464cc30eab7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.080349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 636/1266] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:35.082586 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbc3f2-1746-48e7-9ef4-0c70b10f2405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.083569 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf62daa-3ea6-47af-9a62-e86436718dcd service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.084087 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbc3f2-1746-48e7-9ef4-0c70b10f2405 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.084413 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbc3f2-1746-48e7-9ef4-0c70b10f2405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.084691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbc3f2-1746-48e7-9ef4-0c70b10f2405 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.085320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbc3f2-1746-48e7-9ef4-0c70b10f2405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.087389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbc3f2-1746-48e7-9ef4-0c70b10f2405 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.094054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf62daa-3ea6-47af-9a62-e86436718dcd service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.100511 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ed30b-148e-4629-b76e-58340479dee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.101826 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ed30b-148e-4629-b76e-58340479dee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.102491 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ed30b-148e-4629-b76e-58340479dee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.102770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ed30b-148e-4629-b76e-58340479dee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.103904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ed30b-148e-4629-b76e-58340479dee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.105976 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ed30b-148e-4629-b76e-58340479dee6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.113580 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 631/1267] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:35 2022] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:35.115138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbc3f2-1746-48e7-9ef4-0c70b10f2405 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.120842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 637/1268] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:35.120842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ed30b-148e-4629-b76e-58340479dee6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.125656 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbc3f2-1746-48e7-9ef4-0c70b10f2405 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.128211 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ed30b-148e-4629-b76e-58340479dee6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.131116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c04e6-7867-4ee0-88f0-1d7c5ca0fe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.131704 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c04e6-7867-4ee0-88f0-1d7c5ca0fe96 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.132011 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c04e6-7867-4ee0-88f0-1d7c5ca0fe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.132288 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c04e6-7867-4ee0-88f0-1d7c5ca0fe96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.132930 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c04e6-7867-4ee0-88f0-1d7c5ca0fe96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.134072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ee522-e9cb-48d3-9ad4-34943118cb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.134505 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c04e6-7867-4ee0-88f0-1d7c5ca0fe96 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.134651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ee522-e9cb-48d3-9ad4-34943118cb83 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.134936 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ee522-e9cb-48d3-9ad4-34943118cb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.135305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ee522-e9cb-48d3-9ad4-34943118cb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.135961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ee522-e9cb-48d3-9ad4-34943118cb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.137606 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ee522-e9cb-48d3-9ad4-34943118cb83 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.147668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 632/1269] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:35.147913 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 638/1270] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:35.151650 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c04e6-7867-4ee0-88f0-1d7c5ca0fe96 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.151792 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ee522-e9cb-48d3-9ad4-34943118cb83 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.162427 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ee522-e9cb-48d3-9ad4-34943118cb83 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.162598 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c04e6-7867-4ee0-88f0-1d7c5ca0fe96 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.167134 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac0691-abe1-4384-80d6-c43f8210c35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.167340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c117cc9-4949-46be-855f-91bf489993be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.167730 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac0691-abe1-4384-80d6-c43f8210c35e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.167917 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c117cc9-4949-46be-855f-91bf489993be admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.168051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac0691-abe1-4384-80d6-c43f8210c35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.168204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c117cc9-4949-46be-855f-91bf489993be admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.168301 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac0691-abe1-4384-80d6-c43f8210c35e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.168455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c117cc9-4949-46be-855f-91bf489993be admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.168934 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac0691-abe1-4384-80d6-c43f8210c35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.169117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c117cc9-4949-46be-855f-91bf489993be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.170534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac0691-abe1-4384-80d6-c43f8210c35e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.171100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c117cc9-4949-46be-855f-91bf489993be admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.182001 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 639/1271] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:35.182865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac0691-abe1-4384-80d6-c43f8210c35e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.195497 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac0691-abe1-4384-80d6-c43f8210c35e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.199697 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 633/1272] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:35 2022] POST /identity/v3/users => generated 294 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:35.200462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f0600-2985-4088-aa08-a391f91a0073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.200860 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c117cc9-4949-46be-855f-91bf489993be admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.201324 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f0600-2985-4088-aa08-a391f91a0073 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.201683 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f0600-2985-4088-aa08-a391f91a0073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.202039 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f0600-2985-4088-aa08-a391f91a0073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.202776 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f0600-2985-4088-aa08-a391f91a0073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.204464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f0600-2985-4088-aa08-a391f91a0073 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.212457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c117cc9-4949-46be-855f-91bf489993be admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.219045 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 640/1273] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:35.219045 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f0600-2985-4088-aa08-a391f91a0073 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.220031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d89da-035b-41e3-abdc-117ce8d66d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.220743 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d89da-035b-41e3-abdc-117ce8d66d84 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.221254 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d89da-035b-41e3-abdc-117ce8d66d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.221773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d89da-035b-41e3-abdc-117ce8d66d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.222490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d89da-035b-41e3-abdc-117ce8d66d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.225122 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d89da-035b-41e3-abdc-117ce8d66d84 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.226518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f0600-2985-4088-aa08-a391f91a0073 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.226954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=85,keystone:INSERT=15 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:35.232389 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33721e3f-5eeb-427a-8b1d-31b2c677001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.233042 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33721e3f-5eeb-427a-8b1d-31b2c677001a admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.233323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33721e3f-5eeb-427a-8b1d-31b2c677001a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.233643 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33721e3f-5eeb-427a-8b1d-31b2c677001a admin admin] PATH_INFO: `/v3/projects/e02bc7a1a6b04e1f83d2165d422f0c8b/users/3c9126a0159e4682990320d07459cde7/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.243027 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 634/1274] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:35.244258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d89da-035b-41e3-abdc-117ce8d66d84 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.250821 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33721e3f-5eeb-427a-8b1d-31b2c677001a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02bc7a1a6b04e1f83d2165d422f0c8b, user_id=3c9126a0159e4682990320d07459cde7, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.253768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33721e3f-5eeb-427a-8b1d-31b2c677001a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.260556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d89da-035b-41e3-abdc-117ce8d66d84 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.265899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb170ea-78f5-40a6-8f34-7f07306df955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.266613 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb170ea-78f5-40a6-8f34-7f07306df955 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.266935 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb170ea-78f5-40a6-8f34-7f07306df955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.267214 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb170ea-78f5-40a6-8f34-7f07306df955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.267844 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb170ea-78f5-40a6-8f34-7f07306df955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.269498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb170ea-78f5-40a6-8f34-7f07306df955 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.273796 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 641/1275] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:35 2022] PUT /identity/v3/projects/e02bc7a1a6b04e1f83d2165d422f0c8b/users/3c9126a0159e4682990320d07459cde7/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:35.274627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33721e3f-5eeb-427a-8b1d-31b2c677001a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.290924 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 635/1276] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:35.290924 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb170ea-78f5-40a6-8f34-7f07306df955 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.300525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb170ea-78f5-40a6-8f34-7f07306df955 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.345007 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33721e3f-5eeb-427a-8b1d-31b2c677001a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.350763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c4fd0-4fd6-433e-902f-04a2512d23aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.351498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c4fd0-4fd6-433e-902f-04a2512d23aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.351863 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c4fd0-4fd6-433e-902f-04a2512d23aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.352228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c4fd0-4fd6-433e-902f-04a2512d23aa admin admin] PATH_INFO: `/v3/projects/df74a31bc74c45e88e057e030511e5ba/users/8ab4b0cfef7844b8b4498939731a862b/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.360939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c987b2-ac82-4c40-bffb-6d1618a2861f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.361669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c987b2-ac82-4c40-bffb-6d1618a2861f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.362009 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c987b2-ac82-4c40-bffb-6d1618a2861f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.362341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c987b2-ac82-4c40-bffb-6d1618a2861f admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.363049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c987b2-ac82-4c40-bffb-6d1618a2861f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.365365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c987b2-ac82-4c40-bffb-6d1618a2861f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.368208 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c4fd0-4fd6-433e-902f-04a2512d23aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=df74a31bc74c45e88e057e030511e5ba, user_id=8ab4b0cfef7844b8b4498939731a862b, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.372022 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c4fd0-4fd6-433e-902f-04a2512d23aa admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.380005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 636/1277] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:35.380005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c987b2-ac82-4c40-bffb-6d1618a2861f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.390800 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c987b2-ac82-4c40-bffb-6d1618a2861f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.394728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 642/1278] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:35 2022] PUT /identity/v3/projects/df74a31bc74c45e88e057e030511e5ba/users/8ab4b0cfef7844b8b4498939731a862b/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:35.395537 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c4fd0-4fd6-433e-902f-04a2512d23aa admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.405535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:35.456846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d30b34-9108-479e-b3cf-5163f88f8cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.457475 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d30b34-9108-479e-b3cf-5163f88f8cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.458412 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d30b34-9108-479e-b3cf-5163f88f8cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.458686 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d30b34-9108-479e-b3cf-5163f88f8cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.459325 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d30b34-9108-479e-b3cf-5163f88f8cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.461008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d30b34-9108-479e-b3cf-5163f88f8cf9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.468461 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c4fd0-4fd6-433e-902f-04a2512d23aa admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.471327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 637/1279] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:35.471327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d30b34-9108-479e-b3cf-5163f88f8cf9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.476428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c54b01-8a5e-4578-ab93-cdbead93815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.477107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c54b01-8a5e-4578-ab93-cdbead93815c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.477382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c54b01-8a5e-4578-ab93-cdbead93815c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.477648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c54b01-8a5e-4578-ab93-cdbead93815c admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.478288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c54b01-8a5e-4578-ab93-cdbead93815c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.481786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c54b01-8a5e-4578-ab93-cdbead93815c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.482598 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d30b34-9108-479e-b3cf-5163f88f8cf9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.487501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d092b28-bdfd-4151-83e1-8b2ea4fd7fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.487872 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d092b28-bdfd-4151-83e1-8b2ea4fd7fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.488238 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d092b28-bdfd-4151-83e1-8b2ea4fd7fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.488520 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d092b28-bdfd-4151-83e1-8b2ea4fd7fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.489581 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d092b28-bdfd-4151-83e1-8b2ea4fd7fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.491160 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d092b28-bdfd-4151-83e1-8b2ea4fd7fd4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.493075 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 643/1280] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:35.493075 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184c9c2-b724-4e6d-a4c4-55d579b121a2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.493075 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184c9c2-b724-4e6d-a4c4-55d579b121a2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.493075 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184c9c2-b724-4e6d-a4c4-55d579b121a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.510258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 638/1281] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:35.510258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d092b28-bdfd-4151-83e1-8b2ea4fd7fd4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.518103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d092b28-bdfd-4151-83e1-8b2ea4fd7fd4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.523580 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dcd00-2210-4baf-9790-4fb85c1f6d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.524358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dcd00-2210-4baf-9790-4fb85c1f6d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.524633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dcd00-2210-4baf-9790-4fb85c1f6d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.524981 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dcd00-2210-4baf-9790-4fb85c1f6d9f admin admin] PATH_INFO: `/v3/projects/5e1a1f34daba4db8b446ac88ff64e5c0/users/1e8f424a6f314b1086e067483127392b/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.526400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4184c9c2-b724-4e6d-a4c4-55d579b121a2 None None] MFA Rules not processed for user `3c9126a0159e4682990320d07459cde7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:35.528053 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4184c9c2-b724-4e6d-a4c4-55d579b121a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:35.541054 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dcd00-2210-4baf-9790-4fb85c1f6d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e1a1f34daba4db8b446ac88ff64e5c0, user_id=1e8f424a6f314b1086e067483127392b, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.543754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dcd00-2210-4baf-9790-4fb85c1f6d9f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.559470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 639/1282] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:35 2022] PUT /identity/v3/projects/5e1a1f34daba4db8b446ac88ff64e5c0/users/1e8f424a6f314b1086e067483127392b/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:35.560448 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dcd00-2210-4baf-9790-4fb85c1f6d9f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.610379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 644/1283] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:35.612437 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd640595-e01d-4e45-a1eb-b8af6b896070 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.612737 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd640595-e01d-4e45-a1eb-b8af6b896070 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.613295 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd640595-e01d-4e45-a1eb-b8af6b896070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.630358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:35.651658 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fd640595-e01d-4e45-a1eb-b8af6b896070 None None] MFA Rules not processed for user `8ab4b0cfef7844b8b4498939731a862b`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:35.652777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dcd00-2210-4baf-9790-4fb85c1f6d9f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.653310 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fd640595-e01d-4e45-a1eb-b8af6b896070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:35.659232 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfff29e-cfe1-4640-ba92-80684ea2ec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.660882 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfff29e-cfe1-4640-ba92-80684ea2ec76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.661172 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfff29e-cfe1-4640-ba92-80684ea2ec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.661569 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfff29e-cfe1-4640-ba92-80684ea2ec76 admin admin] PATH_INFO: `/v3/projects/9d5fb5e955514f76b48b44fd9bf9f2d7/users/b8532a4cfb224d75aab98dddf1dcd0fb/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.687105 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfff29e-cfe1-4640-ba92-80684ea2ec76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5fb5e955514f76b48b44fd9bf9f2d7, user_id=b8532a4cfb224d75aab98dddf1dcd0fb, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.690735 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfff29e-cfe1-4640-ba92-80684ea2ec76 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.724007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 640/1284] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:35 2022] PUT /identity/v3/projects/9d5fb5e955514f76b48b44fd9bf9f2d7/users/b8532a4cfb224d75aab98dddf1dcd0fb/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:35.724007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfff29e-cfe1-4640-ba92-80684ea2ec76 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.742379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 645/1285] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:35.742379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd640595-e01d-4e45-a1eb-b8af6b896070 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.751777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd640595-e01d-4e45-a1eb-b8af6b896070 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.771557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:35.804844 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfff29e-cfe1-4640-ba92-80684ea2ec76 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.811690 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c9e79-3528-47ae-be2b-dfcabce76963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.812618 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c9e79-3528-47ae-be2b-dfcabce76963 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.813046 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c9e79-3528-47ae-be2b-dfcabce76963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.813463 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c9e79-3528-47ae-be2b-dfcabce76963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.814251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c9e79-3528-47ae-be2b-dfcabce76963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.815959 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288683c-3052-4cb4-9f46-ab92f310425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.816494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c9e79-3528-47ae-be2b-dfcabce76963 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.816998 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288683c-3052-4cb4-9f46-ab92f310425f admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.817408 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288683c-3052-4cb4-9f46-ab92f310425f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.817994 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288683c-3052-4cb4-9f46-ab92f310425f admin admin] PATH_INFO: `/v3/projects/e8ec43a3c32c445c82865708ec55ec34/users/df6a4914e6f0486683abf7740dd0c863/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.830459 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 641/1286] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:35.831940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c9e79-3528-47ae-be2b-dfcabce76963 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.837299 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288683c-3052-4cb4-9f46-ab92f310425f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ec43a3c32c445c82865708ec55ec34, user_id=df6a4914e6f0486683abf7740dd0c863, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.840497 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288683c-3052-4cb4-9f46-ab92f310425f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.843438 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c9e79-3528-47ae-be2b-dfcabce76963 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.850863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8c6fa-4e1e-425e-b8d8-c15d2fe9a781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.851543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8c6fa-4e1e-425e-b8d8-c15d2fe9a781 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.851832 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8c6fa-4e1e-425e-b8d8-c15d2fe9a781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.852109 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8c6fa-4e1e-425e-b8d8-c15d2fe9a781 admin admin] PATH_INFO: `/v3/projects/829946736bde4f5ba6423ade7d086e60/users/38b48da35205469abf5aa714dacfe6cb/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.861133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 646/1287] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:35 2022] PUT /identity/v3/projects/e8ec43a3c32c445c82865708ec55ec34/users/df6a4914e6f0486683abf7740dd0c863/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:35.862810 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5047e1-bf70-4e4c-a589-7135cea9ee7a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.863702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5047e1-bf70-4e4c-a589-7135cea9ee7a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.864607 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5047e1-bf70-4e4c-a589-7135cea9ee7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.871028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8c6fa-4e1e-425e-b8d8-c15d2fe9a781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=829946736bde4f5ba6423ade7d086e60, user_id=38b48da35205469abf5aa714dacfe6cb, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.873973 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8c6fa-4e1e-425e-b8d8-c15d2fe9a781 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.889464 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 642/1288] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:35 2022] PUT /identity/v3/projects/829946736bde4f5ba6423ade7d086e60/users/38b48da35205469abf5aa714dacfe6cb/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:35.890734 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8c6fa-4e1e-425e-b8d8-c15d2fe9a781 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:35.898719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2b5047e1-bf70-4e4c-a589-7135cea9ee7a None None] MFA Rules not processed for user `1e8f424a6f314b1086e067483127392b`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:35.900537 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2b5047e1-bf70-4e4c-a589-7135cea9ee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:35.954689 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8c6fa-4e1e-425e-b8d8-c15d2fe9a781 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:35.960213 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bbb1d-9863-4ebd-9b84-813b9a692455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:35.960828 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bbb1d-9863-4ebd-9b84-813b9a692455 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.961107 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bbb1d-9863-4ebd-9b84-813b9a692455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.961380 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bbb1d-9863-4ebd-9b84-813b9a692455 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:35.962019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bbb1d-9863-4ebd-9b84-813b9a692455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:35.963960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bbb1d-9863-4ebd-9b84-813b9a692455 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:35.975383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 647/1289] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:35.977284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef32f5-4de6-4413-847b-40275444207d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:35.977987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef32f5-4de6-4413-847b-40275444207d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:35.978415 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef32f5-4de6-4413-847b-40275444207d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.001277 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 643/1290] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:35 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:36.003119 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bbb1d-9863-4ebd-9b84-813b9a692455 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:36.005269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7bef32f5-4de6-4413-847b-40275444207d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:36.006509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7bef32f5-4de6-4413-847b-40275444207d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:36.029691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:36.067747 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 648/1291] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:36.068801 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef32f5-4de6-4413-847b-40275444207d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:36.077547 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bbb1d-9863-4ebd-9b84-813b9a692455 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:36.078871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef32f5-4de6-4413-847b-40275444207d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:36.082428 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9172a67-9cdf-4eeb-9d11-cb27e1f6c6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:36.083074 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9172a67-9cdf-4eeb-9d11-cb27e1f6c6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.083351 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9172a67-9cdf-4eeb-9d11-cb27e1f6c6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.083464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7eed1-fe9c-492a-afe0-df0e4dfa8205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:36.083623 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9172a67-9cdf-4eeb-9d11-cb27e1f6c6d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.084156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7eed1-fe9c-492a-afe0-df0e4dfa8205 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.084299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9172a67-9cdf-4eeb-9d11-cb27e1f6c6d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:36.084436 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7eed1-fe9c-492a-afe0-df0e4dfa8205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.084705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7eed1-fe9c-492a-afe0-df0e4dfa8205 admin admin] PATH_INFO: `/v3/projects/eae04fd7301f41ed9d09665f8366752f/users/9bc07aa85f5643cfb89280a136496619/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.086161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9172a67-9cdf-4eeb-9d11-cb27e1f6c6d3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:36.100353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7eed1-fe9c-492a-afe0-df0e4dfa8205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae04fd7301f41ed9d09665f8366752f, user_id=9bc07aa85f5643cfb89280a136496619, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:36.103024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7eed1-fe9c-492a-afe0-df0e4dfa8205 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:36.114397 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 644/1292] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:36 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:36.116546 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 649/1293] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:36 2022] PUT /identity/v3/projects/eae04fd7301f41ed9d09665f8366752f/users/9bc07aa85f5643cfb89280a136496619/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:36.117517 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b5950-43ec-4040-a01e-a07a69a148a7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.117936 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5969bb-0ec1-4d81-af26-7597ef9c9150 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.118094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b5950-43ec-4040-a01e-a07a69a148a7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.118264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5969bb-0ec1-4d81-af26-7597ef9c9150 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.118374 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b5950-43ec-4040-a01e-a07a69a148a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.118661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5969bb-0ec1-4d81-af26-7597ef9c9150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.137931 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cd5969bb-0ec1-4d81-af26-7597ef9c9150 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:36.138742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-790b5950-43ec-4040-a01e-a07a69a148a7 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:36.139128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cd5969bb-0ec1-4d81-af26-7597ef9c9150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:36.139972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-790b5950-43ec-4040-a01e-a07a69a148a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:36.144590 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:36.199100 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 650/1294] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:36.199827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 645/1295] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:36.200528 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14b372-0df1-4531-9f50-7d8ee36bff63 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.200710 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b5950-43ec-4040-a01e-a07a69a148a7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:36.201440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14b372-0df1-4531-9f50-7d8ee36bff63 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.201719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14b372-0df1-4531-9f50-7d8ee36bff63 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.203266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 651/1296] 10.222.0.13 () {54 vars in 961 bytes} [Mon Oct 17 10:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:24:36.203880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14b372-0df1-4531-9f50-7d8ee36bff63 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:36.217201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14b372-0df1-4531-9f50-7d8ee36bff63 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:36.222075 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318e88-0f6a-43c4-8d3e-e3f7709dae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:36.222688 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318e88-0f6a-43c4-8d3e-e3f7709dae96 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.222967 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318e88-0f6a-43c4-8d3e-e3f7709dae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.223822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318e88-0f6a-43c4-8d3e-e3f7709dae96 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.224440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93318e88-0f6a-43c4-8d3e-e3f7709dae96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:36.226881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93318e88-0f6a-43c4-8d3e-e3f7709dae96 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:36.249069 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 652/1297] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:36 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:36.249997 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318e88-0f6a-43c4-8d3e-e3f7709dae96 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:36.267077 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b5950-43ec-4040-a01e-a07a69a148a7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:36.270679 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90201b2-9126-4d4c-bdea-7dd62232ea44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:36.271281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90201b2-9126-4d4c-bdea-7dd62232ea44 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.271556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90201b2-9126-4d4c-bdea-7dd62232ea44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.271819 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90201b2-9126-4d4c-bdea-7dd62232ea44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.306093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318e88-0f6a-43c4-8d3e-e3f7709dae96 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:36.309803 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e51fd-1b41-4eac-81a7-cba90b4795b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:36.310407 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e51fd-1b41-4eac-81a7-cba90b4795b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.310687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e51fd-1b41-4eac-81a7-cba90b4795b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.310962 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e51fd-1b41-4eac-81a7-cba90b4795b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.320465 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e51fd-1b41-4eac-81a7-cba90b4795b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:36.321888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e51fd-1b41-4eac-81a7-cba90b4795b6 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:36.327583 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90201b2-9126-4d4c-bdea-7dd62232ea44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:36.329112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90201b2-9126-4d4c-bdea-7dd62232ea44 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:36.331468 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 653/1298] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:36.332140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e51fd-1b41-4eac-81a7-cba90b4795b6 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:36.341729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 646/1299] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:36.342250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e51fd-1b41-4eac-81a7-cba90b4795b6 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:36.343183 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d257be3-1a4d-4eba-bcff-e7299eb3c3a9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.343632 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d257be3-1a4d-4eba-bcff-e7299eb3c3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.344149 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d257be3-1a4d-4eba-bcff-e7299eb3c3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.347594 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a7776-9ac6-4df8-94ad-e0bba0f3a971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:36.348905 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a7776-9ac6-4df8-94ad-e0bba0f3a971 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.349204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a7776-9ac6-4df8-94ad-e0bba0f3a971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.349479 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a7776-9ac6-4df8-94ad-e0bba0f3a971 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.350108 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a7776-9ac6-4df8-94ad-e0bba0f3a971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:36.352119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a7776-9ac6-4df8-94ad-e0bba0f3a971 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:36.352741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:36.369966 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2d257be3-1a4d-4eba-bcff-e7299eb3c3a9 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:36.371434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2d257be3-1a4d-4eba-bcff-e7299eb3c3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:36.382663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 647/1300] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:36.384268 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6496f4-3e81-4351-8009-5bda02d1670e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.384599 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6496f4-3e81-4351-8009-5bda02d1670e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.384976 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6496f4-3e81-4351-8009-5bda02d1670e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.404029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 654/1301] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:36 2022] POST /identity/v3/users => generated 300 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:36.405118 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a7776-9ac6-4df8-94ad-e0bba0f3a971 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:36.412976 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2a6496f4-3e81-4351-8009-5bda02d1670e None None] MFA Rules not processed for user `a80cc7ec3d2d49f88c81403f918a6900`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:36.414307 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2a6496f4-3e81-4351-8009-5bda02d1670e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:36.420635 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a7776-9ac6-4df8-94ad-e0bba0f3a971 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:36.425842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548be037-3773-4d8b-8695-39ed3e44c27a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:36.426622 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548be037-3773-4d8b-8695-39ed3e44c27a service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.427866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548be037-3773-4d8b-8695-39ed3e44c27a service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.428410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548be037-3773-4d8b-8695-39ed3e44c27a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.441253 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548be037-3773-4d8b-8695-39ed3e44c27a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:36.443380 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548be037-3773-4d8b-8695-39ed3e44c27a service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:36.455495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 655/1302] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:36.456297 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548be037-3773-4d8b-8695-39ed3e44c27a service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:36.466557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548be037-3773-4d8b-8695-39ed3e44c27a service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:36.472139 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04291f2d-9d7d-49bb-bfec-e9d2ad49210c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:36.473134 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04291f2d-9d7d-49bb-bfec-e9d2ad49210c service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.473699 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04291f2d-9d7d-49bb-bfec-e9d2ad49210c service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.474299 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04291f2d-9d7d-49bb-bfec-e9d2ad49210c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.486973 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04291f2d-9d7d-49bb-bfec-e9d2ad49210c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:36.488745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04291f2d-9d7d-49bb-bfec-e9d2ad49210c service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:36.503785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 656/1303] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:36.507539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04291f2d-9d7d-49bb-bfec-e9d2ad49210c service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:36.516209 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 648/1304] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Oct 17 10:24:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:36.517299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6496f4-3e81-4351-8009-5bda02d1670e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:36.526685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04291f2d-9d7d-49bb-bfec-e9d2ad49210c service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:36.529381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6496f4-3e81-4351-8009-5bda02d1670e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:36.533255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f511633-fe49-4fc7-9a89-cee64badaa4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:36.533923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f511633-fe49-4fc7-9a89-cee64badaa4d service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.534354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f511633-fe49-4fc7-9a89-cee64badaa4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.534635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f511633-fe49-4fc7-9a89-cee64badaa4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.536658 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195372e-a543-499e-908f-b0d39555d134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:36.537600 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195372e-a543-499e-908f-b0d39555d134 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.538269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195372e-a543-499e-908f-b0d39555d134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.538745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195372e-a543-499e-908f-b0d39555d134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.540211 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195372e-a543-499e-908f-b0d39555d134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:36.542667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195372e-a543-499e-908f-b0d39555d134 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:36.554003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f511633-fe49-4fc7-9a89-cee64badaa4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:36.555875 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f511633-fe49-4fc7-9a89-cee64badaa4d service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:36.559322 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 657/1305] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:36.560514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195372e-a543-499e-908f-b0d39555d134 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:36.573477 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195372e-a543-499e-908f-b0d39555d134 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:36.579822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c3d93-06a3-4eda-b620-c578cb5aea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:36.581535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c3d93-06a3-4eda-b620-c578cb5aea6b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.582001 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c3d93-06a3-4eda-b620-c578cb5aea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.583245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c3d93-06a3-4eda-b620-c578cb5aea6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.584456 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c3d93-06a3-4eda-b620-c578cb5aea6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:36.585211 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 649/1306] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:36.587770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c3d93-06a3-4eda-b620-c578cb5aea6b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:36.589146 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82d913-7c9d-403b-ab78-dc24bb869ac6 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.590565 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82d913-7c9d-403b-ab78-dc24bb869ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.590870 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82d913-7c9d-403b-ab78-dc24bb869ac6 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.596322 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 650/1307] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 17 10:24:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:24:36.597258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82d913-7c9d-403b-ab78-dc24bb869ac6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:36.607598 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 658/1308] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:36.609107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb055fc-475f-4467-b965-e302758dbf3a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.609378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb055fc-475f-4467-b965-e302758dbf3a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.609739 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb055fc-475f-4467-b965-e302758dbf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.638930 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82d913-7c9d-403b-ab78-dc24bb869ac6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:36.639624 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0eb055fc-475f-4467-b965-e302758dbf3a None None] MFA Rules not processed for user `a80cc7ec3d2d49f88c81403f918a6900`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:36.641348 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0eb055fc-475f-4467-b965-e302758dbf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:36.659175 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa508f-5ca1-402d-941d-f9d30b4e422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:36.659937 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa508f-5ca1-402d-941d-f9d30b4e422a admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.660215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa508f-5ca1-402d-941d-f9d30b4e422a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.660493 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa508f-5ca1-402d-941d-f9d30b4e422a admin admin] PATH_INFO: `/v3/projects/80235a75b263403d94894f25dd8f8996/users/9513f39706184d5bbc6f0c93a7fdeb6d/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.675196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 659/1309] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 17 10:24:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:36.676526 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb055fc-475f-4467-b965-e302758dbf3a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:36.694228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb055fc-475f-4467-b965-e302758dbf3a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:36.700881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef56271-6bd2-4b5d-b91a-e843ad86cf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:36.701619 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa508f-5ca1-402d-941d-f9d30b4e422a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80235a75b263403d94894f25dd8f8996, user_id=9513f39706184d5bbc6f0c93a7fdeb6d, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:36.701740 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef56271-6bd2-4b5d-b91a-e843ad86cf90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.702009 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef56271-6bd2-4b5d-b91a-e843ad86cf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.702919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef56271-6bd2-4b5d-b91a-e843ad86cf90 admin admin] PATH_INFO: `/v3/projects/75f95bea99204e5bbee31e92686a3191/users/0b30e301568f41d9a30aa66f73a9e1c3/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.711033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa508f-5ca1-402d-941d-f9d30b4e422a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:36.730285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef56271-6bd2-4b5d-b91a-e843ad86cf90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75f95bea99204e5bbee31e92686a3191, user_id=0b30e301568f41d9a30aa66f73a9e1c3, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:36.734260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef56271-6bd2-4b5d-b91a-e843ad86cf90 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:36.748521 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 651/1310] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:36 2022] PUT /identity/v3/projects/80235a75b263403d94894f25dd8f8996/users/9513f39706184d5bbc6f0c93a7fdeb6d/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:36.752607 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa508f-5ca1-402d-941d-f9d30b4e422a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:36.753472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:36.760690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 660/1311] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:36 2022] PUT /identity/v3/projects/75f95bea99204e5bbee31e92686a3191/users/0b30e301568f41d9a30aa66f73a9e1c3/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:36.761675 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef56271-6bd2-4b5d-b91a-e843ad86cf90 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:36.900249 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa508f-5ca1-402d-941d-f9d30b4e422a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:36.935611 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef56271-6bd2-4b5d-b91a-e843ad86cf90 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:36.955768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b165c6-c434-4f9b-adb1-9fe63252c9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:36.956682 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b165c6-c434-4f9b-adb1-9fe63252c9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:36.957279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b165c6-c434-4f9b-adb1-9fe63252c9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:36.957915 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b165c6-c434-4f9b-adb1-9fe63252c9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:36.958788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b165c6-c434-4f9b-adb1-9fe63252c9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:36.960852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b165c6-c434-4f9b-adb1-9fe63252c9d7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:36.988511 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 661/1312] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:36.989796 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b165c6-c434-4f9b-adb1-9fe63252c9d7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:37.000978 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b165c6-c434-4f9b-adb1-9fe63252c9d7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:37.008424 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b4c87-9a22-4b18-9f91-5b4240da215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:37.009349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b4c87-9a22-4b18-9f91-5b4240da215f admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:37.009767 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b4c87-9a22-4b18-9f91-5b4240da215f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:37.010157 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b4c87-9a22-4b18-9f91-5b4240da215f admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:37.010644 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd54e6-9d8d-4670-808e-c21a9cc688cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:37.010929 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b4c87-9a22-4b18-9f91-5b4240da215f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:37.011263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd54e6-9d8d-4670-808e-c21a9cc688cb service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:37.011544 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd54e6-9d8d-4670-808e-c21a9cc688cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:37.011895 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd54e6-9d8d-4670-808e-c21a9cc688cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:37.012606 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b4c87-9a22-4b18-9f91-5b4240da215f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:37.025805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 662/1313] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:37.026752 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b4c87-9a22-4b18-9f91-5b4240da215f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:37.036740 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:37.040865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b4c87-9a22-4b18-9f91-5b4240da215f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:37.047070 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ecf51-07d2-4afe-8da9-312928bd1182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:37.047788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ecf51-07d2-4afe-8da9-312928bd1182 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:37.048110 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ecf51-07d2-4afe-8da9-312928bd1182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:37.048388 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ecf51-07d2-4afe-8da9-312928bd1182 admin admin] PATH_INFO: `/v3/projects/80235a75b263403d94894f25dd8f8996/users/9513f39706184d5bbc6f0c93a7fdeb6d/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:37.052472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ecf51-07d2-4afe-8da9-312928bd1182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80235a75b263403d94894f25dd8f8996, user_id=9513f39706184d5bbc6f0c93a7fdeb6d, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:37.056618 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ecf51-07d2-4afe-8da9-312928bd1182 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:37.076028 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 663/1314] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:37 2022] PUT /identity/v3/projects/80235a75b263403d94894f25dd8f8996/users/9513f39706184d5bbc6f0c93a7fdeb6d/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:37.076951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ecf51-07d2-4afe-8da9-312928bd1182 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:37.137556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd54e6-9d8d-4670-808e-c21a9cc688cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:37.139874 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd54e6-9d8d-4670-808e-c21a9cc688cb service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:37.167860 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 652/1315] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:37.170950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815ad3c-e644-48bb-b318-2412748dafc7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:37.171271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815ad3c-e644-48bb-b318-2412748dafc7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:37.171702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815ad3c-e644-48bb-b318-2412748dafc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:37.239752 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ecf51-07d2-4afe-8da9-312928bd1182 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:37.258424 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b661914-8d3d-4b6d-be30-3d3df667f931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:37.258424 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b661914-8d3d-4b6d-be30-3d3df667f931 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:37.258424 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b661914-8d3d-4b6d-be30-3d3df667f931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:37.258424 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b661914-8d3d-4b6d-be30-3d3df667f931 admin admin] PATH_INFO: `/v3/projects/75f95bea99204e5bbee31e92686a3191/users/0b30e301568f41d9a30aa66f73a9e1c3/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:37.267426 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b661914-8d3d-4b6d-be30-3d3df667f931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75f95bea99204e5bbee31e92686a3191, user_id=0b30e301568f41d9a30aa66f73a9e1c3, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:37.271992 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b815ad3c-e644-48bb-b318-2412748dafc7 None None] MFA Rules not processed for user `9513f39706184d5bbc6f0c93a7fdeb6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:37.273240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b815ad3c-e644-48bb-b318-2412748dafc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:37.274907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b661914-8d3d-4b6d-be30-3d3df667f931 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:37.315110 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 664/1316] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:37 2022] PUT /identity/v3/projects/75f95bea99204e5bbee31e92686a3191/users/0b30e301568f41d9a30aa66f73a9e1c3/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:37.326266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dd96d-6861-42fb-8049-9c18726b313d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:37.326560 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dd96d-6861-42fb-8049-9c18726b313d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:37.326842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dd96d-6861-42fb-8049-9c18726b313d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:37.374419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-688dd96d-6861-42fb-8049-9c18726b313d None None] MFA Rules not processed for user `0b30e301568f41d9a30aa66f73a9e1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:37.375861 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-688dd96d-6861-42fb-8049-9c18726b313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:37.413414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 653/1317] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:37.425756 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815ad3c-e644-48bb-b318-2412748dafc7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:37.471734 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:37.497465 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 665/1318] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:37.550948 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dd96d-6861-42fb-8049-9c18726b313d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:37.553451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815ad3c-e644-48bb-b318-2412748dafc7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:37.630026 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:37.636969 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0d75e-5a98-480e-bc56-fdfbcb7040c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:37.638388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0d75e-5a98-480e-bc56-fdfbcb7040c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:37.638809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0d75e-5a98-480e-bc56-fdfbcb7040c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:37.639185 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0d75e-5a98-480e-bc56-fdfbcb7040c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:37.666922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dd96d-6861-42fb-8049-9c18726b313d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:37.671738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25928ef-cfb6-4d34-bcd9-d70140cccac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:37.672706 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25928ef-cfb6-4d34-bcd9-d70140cccac6 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:37.672989 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25928ef-cfb6-4d34-bcd9-d70140cccac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:37.673270 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25928ef-cfb6-4d34-bcd9-d70140cccac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:37.689038 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25928ef-cfb6-4d34-bcd9-d70140cccac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:37.690570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25928ef-cfb6-4d34-bcd9-d70140cccac6 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:37.717921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 666/1319] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:37.819024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0d75e-5a98-480e-bc56-fdfbcb7040c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:37.822070 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0d75e-5a98-480e-bc56-fdfbcb7040c1 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:37.852478 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25928ef-cfb6-4d34-bcd9-d70140cccac6 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:37.874043 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 654/1320] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:24:37.914947 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0d75e-5a98-480e-bc56-fdfbcb7040c1 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:37.952359 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25928ef-cfb6-4d34-bcd9-d70140cccac6 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:37.960292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e48e43-6e3f-4b4d-9dfe-53c74e1f9104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:37.962093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e48e43-6e3f-4b4d-9dfe-53c74e1f9104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:37.963104 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e48e43-6e3f-4b4d-9dfe-53c74e1f9104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:37.964109 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e48e43-6e3f-4b4d-9dfe-53c74e1f9104 admin admin] PATH_INFO: `/v3/users/99383ed742b943ecb45b0b86ceae051e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:37.966260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e48e43-6e3f-4b4d-9dfe-53c74e1f9104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99383ed742b943ecb45b0b86ceae051e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:37.968791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e48e43-6e3f-4b4d-9dfe-53c74e1f9104 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:38.074253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0d75e-5a98-480e-bc56-fdfbcb7040c1 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:38.085761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0bda4-cec1-467b-a47e-bb26e0faad9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:38.086561 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0bda4-cec1-467b-a47e-bb26e0faad9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:38.087054 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0bda4-cec1-467b-a47e-bb26e0faad9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:38.092089 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0bda4-cec1-467b-a47e-bb26e0faad9a admin admin] PATH_INFO: `/v3/users/8ab4b0cfef7844b8b4498939731a862b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:38.094806 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0bda4-cec1-467b-a47e-bb26e0faad9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab4b0cfef7844b8b4498939731a862b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:38.100048 dv-cinder-860209-5-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-d1c0bda4-cec1-467b-a47e-bb26e0faad9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:24:38.100048 dv-cinder-860209-5-smb devstack@keystone.service[81386]: warnings.warn(msg) Oct 17 10:24:38.100048 dv-cinder-860209-5-smb devstack@keystone.service[81386]: Oct 17 10:24:38.101739 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0bda4-cec1-467b-a47e-bb26e0faad9a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:38.116544 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-13e48e43-6e3f-4b4d-9dfe-53c74e1f9104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99383ed742b943ecb45b0b86ceae051e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:38.118093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-13e48e43-6e3f-4b4d-9dfe-53c74e1f9104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99383ed742b943ecb45b0b86ceae051e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:38.128284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-13e48e43-6e3f-4b4d-9dfe-53c74e1f9104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99383ed742b943ecb45b0b86ceae051e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:38.135825 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-13e48e43-6e3f-4b4d-9dfe-53c74e1f9104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99383ed742b943ecb45b0b86ceae051e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:38.149751 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-13e48e43-6e3f-4b4d-9dfe-53c74e1f9104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99383ed742b943ecb45b0b86ceae051e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:38.204884 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 667/1321] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:24:37 2022] DELETE /identity/v3/users/99383ed742b943ecb45b0b86ceae051e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:38.205933 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e48e43-6e3f-4b4d-9dfe-53c74e1f9104 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:38.213049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-13e48e43-6e3f-4b4d-9dfe-53c74e1f9104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:38.246522 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d1c0bda4-cec1-467b-a47e-bb26e0faad9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab4b0cfef7844b8b4498939731a862b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:38.247696 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d1c0bda4-cec1-467b-a47e-bb26e0faad9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab4b0cfef7844b8b4498939731a862b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:38.255521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:38.298069 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d1c0bda4-cec1-467b-a47e-bb26e0faad9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab4b0cfef7844b8b4498939731a862b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:38.299834 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d1c0bda4-cec1-467b-a47e-bb26e0faad9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab4b0cfef7844b8b4498939731a862b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:38.329744 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d1c0bda4-cec1-467b-a47e-bb26e0faad9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab4b0cfef7844b8b4498939731a862b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:38.418527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 655/1322] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:24:37 2022] DELETE /identity/v3/users/8ab4b0cfef7844b8b4498939731a862b => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:24:38.418527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16541b9-125e-4bee-89d8-2c6ae4159474 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:38.418527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16541b9-125e-4bee-89d8-2c6ae4159474 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:38.418527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16541b9-125e-4bee-89d8-2c6ae4159474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:38.423152 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e48e43-6e3f-4b4d-9dfe-53c74e1f9104 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:38.447008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d16541b9-125e-4bee-89d8-2c6ae4159474 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:38.448291 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d16541b9-125e-4bee-89d8-2c6ae4159474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:38.464203 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:38.513921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cced2f-cf1d-471f-999e-cde4acaedf2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:38.514731 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cced2f-cf1d-471f-999e-cde4acaedf2b service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:38.515749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cced2f-cf1d-471f-999e-cde4acaedf2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:38.516349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cced2f-cf1d-471f-999e-cde4acaedf2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:38.518646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-78cced2f-cf1d-471f-999e-cde4acaedf2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:38.579690 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 656/1323] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:38.581465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2e295-2ff1-4122-96ab-f0960860bf05 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:38.581952 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2e295-2ff1-4122-96ab-f0960860bf05 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:38.582416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2e295-2ff1-4122-96ab-f0960860bf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:38.626258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c3e2e295-2ff1-4122-96ab-f0960860bf05 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:38.630630 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c3e2e295-2ff1-4122-96ab-f0960860bf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:38.635972 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cced2f-cf1d-471f-999e-cde4acaedf2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:38.637576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cced2f-cf1d-471f-999e-cde4acaedf2b service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:38.649503 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 657/1324] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:38.650207 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 668/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:38.713809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2e295-2ff1-4122-96ab-f0960860bf05 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:38.716062 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c3e2e295-2ff1-4122-96ab-f0960860bf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:38.735223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cced2f-cf1d-471f-999e-cde4acaedf2b service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:38.739436 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-78cced2f-cf1d-471f-999e-cde4acaedf2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:38.871769 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2e295-2ff1-4122-96ab-f0960860bf05 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:38.900287 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad3814-eeb1-426a-b2c9-ce9ed78d32fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:38.902209 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad3814-eeb1-426a-b2c9-ce9ed78d32fd service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:38.902495 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad3814-eeb1-426a-b2c9-ce9ed78d32fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:38.902770 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad3814-eeb1-426a-b2c9-ce9ed78d32fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:38.920359 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cced2f-cf1d-471f-999e-cde4acaedf2b service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:38.935310 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4508b1-d52e-4891-9521-fdec5ad83b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:38.936639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad3814-eeb1-426a-b2c9-ce9ed78d32fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:38.937834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4508b1-d52e-4891-9521-fdec5ad83b3c service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:38.938146 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4508b1-d52e-4891-9521-fdec5ad83b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:38.940211 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad3814-eeb1-426a-b2c9-ce9ed78d32fd service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:38.940772 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4508b1-d52e-4891-9521-fdec5ad83b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:38.982161 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4508b1-d52e-4891-9521-fdec5ad83b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:38.988651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 658/1326] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:38.991418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4508b1-d52e-4891-9521-fdec5ad83b3c service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:39.013599 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 669/1327] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:40.324934 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad3814-eeb1-426a-b2c9-ce9ed78d32fd service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:40.326309 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-34ad3814-eeb1-426a-b2c9-ce9ed78d32fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:40.351742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad3814-eeb1-426a-b2c9-ce9ed78d32fd service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:40.358469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4508b1-d52e-4891-9521-fdec5ad83b3c service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:40.359879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ba4508b1-d52e-4891-9521-fdec5ad83b3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:40.374332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af10ca1-e56b-4536-aec7-1b7b3e3c4158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:40.374908 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10ca1-e56b-4536-aec7-1b7b3e3c4158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:40.375186 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10ca1-e56b-4536-aec7-1b7b3e3c4158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:40.375453 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10ca1-e56b-4536-aec7-1b7b3e3c4158 admin admin] PATH_INFO: `/v3/projects/acb50eedf34b4fd69f28420746e82184` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:40.381658 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af10ca1-e56b-4536-aec7-1b7b3e3c4158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb50eedf34b4fd69f28420746e82184)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:40.382428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4508b1-d52e-4891-9521-fdec5ad83b3c service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:40.383163 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af10ca1-e56b-4536-aec7-1b7b3e3c4158 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:40.397403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a65df4-480a-4e9d-a084-573efaf8b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:40.398477 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a65df4-480a-4e9d-a084-573efaf8b754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:40.399254 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a65df4-480a-4e9d-a084-573efaf8b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:40.399864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a65df4-480a-4e9d-a084-573efaf8b754 admin admin] PATH_INFO: `/v3/projects/df74a31bc74c45e88e057e030511e5ba` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:40.403155 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a65df4-480a-4e9d-a084-573efaf8b754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df74a31bc74c45e88e057e030511e5ba)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:40.404493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-f1a65df4-480a-4e9d-a084-573efaf8b754 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 10:24:40.404493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: warnings.warn(msg) Oct 17 10:24:40.404493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: Oct 17 10:24:40.406154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a65df4-480a-4e9d-a084-573efaf8b754 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:40.444620 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:40.471622 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0af10ca1-e56b-4536-aec7-1b7b3e3c4158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb50eedf34b4fd69f28420746e82184', 'request_id': 'req-0af10ca1-e56b-4536-aec7-1b7b3e3c4158'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:40.490686 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0af10ca1-e56b-4536-aec7-1b7b3e3c4158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb50eedf34b4fd69f28420746e82184', 'request_id': 'req-0af10ca1-e56b-4536-aec7-1b7b3e3c4158'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:40.502167 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0af10ca1-e56b-4536-aec7-1b7b3e3c4158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb50eedf34b4fd69f28420746e82184', 'request_id': 'req-0af10ca1-e56b-4536-aec7-1b7b3e3c4158'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:40.525586 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0af10ca1-e56b-4536-aec7-1b7b3e3c4158 admin admin] The token cache is being invalidate because project acb50eedf34b4fd69f28420746e82184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:24:40.525883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0af10ca1-e56b-4536-aec7-1b7b3e3c4158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:40.526667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0af10ca1-e56b-4536-aec7-1b7b3e3c4158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:40.528885 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 659/1328] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:24:40 2022] DELETE /identity/v3/projects/acb50eedf34b4fd69f28420746e82184 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:40.533942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e59915-ea7a-4c40-b36f-dd4b17e41f14 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:40.534308 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e59915-ea7a-4c40-b36f-dd4b17e41f14 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:40.534646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e59915-ea7a-4c40-b36f-dd4b17e41f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:40.537859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f1a65df4-480a-4e9d-a084-573efaf8b754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df74a31bc74c45e88e057e030511e5ba', 'request_id': 'req-f1a65df4-480a-4e9d-a084-573efaf8b754'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:40.555489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f1a65df4-480a-4e9d-a084-573efaf8b754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df74a31bc74c45e88e057e030511e5ba', 'request_id': 'req-f1a65df4-480a-4e9d-a084-573efaf8b754'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:40.568408 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-41e59915-ea7a-4c40-b36f-dd4b17e41f14 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:40.571281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-41e59915-ea7a-4c40-b36f-dd4b17e41f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:40.577579 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f1a65df4-480a-4e9d-a084-573efaf8b754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df74a31bc74c45e88e057e030511e5ba', 'request_id': 'req-f1a65df4-480a-4e9d-a084-573efaf8b754'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:40.603984 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f1a65df4-480a-4e9d-a084-573efaf8b754 admin admin] The token cache is being invalidate because project df74a31bc74c45e88e057e030511e5ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:24:40.604287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f1a65df4-480a-4e9d-a084-573efaf8b754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:40.604948 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f1a65df4-480a-4e9d-a084-573efaf8b754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:40.606452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 670/1329] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:24:40 2022] DELETE /identity/v3/projects/df74a31bc74c45e88e057e030511e5ba => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:24:40.610199 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a65df4-480a-4e9d-a084-573efaf8b754 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:40.611581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f1a65df4-480a-4e9d-a084-573efaf8b754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:40.662226 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:40.716020 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 660/1330] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:40.724641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae430d6-3ca1-43cb-8094-57d5f8aea5fc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:40.725097 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae430d6-3ca1-43cb-8094-57d5f8aea5fc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:40.725525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae430d6-3ca1-43cb-8094-57d5f8aea5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:40.752801 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a65df4-480a-4e9d-a084-573efaf8b754 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:40.774532 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0706d-3138-4aa2-8f31-64b14159f053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:40.776257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0706d-3138-4aa2-8f31-64b14159f053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:40.776544 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0706d-3138-4aa2-8f31-64b14159f053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:40.777551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0706d-3138-4aa2-8f31-64b14159f053 admin admin] PATH_INFO: `/v3/users/0b30e301568f41d9a30aa66f73a9e1c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:40.778598 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dae430d6-3ca1-43cb-8094-57d5f8aea5fc None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:40.781167 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dae430d6-3ca1-43cb-8094-57d5f8aea5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:40.783002 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0706d-3138-4aa2-8f31-64b14159f053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b30e301568f41d9a30aa66f73a9e1c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:40.785300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0706d-3138-4aa2-8f31-64b14159f053 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:40.807637 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 661/1331] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:24:40.812365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae430d6-3ca1-43cb-8094-57d5f8aea5fc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:40.866103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae430d6-3ca1-43cb-8094-57d5f8aea5fc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:40.882341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e327fff-813a-43e5-9f12-40249f2c9660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:40.883520 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e327fff-813a-43e5-9f12-40249f2c9660 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:40.883789 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e327fff-813a-43e5-9f12-40249f2c9660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:40.886898 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e327fff-813a-43e5-9f12-40249f2c9660 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:40.886898 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e327fff-813a-43e5-9f12-40249f2c9660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:24:40.886898 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e327fff-813a-43e5-9f12-40249f2c9660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:40.889333 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e327fff-813a-43e5-9f12-40249f2c9660 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:40.904508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a0f0706d-3138-4aa2-8f31-64b14159f053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b30e301568f41d9a30aa66f73a9e1c3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:40.906263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a0f0706d-3138-4aa2-8f31-64b14159f053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b30e301568f41d9a30aa66f73a9e1c3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:40.920690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a0f0706d-3138-4aa2-8f31-64b14159f053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b30e301568f41d9a30aa66f73a9e1c3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:40.922779 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a0f0706d-3138-4aa2-8f31-64b14159f053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b30e301568f41d9a30aa66f73a9e1c3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:40.929916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 662/1332] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:24:40.932018 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e327fff-813a-43e5-9f12-40249f2c9660 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:40.936327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9e327fff-813a-43e5-9f12-40249f2c9660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:40.946073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a0f0706d-3138-4aa2-8f31-64b14159f053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b30e301568f41d9a30aa66f73a9e1c3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:40.973437 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e327fff-813a-43e5-9f12-40249f2c9660 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:40.988115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 671/1333] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:24:40 2022] DELETE /identity/v3/users/0b30e301568f41d9a30aa66f73a9e1c3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:41.106604 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcf3c1-36bd-41a2-8d2a-7afbe86efb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:41.107502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcf3c1-36bd-41a2-8d2a-7afbe86efb11 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:41.107733 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcf3c1-36bd-41a2-8d2a-7afbe86efb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:41.108327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcf3c1-36bd-41a2-8d2a-7afbe86efb11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:41.108997 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcf3c1-36bd-41a2-8d2a-7afbe86efb11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:41.112279 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcf3c1-36bd-41a2-8d2a-7afbe86efb11 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:41.167354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 663/1334] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:40 2022] POST /identity/v3/projects => generated 367 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:41.168583 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0706d-3138-4aa2-8f31-64b14159f053 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:41.179156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0706d-3138-4aa2-8f31-64b14159f053 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:41.232720 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:41.287968 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d0e01-b6ab-4ea5-8b85-99b341e90401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:41.288740 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0e01-b6ab-4ea5-8b85-99b341e90401 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:41.289123 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0e01-b6ab-4ea5-8b85-99b341e90401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:41.289495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0e01-b6ab-4ea5-8b85-99b341e90401 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:41.290899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d0e01-b6ab-4ea5-8b85-99b341e90401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:41.293384 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d0e01-b6ab-4ea5-8b85-99b341e90401 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:41.359045 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 672/1335] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:41 2022] POST /identity/v3/users => generated 284 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:41.365310 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcf3c1-36bd-41a2-8d2a-7afbe86efb11 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:41.385473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcf3c1-36bd-41a2-8d2a-7afbe86efb11 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:41.394314 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce77e65-edb1-4782-8b8b-bae52003f57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:41.395979 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce77e65-edb1-4782-8b8b-bae52003f57d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:41.396510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce77e65-edb1-4782-8b8b-bae52003f57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:41.397134 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce77e65-edb1-4782-8b8b-bae52003f57d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:41.398007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce77e65-edb1-4782-8b8b-bae52003f57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:41.399897 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce77e65-edb1-4782-8b8b-bae52003f57d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:41.417989 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 664/1336] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:41.420707 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d0e01-b6ab-4ea5-8b85-99b341e90401 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:41.434845 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d0e01-b6ab-4ea5-8b85-99b341e90401 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:41.443615 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0063a7-49a0-4b6c-9f9d-b04b710a49cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:41.445125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0063a7-49a0-4b6c-9f9d-b04b710a49cb admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:41.445665 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0063a7-49a0-4b6c-9f9d-b04b710a49cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:41.446288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0063a7-49a0-4b6c-9f9d-b04b710a49cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:41.449483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0063a7-49a0-4b6c-9f9d-b04b710a49cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:41.458835 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0063a7-49a0-4b6c-9f9d-b04b710a49cb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:41.475012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 673/1337] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:24:41.478911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce77e65-edb1-4782-8b8b-bae52003f57d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:41.494595 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce77e65-edb1-4782-8b8b-bae52003f57d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:41.510879 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89e1ed-5751-44a5-aec1-9ec527fa6c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:41.511997 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89e1ed-5751-44a5-aec1-9ec527fa6c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:41.512794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89e1ed-5751-44a5-aec1-9ec527fa6c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:41.513292 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89e1ed-5751-44a5-aec1-9ec527fa6c6b admin admin] PATH_INFO: `/v3/projects/22f80ca651ba48c4bafd51bc07f622b4/users/298a71cb1438458a8e80bb53f3c3b0e9/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:41.538988 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89e1ed-5751-44a5-aec1-9ec527fa6c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f80ca651ba48c4bafd51bc07f622b4, user_id=298a71cb1438458a8e80bb53f3c3b0e9, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:41.545016 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89e1ed-5751-44a5-aec1-9ec527fa6c6b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:41.545631 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0063a7-49a0-4b6c-9f9d-b04b710a49cb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:41.547574 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-aa0063a7-49a0-4b6c-9f9d-b04b710a49cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:41.579086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0063a7-49a0-4b6c-9f9d-b04b710a49cb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:41.593912 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 665/1338] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:41 2022] PUT /identity/v3/projects/22f80ca651ba48c4bafd51bc07f622b4/users/298a71cb1438458a8e80bb53f3c3b0e9/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:41.596277 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d05c28-2fb1-4b49-b0e2-69239d92c3f3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:41.596575 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d05c28-2fb1-4b49-b0e2-69239d92c3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:41.596877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d05c28-2fb1-4b49-b0e2-69239d92c3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:41.662186 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-26d05c28-2fb1-4b49-b0e2-69239d92c3f3 None None] MFA Rules not processed for user `298a71cb1438458a8e80bb53f3c3b0e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:41.674259 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-26d05c28-2fb1-4b49-b0e2-69239d92c3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:41.690839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c6387-892a-4631-8df3-3ca3b653f2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:41.692328 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c6387-892a-4631-8df3-3ca3b653f2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:41.692943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c6387-892a-4631-8df3-3ca3b653f2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:41.693451 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c6387-892a-4631-8df3-3ca3b653f2cb admin admin] PATH_INFO: `/v3/projects/75f95bea99204e5bbee31e92686a3191` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:41.711231 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c6387-892a-4631-8df3-3ca3b653f2cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=75f95bea99204e5bbee31e92686a3191)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:41.717903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c6387-892a-4631-8df3-3ca3b653f2cb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:41.850195 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:41.866123 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 666/1339] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:41.871348 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d05c28-2fb1-4b49-b0e2-69239d92c3f3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:41.894590 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b4c6387-892a-4631-8df3-3ca3b653f2cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75f95bea99204e5bbee31e92686a3191', 'request_id': 'req-1b4c6387-892a-4631-8df3-3ca3b653f2cb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:41.901167 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d05c28-2fb1-4b49-b0e2-69239d92c3f3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:41.911637 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b4c6387-892a-4631-8df3-3ca3b653f2cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75f95bea99204e5bbee31e92686a3191', 'request_id': 'req-1b4c6387-892a-4631-8df3-3ca3b653f2cb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:41.927815 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b4c6387-892a-4631-8df3-3ca3b653f2cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75f95bea99204e5bbee31e92686a3191', 'request_id': 'req-1b4c6387-892a-4631-8df3-3ca3b653f2cb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:41.965866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b4c6387-892a-4631-8df3-3ca3b653f2cb admin admin] The token cache is being invalidate because project 75f95bea99204e5bbee31e92686a3191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:24:41.967735 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b4c6387-892a-4631-8df3-3ca3b653f2cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:41.975530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b4c6387-892a-4631-8df3-3ca3b653f2cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:41.992527 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 674/1340] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:24:41 2022] DELETE /identity/v3/projects/75f95bea99204e5bbee31e92686a3191 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:24:41.999384 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920012d-4e78-4e7b-8d88-8d280cf6f651 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:42.001403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920012d-4e78-4e7b-8d88-8d280cf6f651 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:42.001936 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920012d-4e78-4e7b-8d88-8d280cf6f651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:42.107922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a7eb1-19fe-4a3c-abde-e2efc1338a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:42.108736 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a7eb1-19fe-4a3c-abde-e2efc1338a0a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:42.109280 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a7eb1-19fe-4a3c-abde-e2efc1338a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:42.109621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a7eb1-19fe-4a3c-abde-e2efc1338a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:42.110472 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a7eb1-19fe-4a3c-abde-e2efc1338a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:42.115103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a7eb1-19fe-4a3c-abde-e2efc1338a0a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:42.123317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1920012d-4e78-4e7b-8d88-8d280cf6f651 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:42.125851 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1920012d-4e78-4e7b-8d88-8d280cf6f651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:42.168927 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 675/1341] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:42.171020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd221681-c903-4401-b48c-592a3c422045 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:42.171404 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd221681-c903-4401-b48c-592a3c422045 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:42.171772 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd221681-c903-4401-b48c-592a3c422045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:42.222030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 667/1342] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:41 2022] POST /identity/v3/projects => generated 369 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:24:42.225969 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a7eb1-19fe-4a3c-abde-e2efc1338a0a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:42.239699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b62a7eb1-19fe-4a3c-abde-e2efc1338a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:42.243845 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cd221681-c903-4401-b48c-592a3c422045 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:42.245769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cd221681-c903-4401-b48c-592a3c422045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:42.320399 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:42.448222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 676/1343] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:24:42.453612 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd221681-c903-4401-b48c-592a3c422045 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:42.493081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd221681-c903-4401-b48c-592a3c422045 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:42.512272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a7eb1-19fe-4a3c-abde-e2efc1338a0a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:42.522376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff379c-aad6-4e76-bc70-82bf45fef1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:42.522742 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff379c-aad6-4e76-bc70-82bf45fef1eb admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:42.523020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff379c-aad6-4e76-bc70-82bf45fef1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:42.523327 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff379c-aad6-4e76-bc70-82bf45fef1eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:42.524096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff379c-aad6-4e76-bc70-82bf45fef1eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:24:42.524308 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff379c-aad6-4e76-bc70-82bf45fef1eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:42.525884 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff379c-aad6-4e76-bc70-82bf45fef1eb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:42.545122 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043e98a-7ba0-4d17-95bc-ec75bf97eaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:42.548979 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043e98a-7ba0-4d17-95bc-ec75bf97eaaf admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:42.549419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043e98a-7ba0-4d17-95bc-ec75bf97eaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:42.549777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043e98a-7ba0-4d17-95bc-ec75bf97eaaf admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:42.553574 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043e98a-7ba0-4d17-95bc-ec75bf97eaaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:42.555668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043e98a-7ba0-4d17-95bc-ec75bf97eaaf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:42.575157 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 677/1344] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:24:42.576115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff379c-aad6-4e76-bc70-82bf45fef1eb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:42.581113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a9ff379c-aad6-4e76-bc70-82bf45fef1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:42.612210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 668/1345] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:42 2022] POST /identity/v3/users => generated 291 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:42.613155 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043e98a-7ba0-4d17-95bc-ec75bf97eaaf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:42.639328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043e98a-7ba0-4d17-95bc-ec75bf97eaaf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:42.651602 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff379c-aad6-4e76-bc70-82bf45fef1eb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:42.654538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eea074-9240-4ad0-8cb2-81d9b6f8e230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:42.655214 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eea074-9240-4ad0-8cb2-81d9b6f8e230 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:42.655497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eea074-9240-4ad0-8cb2-81d9b6f8e230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:42.655779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eea074-9240-4ad0-8cb2-81d9b6f8e230 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:42.656443 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eea074-9240-4ad0-8cb2-81d9b6f8e230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:42.658405 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eea074-9240-4ad0-8cb2-81d9b6f8e230 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:42.663473 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fdb7b-3de6-44fc-9e3d-bfa43a454fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:42.664246 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fdb7b-3de6-44fc-9e3d-bfa43a454fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:42.664528 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fdb7b-3de6-44fc-9e3d-bfa43a454fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:42.664806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fdb7b-3de6-44fc-9e3d-bfa43a454fa1 admin admin] PATH_INFO: `/v3/users/3c9126a0159e4682990320d07459cde7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:42.673565 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fdb7b-3de6-44fc-9e3d-bfa43a454fa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c9126a0159e4682990320d07459cde7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:42.676866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fdb7b-3de6-44fc-9e3d-bfa43a454fa1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:42.727894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 669/1346] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:42 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:42.729279 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eea074-9240-4ad0-8cb2-81d9b6f8e230 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:42.776347 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f30fdb7b-3de6-44fc-9e3d-bfa43a454fa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c9126a0159e4682990320d07459cde7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:42.776887 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f30fdb7b-3de6-44fc-9e3d-bfa43a454fa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c9126a0159e4682990320d07459cde7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:42.799353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f30fdb7b-3de6-44fc-9e3d-bfa43a454fa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c9126a0159e4682990320d07459cde7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:42.800444 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f30fdb7b-3de6-44fc-9e3d-bfa43a454fa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c9126a0159e4682990320d07459cde7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:42.849052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:42.850022 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f30fdb7b-3de6-44fc-9e3d-bfa43a454fa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c9126a0159e4682990320d07459cde7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:42.884567 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eea074-9240-4ad0-8cb2-81d9b6f8e230 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:42.901413 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61597e99-74f2-40aa-9d8e-8f9191117683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:42.902059 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61597e99-74f2-40aa-9d8e-8f9191117683 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:42.902337 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61597e99-74f2-40aa-9d8e-8f9191117683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:42.902759 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61597e99-74f2-40aa-9d8e-8f9191117683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:42.903426 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61597e99-74f2-40aa-9d8e-8f9191117683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:42.905075 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61597e99-74f2-40aa-9d8e-8f9191117683 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:42.906509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 678/1347] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:24:42 2022] DELETE /identity/v3/users/3c9126a0159e4682990320d07459cde7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:42.908976 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fdb7b-3de6-44fc-9e3d-bfa43a454fa1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:42.914322 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f30fdb7b-3de6-44fc-9e3d-bfa43a454fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:42.938292 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 670/1348] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:42.940953 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805e08c-2103-4398-9ec1-381f024e6f23 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:42.944761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805e08c-2103-4398-9ec1-381f024e6f23 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:42.945284 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805e08c-2103-4398-9ec1-381f024e6f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:42.984759 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6805e08c-2103-4398-9ec1-381f024e6f23 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:42.986713 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6805e08c-2103-4398-9ec1-381f024e6f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:43.142137 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fdb7b-3de6-44fc-9e3d-bfa43a454fa1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:43.156525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54b4e9-cff7-4a4b-acd5-78503bd356ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:43.157177 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54b4e9-cff7-4a4b-acd5-78503bd356ea admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:43.157465 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54b4e9-cff7-4a4b-acd5-78503bd356ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:43.157740 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54b4e9-cff7-4a4b-acd5-78503bd356ea admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:43.158414 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54b4e9-cff7-4a4b-acd5-78503bd356ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:43.160459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54b4e9-cff7-4a4b-acd5-78503bd356ea admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:43.179341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 671/1349] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:43.181504 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805e08c-2103-4398-9ec1-381f024e6f23 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:43.189069 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6805e08c-2103-4398-9ec1-381f024e6f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:43.218528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805e08c-2103-4398-9ec1-381f024e6f23 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:43.236111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9bedc-4b25-487c-a29b-720277e052a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:43.236900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9bedc-4b25-487c-a29b-720277e052a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:43.237252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9bedc-4b25-487c-a29b-720277e052a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:43.237603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9bedc-4b25-487c-a29b-720277e052a3 admin admin] PATH_INFO: `/v3/projects/fa496b5f16654c50bf8f071a70f437f1/users/7bf9343478e346fe8186a2a46d6d42a3/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:43.240305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 679/1350] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:42 2022] POST /identity/v3/users => generated 288 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:43.241260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54b4e9-cff7-4a4b-acd5-78503bd356ea admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:43.280129 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54b4e9-cff7-4a4b-acd5-78503bd356ea admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:43.286278 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9bedc-4b25-487c-a29b-720277e052a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa496b5f16654c50bf8f071a70f437f1, user_id=7bf9343478e346fe8186a2a46d6d42a3, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:43.289310 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9bedc-4b25-487c-a29b-720277e052a3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:43.302683 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14975a12-b644-4088-828b-2f38497223ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:43.303310 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14975a12-b644-4088-828b-2f38497223ad admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:43.303599 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14975a12-b644-4088-828b-2f38497223ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:43.303869 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14975a12-b644-4088-828b-2f38497223ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:43.304592 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14975a12-b644-4088-828b-2f38497223ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:43.306192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14975a12-b644-4088-828b-2f38497223ad admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:43.326659 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 680/1351] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:43.329515 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 672/1352] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:43 2022] PUT /identity/v3/projects/fa496b5f16654c50bf8f071a70f437f1/users/7bf9343478e346fe8186a2a46d6d42a3/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:43.334146 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14975a12-b644-4088-828b-2f38497223ad admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:43.335241 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9bedc-4b25-487c-a29b-720277e052a3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:43.356517 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14975a12-b644-4088-828b-2f38497223ad admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:43.363447 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:43.578351 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a450b-26ec-4be1-8914-359329a35745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:43.579086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a450b-26ec-4be1-8914-359329a35745 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:43.579244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a450b-26ec-4be1-8914-359329a35745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:43.579515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a450b-26ec-4be1-8914-359329a35745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:43.580194 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a450b-26ec-4be1-8914-359329a35745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:43.581711 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9bedc-4b25-487c-a29b-720277e052a3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:43.582139 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a450b-26ec-4be1-8914-359329a35745 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:43.594911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c062088-b7bc-403d-a343-14ddb3413225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:43.595867 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c062088-b7bc-403d-a343-14ddb3413225 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:43.596388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c062088-b7bc-403d-a343-14ddb3413225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:43.596889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c062088-b7bc-403d-a343-14ddb3413225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:43.597779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c062088-b7bc-403d-a343-14ddb3413225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:43.601102 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c062088-b7bc-403d-a343-14ddb3413225 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:43.626406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 673/1353] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:43.627390 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c062088-b7bc-403d-a343-14ddb3413225 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:43.636832 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3c062088-b7bc-403d-a343-14ddb3413225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:43.663733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 681/1354] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:43.665001 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a450b-26ec-4be1-8914-359329a35745 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:43.700905 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a450b-26ec-4be1-8914-359329a35745 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:43.722248 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b6046-41d3-45ac-8c01-f21b6d72f5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:43.724525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b6046-41d3-45ac-8c01-f21b6d72f5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:43.724976 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b6046-41d3-45ac-8c01-f21b6d72f5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:43.725611 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b6046-41d3-45ac-8c01-f21b6d72f5d1 admin admin] PATH_INFO: `/v3/projects/fa496b5f16654c50bf8f071a70f437f1/users/7bf9343478e346fe8186a2a46d6d42a3/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:43.732847 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b6046-41d3-45ac-8c01-f21b6d72f5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa496b5f16654c50bf8f071a70f437f1, user_id=7bf9343478e346fe8186a2a46d6d42a3, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:43.744779 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b6046-41d3-45ac-8c01-f21b6d72f5d1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:43.784492 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 682/1355] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:43 2022] PUT /identity/v3/projects/fa496b5f16654c50bf8f071a70f437f1/users/7bf9343478e346fe8186a2a46d6d42a3/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:43.797671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b6046-41d3-45ac-8c01-f21b6d72f5d1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:43.823640 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c062088-b7bc-403d-a343-14ddb3413225 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:43.855881 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:43.960700 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b6cb1-684c-4c0d-ab25-14f492adbb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:43.961364 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b6cb1-684c-4c0d-ab25-14f492adbb3a service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:43.962861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b6cb1-684c-4c0d-ab25-14f492adbb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:43.963150 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b6cb1-684c-4c0d-ab25-14f492adbb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:44.041602 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b6046-41d3-45ac-8c01-f21b6d72f5d1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:44.063337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8647b6-6d1a-49f3-b497-5f6a5ceee671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:44.064972 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8647b6-6d1a-49f3-b497-5f6a5ceee671 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:44.065503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8647b6-6d1a-49f3-b497-5f6a5ceee671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:44.065992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8647b6-6d1a-49f3-b497-5f6a5ceee671 admin admin] PATH_INFO: `/v3/projects/7f13da24ba3741b9945460cd7742a681/users/4f85da82b19d41c28ecfda8f276d5ad6/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:44.110222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8647b6-6d1a-49f3-b497-5f6a5ceee671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f13da24ba3741b9945460cd7742a681, user_id=4f85da82b19d41c28ecfda8f276d5ad6, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:44.121068 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8647b6-6d1a-49f3-b497-5f6a5ceee671 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:44.149428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 683/1356] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:43 2022] PUT /identity/v3/projects/7f13da24ba3741b9945460cd7742a681/users/4f85da82b19d41c28ecfda8f276d5ad6/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:44.150888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddeee1-7bcf-4120-bbfa-d61ccfb041d9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:44.151266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddeee1-7bcf-4120-bbfa-d61ccfb041d9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:44.151638 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddeee1-7bcf-4120-bbfa-d61ccfb041d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:44.173198 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b6cb1-684c-4c0d-ab25-14f492adbb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:44.177573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b6cb1-684c-4c0d-ab25-14f492adbb3a service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:44.206896 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 674/1357] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:44.210549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2ea06-9642-4e15-993f-d4ec3d10f4de None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:44.210811 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2ea06-9642-4e15-993f-d4ec3d10f4de None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:44.211091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2ea06-9642-4e15-993f-d4ec3d10f4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:44.235821 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4bddeee1-7bcf-4120-bbfa-d61ccfb041d9 None None] MFA Rules not processed for user `7bf9343478e346fe8186a2a46d6d42a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:44.237058 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4bddeee1-7bcf-4120-bbfa-d61ccfb041d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:44.281349 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-09e2ea06-9642-4e15-993f-d4ec3d10f4de None None] MFA Rules not processed for user `4f85da82b19d41c28ecfda8f276d5ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:44.282720 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-09e2ea06-9642-4e15-993f-d4ec3d10f4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:44.499708 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 675/1358] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:44.507367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2ea06-9642-4e15-993f-d4ec3d10f4de None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:44.507886 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:44.540684 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 684/1359] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:44.556789 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddeee1-7bcf-4120-bbfa-d61ccfb041d9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:44.559059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4bddeee1-7bcf-4120-bbfa-d61ccfb041d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:44.719959 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:44.721120 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddeee1-7bcf-4120-bbfa-d61ccfb041d9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:44.730784 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480acfed-bc31-4914-b8a2-d83dc9c88aa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:44.731152 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480acfed-bc31-4914-b8a2-d83dc9c88aa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:44.731394 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480acfed-bc31-4914-b8a2-d83dc9c88aa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:44.731678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480acfed-bc31-4914-b8a2-d83dc9c88aa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:44.743575 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2ea06-9642-4e15-993f-d4ec3d10f4de None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:44.759049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1470a-d470-4b69-923d-d54c5374b4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:44.761057 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1470a-d470-4b69-923d-d54c5374b4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:44.761828 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1470a-d470-4b69-923d-d54c5374b4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:44.761942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480acfed-bc31-4914-b8a2-d83dc9c88aa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:44.765112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1470a-d470-4b69-923d-d54c5374b4b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:44.765665 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480acfed-bc31-4914-b8a2-d83dc9c88aa2 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:44.770946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1470a-d470-4b69-923d-d54c5374b4b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:44.773383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1470a-d470-4b69-923d-d54c5374b4b7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:44.798541 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 685/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:24:44.886008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 676/1361] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:44 2022] POST /identity/v3/projects => generated 379 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:44.886907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480acfed-bc31-4914-b8a2-d83dc9c88aa2 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:44.913335 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480acfed-bc31-4914-b8a2-d83dc9c88aa2 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:45.070533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffa5dd-b4e7-49f7-96ee-06d9ca1c16f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:45.071284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffa5dd-b4e7-49f7-96ee-06d9ca1c16f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:45.071468 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffa5dd-b4e7-49f7-96ee-06d9ca1c16f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:45.071708 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffa5dd-b4e7-49f7-96ee-06d9ca1c16f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:45.072783 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffa5dd-b4e7-49f7-96ee-06d9ca1c16f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:45.074369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffa5dd-b4e7-49f7-96ee-06d9ca1c16f0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:45.116333 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 686/1362] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:44 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:24:45.120737 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1470a-d470-4b69-923d-d54c5374b4b7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:45.138476 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1470a-d470-4b69-923d-d54c5374b4b7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:45.155652 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9a8ef-9e63-413b-a29f-1bafecee8a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:45.161521 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9a8ef-9e63-413b-a29f-1bafecee8a04 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:45.161860 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9a8ef-9e63-413b-a29f-1bafecee8a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:45.162146 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9a8ef-9e63-413b-a29f-1bafecee8a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:45.162843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9a8ef-9e63-413b-a29f-1bafecee8a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:45.164794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9a8ef-9e63-413b-a29f-1bafecee8a04 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:45.218306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffa5dd-b4e7-49f7-96ee-06d9ca1c16f0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:45.220716 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 677/1363] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:45.239578 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffa5dd-b4e7-49f7-96ee-06d9ca1c16f0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:45.251566 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa48b6-fdf5-4617-ba1c-f44b71b545be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:45.262679 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa48b6-fdf5-4617-ba1c-f44b71b545be admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:45.263177 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa48b6-fdf5-4617-ba1c-f44b71b545be admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:45.264162 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa48b6-fdf5-4617-ba1c-f44b71b545be admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:45.266754 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa48b6-fdf5-4617-ba1c-f44b71b545be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:45.270420 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa48b6-fdf5-4617-ba1c-f44b71b545be admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:45.302434 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 687/1364] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:24:45.304500 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9a8ef-9e63-413b-a29f-1bafecee8a04 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:45.316728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9a8ef-9e63-413b-a29f-1bafecee8a04 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:45.329439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e4f82-d692-439d-948e-4284f3d6fbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:45.333928 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e4f82-d692-439d-948e-4284f3d6fbaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:45.334445 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e4f82-d692-439d-948e-4284f3d6fbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:45.334904 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e4f82-d692-439d-948e-4284f3d6fbaa admin admin] PATH_INFO: `/v3/projects/3744fa929d6548518d549f79983e1d9c/users/3283a856f4644457a20f84124a9574fd/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:45.388602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e4f82-d692-439d-948e-4284f3d6fbaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3744fa929d6548518d549f79983e1d9c, user_id=3283a856f4644457a20f84124a9574fd, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:45.392574 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e4f82-d692-439d-948e-4284f3d6fbaa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:45.410500 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 678/1365] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:45 2022] PUT /identity/v3/projects/3744fa929d6548518d549f79983e1d9c/users/3283a856f4644457a20f84124a9574fd/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:45.429135 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c734793-aea1-45db-b8de-0ae34852c3d1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:45.432527 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c734793-aea1-45db-b8de-0ae34852c3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:45.433026 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c734793-aea1-45db-b8de-0ae34852c3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:45.519153 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7c734793-aea1-45db-b8de-0ae34852c3d1 None None] MFA Rules not processed for user `3283a856f4644457a20f84124a9574fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:45.522903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7c734793-aea1-45db-b8de-0ae34852c3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:45.642946 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 688/1366] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:45.644598 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e4f82-d692-439d-948e-4284f3d6fbaa admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:45.806429 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e4f82-d692-439d-948e-4284f3d6fbaa admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:45.838011 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a9614-f357-4b22-9ec6-62c605bd287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:45.841001 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a9614-f357-4b22-9ec6-62c605bd287f admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:45.841255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a9614-f357-4b22-9ec6-62c605bd287f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:45.843104 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a9614-f357-4b22-9ec6-62c605bd287f admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:45.844194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a9614-f357-4b22-9ec6-62c605bd287f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:45.851971 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a9614-f357-4b22-9ec6-62c605bd287f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:45.931952 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 679/1367] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:45 2022] POST /identity/v3/projects => generated 379 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:45.934346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c734793-aea1-45db-b8de-0ae34852c3d1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:45.952753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c734793-aea1-45db-b8de-0ae34852c3d1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:45.972287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:46.054441 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4609f8-5f43-42fe-b941-b21fb5a41ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:46.056023 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4609f8-5f43-42fe-b941-b21fb5a41ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:46.062088 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4609f8-5f43-42fe-b941-b21fb5a41ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:46.062557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4609f8-5f43-42fe-b941-b21fb5a41ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:46.063359 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4609f8-5f43-42fe-b941-b21fb5a41ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:46.074061 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4609f8-5f43-42fe-b941-b21fb5a41ff1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:46.105761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 689/1368] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:45 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:46.115479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a9614-f357-4b22-9ec6-62c605bd287f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:46.130908 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a9614-f357-4b22-9ec6-62c605bd287f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:46.137780 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133175f-2676-475d-a4d2-7dd091729ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:46.138610 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133175f-2676-475d-a4d2-7dd091729ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:46.138893 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133175f-2676-475d-a4d2-7dd091729ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:46.139315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133175f-2676-475d-a4d2-7dd091729ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:46.140124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133175f-2676-475d-a4d2-7dd091729ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:46.143088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133175f-2676-475d-a4d2-7dd091729ccf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:46.177425 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4609f8-5f43-42fe-b941-b21fb5a41ff1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:46.177872 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 680/1369] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:46.194148 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4609f8-5f43-42fe-b941-b21fb5a41ff1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:46.206357 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fb222-ee8c-4fe4-9e2e-0b7334a2fb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:46.207095 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fb222-ee8c-4fe4-9e2e-0b7334a2fb76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:46.207379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fb222-ee8c-4fe4-9e2e-0b7334a2fb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:46.210403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fb222-ee8c-4fe4-9e2e-0b7334a2fb76 admin admin] PATH_INFO: `/v3/projects/85bfe589ecd54c66b288f79f138be596/users/0ed0bcd4868941a6885e0cea9389978b/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:46.264769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fb222-ee8c-4fe4-9e2e-0b7334a2fb76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bfe589ecd54c66b288f79f138be596, user_id=0ed0bcd4868941a6885e0cea9389978b, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:46.268443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fb222-ee8c-4fe4-9e2e-0b7334a2fb76 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:46.303881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 690/1370] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:46 2022] PUT /identity/v3/projects/85bfe589ecd54c66b288f79f138be596/users/0ed0bcd4868941a6885e0cea9389978b/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:46.308194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133175f-2676-475d-a4d2-7dd091729ccf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:46.325733 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133175f-2676-475d-a4d2-7dd091729ccf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:46.542571 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6512479-5692-4b62-8fc0-2ebf47e00824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:46.543215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6512479-5692-4b62-8fc0-2ebf47e00824 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:46.543491 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6512479-5692-4b62-8fc0-2ebf47e00824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:46.543761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6512479-5692-4b62-8fc0-2ebf47e00824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:46.544458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6512479-5692-4b62-8fc0-2ebf47e00824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:46.546080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6512479-5692-4b62-8fc0-2ebf47e00824 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:46.590104 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fb222-ee8c-4fe4-9e2e-0b7334a2fb76 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:46.600000 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 681/1371] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:46.616704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fb222-ee8c-4fe4-9e2e-0b7334a2fb76 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:46.629047 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6191d-6e5b-466f-a3cc-936ba7d7f4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:46.639445 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6191d-6e5b-466f-a3cc-936ba7d7f4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:46.639802 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6191d-6e5b-466f-a3cc-936ba7d7f4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:46.642294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6191d-6e5b-466f-a3cc-936ba7d7f4f7 admin admin] PATH_INFO: `/v3/projects/85bfe589ecd54c66b288f79f138be596/users/0ed0bcd4868941a6885e0cea9389978b/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:46.646824 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6191d-6e5b-466f-a3cc-936ba7d7f4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bfe589ecd54c66b288f79f138be596, user_id=0ed0bcd4868941a6885e0cea9389978b, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:46.654783 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6191d-6e5b-466f-a3cc-936ba7d7f4f7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:46.685543 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 691/1372] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:46 2022] PUT /identity/v3/projects/85bfe589ecd54c66b288f79f138be596/users/0ed0bcd4868941a6885e0cea9389978b/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:46.696863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34e415-42eb-46ee-8109-c9f4b0030999 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:46.697395 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34e415-42eb-46ee-8109-c9f4b0030999 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:46.698564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34e415-42eb-46ee-8109-c9f4b0030999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:46.755976 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4d34e415-42eb-46ee-8109-c9f4b0030999 None None] MFA Rules not processed for user `0ed0bcd4868941a6885e0cea9389978b`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:46.771738 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4d34e415-42eb-46ee-8109-c9f4b0030999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:46.777360 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:46.911275 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6191d-6e5b-466f-a3cc-936ba7d7f4f7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:46.914139 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b6b6191d-6e5b-466f-a3cc-936ba7d7f4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:46.935387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 682/1373] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:46.964097 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34e415-42eb-46ee-8109-c9f4b0030999 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:47.083300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6191d-6e5b-466f-a3cc-936ba7d7f4f7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:47.098991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a4c2b-b880-4c22-996b-f3892d8fbece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:47.099855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a4c2b-b880-4c22-996b-f3892d8fbece admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:47.100497 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a4c2b-b880-4c22-996b-f3892d8fbece admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:47.101657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a4c2b-b880-4c22-996b-f3892d8fbece admin admin] PATH_INFO: `/v3/projects/e02bc7a1a6b04e1f83d2165d422f0c8b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:47.105807 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a4c2b-b880-4c22-996b-f3892d8fbece admin admin] RBAC: Authorizing `identity:delete_project(project_id=e02bc7a1a6b04e1f83d2165d422f0c8b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:47.108272 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a4c2b-b880-4c22-996b-f3892d8fbece admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:47.117889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34e415-42eb-46ee-8109-c9f4b0030999 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:47.122218 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93009d95-759e-4654-a670-ae3865247f3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:47.123143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93009d95-759e-4654-a670-ae3865247f3a service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:47.123502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93009d95-759e-4654-a670-ae3865247f3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:47.123846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93009d95-759e-4654-a670-ae3865247f3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:47.159137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93009d95-759e-4654-a670-ae3865247f3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:47.161847 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93009d95-759e-4654-a670-ae3865247f3a service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:47.201286 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 683/1374] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:24:47.232845 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c97a4c2b-b880-4c22-996b-f3892d8fbece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e02bc7a1a6b04e1f83d2165d422f0c8b', 'request_id': 'req-c97a4c2b-b880-4c22-996b-f3892d8fbece'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:47.251495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c97a4c2b-b880-4c22-996b-f3892d8fbece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e02bc7a1a6b04e1f83d2165d422f0c8b', 'request_id': 'req-c97a4c2b-b880-4c22-996b-f3892d8fbece'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:47.261567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c97a4c2b-b880-4c22-996b-f3892d8fbece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e02bc7a1a6b04e1f83d2165d422f0c8b', 'request_id': 'req-c97a4c2b-b880-4c22-996b-f3892d8fbece'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:47.282173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:47.305686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c97a4c2b-b880-4c22-996b-f3892d8fbece admin admin] The token cache is being invalidate because project e02bc7a1a6b04e1f83d2165d422f0c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:24:47.306313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c97a4c2b-b880-4c22-996b-f3892d8fbece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:47.307120 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c97a4c2b-b880-4c22-996b-f3892d8fbece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:47.311678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 692/1375] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:24:46 2022] DELETE /identity/v3/projects/e02bc7a1a6b04e1f83d2165d422f0c8b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:47.312990 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93009d95-759e-4654-a670-ae3865247f3a service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:47.329166 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93009d95-759e-4654-a670-ae3865247f3a service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:47.365593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a4c2b-b880-4c22-996b-f3892d8fbece admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:47.367511 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c97a4c2b-b880-4c22-996b-f3892d8fbece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:47.452951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13a3c2-c356-44bf-8481-f38e21e0d964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:47.454349 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a3c2-c356-44bf-8481-f38e21e0d964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:47.454635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a3c2-c356-44bf-8481-f38e21e0d964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:47.454912 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a3c2-c356-44bf-8481-f38e21e0d964 admin admin] PATH_INFO: `/v3/users/9513f39706184d5bbc6f0c93a7fdeb6d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:47.456125 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13a3c2-c356-44bf-8481-f38e21e0d964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9513f39706184d5bbc6f0c93a7fdeb6d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:47.462863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13a3c2-c356-44bf-8481-f38e21e0d964 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:47.597235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a4c2b-b880-4c22-996b-f3892d8fbece admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:47.604307 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:47.609549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cb13a3c2-c356-44bf-8481-f38e21e0d964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9513f39706184d5bbc6f0c93a7fdeb6d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:47.609985 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2033c11-bffa-446e-8add-324075a8227e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:47.610704 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cb13a3c2-c356-44bf-8481-f38e21e0d964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9513f39706184d5bbc6f0c93a7fdeb6d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:47.611125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2033c11-bffa-446e-8add-324075a8227e service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:47.611413 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2033c11-bffa-446e-8add-324075a8227e service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:47.612379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2033c11-bffa-446e-8add-324075a8227e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:47.619018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c2033c11-bffa-446e-8add-324075a8227e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:47.631353 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cb13a3c2-c356-44bf-8481-f38e21e0d964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9513f39706184d5bbc6f0c93a7fdeb6d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:47.633245 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cb13a3c2-c356-44bf-8481-f38e21e0d964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9513f39706184d5bbc6f0c93a7fdeb6d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:47.654623 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cb13a3c2-c356-44bf-8481-f38e21e0d964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9513f39706184d5bbc6f0c93a7fdeb6d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:47.702750 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 684/1376] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:24:47 2022] DELETE /identity/v3/users/9513f39706184d5bbc6f0c93a7fdeb6d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:47.768490 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2033c11-bffa-446e-8add-324075a8227e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:47.772321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2033c11-bffa-446e-8add-324075a8227e service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:47.827017 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 693/1377] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:24:48.149057 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13a3c2-c356-44bf-8481-f38e21e0d964 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:48.151830 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cb13a3c2-c356-44bf-8481-f38e21e0d964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:48.289214 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13a3c2-c356-44bf-8481-f38e21e0d964 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:48.298406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e758c-bd8f-4e47-b78d-737bf0bb0b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:48.299079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e758c-bd8f-4e47-b78d-737bf0bb0b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:48.299419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e758c-bd8f-4e47-b78d-737bf0bb0b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:48.300268 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e758c-bd8f-4e47-b78d-737bf0bb0b5a admin admin] PATH_INFO: `/v3/users/298a71cb1438458a8e80bb53f3c3b0e9` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:48.303913 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e758c-bd8f-4e47-b78d-737bf0bb0b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=298a71cb1438458a8e80bb53f3c3b0e9)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:48.309890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e758c-bd8f-4e47-b78d-737bf0bb0b5a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:48.431327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6b0e758c-bd8f-4e47-b78d-737bf0bb0b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298a71cb1438458a8e80bb53f3c3b0e9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:48.432443 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6b0e758c-bd8f-4e47-b78d-737bf0bb0b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298a71cb1438458a8e80bb53f3c3b0e9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:48.449664 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6b0e758c-bd8f-4e47-b78d-737bf0bb0b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298a71cb1438458a8e80bb53f3c3b0e9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:48.450702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6b0e758c-bd8f-4e47-b78d-737bf0bb0b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298a71cb1438458a8e80bb53f3c3b0e9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:48.471896 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6b0e758c-bd8f-4e47-b78d-737bf0bb0b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298a71cb1438458a8e80bb53f3c3b0e9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:48.546643 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 685/1378] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:24:48 2022] DELETE /identity/v3/users/298a71cb1438458a8e80bb53f3c3b0e9 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:48.569107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498fecf-87d5-4ea3-9d4d-6fa59bb5a10f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:48.569554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498fecf-87d5-4ea3-9d4d-6fa59bb5a10f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:48.569554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498fecf-87d5-4ea3-9d4d-6fa59bb5a10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:48.614794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7498fecf-87d5-4ea3-9d4d-6fa59bb5a10f None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:48.616395 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7498fecf-87d5-4ea3-9d4d-6fa59bb5a10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:48.806248 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 694/1379] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:48.820631 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e758c-bd8f-4e47-b78d-737bf0bb0b5a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:48.822089 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6b0e758c-bd8f-4e47-b78d-737bf0bb0b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:48.835243 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498fecf-87d5-4ea3-9d4d-6fa59bb5a10f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:48.837035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7498fecf-87d5-4ea3-9d4d-6fa59bb5a10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:48.851337 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e758c-bd8f-4e47-b78d-737bf0bb0b5a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:48.868361 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2610f77-433e-4e01-89a6-b66f445f0ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:48.869113 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2610f77-433e-4e01-89a6-b66f445f0ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:48.869451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2610f77-433e-4e01-89a6-b66f445f0ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:48.869984 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2610f77-433e-4e01-89a6-b66f445f0ccf admin admin] PATH_INFO: `/v3/users/1e8f424a6f314b1086e067483127392b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:48.872687 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2610f77-433e-4e01-89a6-b66f445f0ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8f424a6f314b1086e067483127392b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:48.875024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2610f77-433e-4e01-89a6-b66f445f0ccf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:48.951507 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:48.961890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=80,keystone:INSERT=2,keystone:DELETE=18 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:48.970397 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498fecf-87d5-4ea3-9d4d-6fa59bb5a10f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:48.982307 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a2610f77-433e-4e01-89a6-b66f445f0ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8f424a6f314b1086e067483127392b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:48.984072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc9d61-bea1-46be-9e5a-b7c55179320f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:48.984626 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a2610f77-433e-4e01-89a6-b66f445f0ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8f424a6f314b1086e067483127392b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:48.985469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc9d61-bea1-46be-9e5a-b7c55179320f service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:48.987315 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc9d61-bea1-46be-9e5a-b7c55179320f service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:48.987820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc9d61-bea1-46be-9e5a-b7c55179320f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:49.003965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a2610f77-433e-4e01-89a6-b66f445f0ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8f424a6f314b1086e067483127392b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:49.006607 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a2610f77-433e-4e01-89a6-b66f445f0ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8f424a6f314b1086e067483127392b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:49.012130 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc9d61-bea1-46be-9e5a-b7c55179320f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:49.014715 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc9d61-bea1-46be-9e5a-b7c55179320f service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:49.025036 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a2610f77-433e-4e01-89a6-b66f445f0ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8f424a6f314b1086e067483127392b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:49.045402 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 695/1380] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:49.057272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 686/1381] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:24:48 2022] DELETE /identity/v3/users/1e8f424a6f314b1086e067483127392b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:49.061761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5085b2-1ba8-4519-8af8-47dff2722f77 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:49.061761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5085b2-1ba8-4519-8af8-47dff2722f77 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:49.061761 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5085b2-1ba8-4519-8af8-47dff2722f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:49.100587 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5a5085b2-1ba8-4519-8af8-47dff2722f77 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:49.105416 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5a5085b2-1ba8-4519-8af8-47dff2722f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:49.235406 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 696/1382] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:49.273111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2610f77-433e-4e01-89a6-b66f445f0ccf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:49.274862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a2610f77-433e-4e01-89a6-b66f445f0ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:49.432797 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2610f77-433e-4e01-89a6-b66f445f0ccf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:49.441510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f9bef-ef5c-4561-a2fa-107fc0dd001e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:49.442677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f9bef-ef5c-4561-a2fa-107fc0dd001e service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:49.442954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f9bef-ef5c-4561-a2fa-107fc0dd001e service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:49.443239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f9bef-ef5c-4561-a2fa-107fc0dd001e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:49.468327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f9bef-ef5c-4561-a2fa-107fc0dd001e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:49.469806 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f9bef-ef5c-4561-a2fa-107fc0dd001e service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:49.500383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 687/1383] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:49.803639 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5085b2-1ba8-4519-8af8-47dff2722f77 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:49.805217 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5a5085b2-1ba8-4519-8af8-47dff2722f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:49.826192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5085b2-1ba8-4519-8af8-47dff2722f77 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:49.840379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a413b39-860d-4c38-b87c-10e5262e6745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:49.843650 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a413b39-860d-4c38-b87c-10e5262e6745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:49.847124 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a413b39-860d-4c38-b87c-10e5262e6745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:49.848002 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a413b39-860d-4c38-b87c-10e5262e6745 admin admin] PATH_INFO: `/v3/projects/80235a75b263403d94894f25dd8f8996` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:49.852985 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a413b39-860d-4c38-b87c-10e5262e6745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80235a75b263403d94894f25dd8f8996)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:49.855819 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a413b39-860d-4c38-b87c-10e5262e6745 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:49.976878 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1a413b39-860d-4c38-b87c-10e5262e6745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80235a75b263403d94894f25dd8f8996', 'request_id': 'req-1a413b39-860d-4c38-b87c-10e5262e6745'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:49.990970 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1a413b39-860d-4c38-b87c-10e5262e6745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80235a75b263403d94894f25dd8f8996', 'request_id': 'req-1a413b39-860d-4c38-b87c-10e5262e6745'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:50.001840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1a413b39-860d-4c38-b87c-10e5262e6745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80235a75b263403d94894f25dd8f8996', 'request_id': 'req-1a413b39-860d-4c38-b87c-10e5262e6745'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:50.037122 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1a413b39-860d-4c38-b87c-10e5262e6745 admin admin] The token cache is being invalidate because project 80235a75b263403d94894f25dd8f8996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:24:50.037423 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1a413b39-860d-4c38-b87c-10e5262e6745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:50.039575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1a413b39-860d-4c38-b87c-10e5262e6745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:50.048292 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce46a8f-ec14-4f3e-b908-27d46d728e0c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:50.048590 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce46a8f-ec14-4f3e-b908-27d46d728e0c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:50.048868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce46a8f-ec14-4f3e-b908-27d46d728e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:50.053996 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 697/1384] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:24:49 2022] DELETE /identity/v3/projects/80235a75b263403d94894f25dd8f8996 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:50.086893 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9ce46a8f-ec14-4f3e-b908-27d46d728e0c None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:50.088173 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9ce46a8f-ec14-4f3e-b908-27d46d728e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:50.264616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b18088-2ae6-40d0-a6d2-7bf81895fb41 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:50.265014 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 688/1385] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:50.265163 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b18088-2ae6-40d0-a6d2-7bf81895fb41 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:50.265905 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b18088-2ae6-40d0-a6d2-7bf81895fb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:50.318016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-99b18088-2ae6-40d0-a6d2-7bf81895fb41 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:50.319852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-99b18088-2ae6-40d0-a6d2-7bf81895fb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:50.332255 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 698/1386] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:50.336350 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce46a8f-ec14-4f3e-b908-27d46d728e0c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:50.359470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce46a8f-ec14-4f3e-b908-27d46d728e0c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:50.367039 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651e7a4-0c23-4ccb-b0b7-25eb4be31673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:50.367874 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651e7a4-0c23-4ccb-b0b7-25eb4be31673 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:50.368890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651e7a4-0c23-4ccb-b0b7-25eb4be31673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:50.369485 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651e7a4-0c23-4ccb-b0b7-25eb4be31673 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:50.370635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651e7a4-0c23-4ccb-b0b7-25eb4be31673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:24:50.371087 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651e7a4-0c23-4ccb-b0b7-25eb4be31673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:50.373285 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651e7a4-0c23-4ccb-b0b7-25eb4be31673 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:50.417939 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b18088-2ae6-40d0-a6d2-7bf81895fb41 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:50.441491 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 689/1387] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:24:50.442912 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b18088-2ae6-40d0-a6d2-7bf81895fb41 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:50.454306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef88d3-c63a-49f7-9e77-30ec82e3ba6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:50.455808 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef88d3-c63a-49f7-9e77-30ec82e3ba6f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:50.456909 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef88d3-c63a-49f7-9e77-30ec82e3ba6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:50.458492 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef88d3-c63a-49f7-9e77-30ec82e3ba6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:50.459503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef88d3-c63a-49f7-9e77-30ec82e3ba6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:50.469809 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef88d3-c63a-49f7-9e77-30ec82e3ba6f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:50.547692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 699/1388] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:50 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:50.552149 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651e7a4-0c23-4ccb-b0b7-25eb4be31673 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:50.566147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651e7a4-0c23-4ccb-b0b7-25eb4be31673 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:50.677558 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:50.737027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbada4f-aca8-477f-8cb5-ff20b4e7866a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:50.737458 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbada4f-aca8-477f-8cb5-ff20b4e7866a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:50.737888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbada4f-aca8-477f-8cb5-ff20b4e7866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:50.775578 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7c218-e22b-4a59-99b2-52de844f337a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:50.779882 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7c218-e22b-4a59-99b2-52de844f337a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:50.783316 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7c218-e22b-4a59-99b2-52de844f337a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:50.784437 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7c218-e22b-4a59-99b2-52de844f337a admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:50.789494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7c218-e22b-4a59-99b2-52de844f337a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:50.796114 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7c218-e22b-4a59-99b2-52de844f337a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:50.880815 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9cbada4f-aca8-477f-8cb5-ff20b4e7866a None None] MFA Rules not processed for user `df6a4914e6f0486683abf7740dd0c863`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:50.886527 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9cbada4f-aca8-477f-8cb5-ff20b4e7866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:50.889408 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 690/1389] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:50 2022] POST /identity/v3/users => generated 290 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:50.893348 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7c218-e22b-4a59-99b2-52de844f337a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:50.919157 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7c218-e22b-4a59-99b2-52de844f337a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:50.929487 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071a588-793c-4ac9-a50b-8d3b0c43d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:50.930533 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071a588-793c-4ac9-a50b-8d3b0c43d854 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:50.941050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071a588-793c-4ac9-a50b-8d3b0c43d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:50.941629 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071a588-793c-4ac9-a50b-8d3b0c43d854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:50.948173 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071a588-793c-4ac9-a50b-8d3b0c43d854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:50.950652 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071a588-793c-4ac9-a50b-8d3b0c43d854 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:50.981465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 691/1390] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:50.983619 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071a588-793c-4ac9-a50b-8d3b0c43d854 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:51.012642 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071a588-793c-4ac9-a50b-8d3b0c43d854 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:51.018053 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:51.026481 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d78e8f-b0e3-4dc8-98ac-da71eae66758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:51.028055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d78e8f-b0e3-4dc8-98ac-da71eae66758 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:51.030799 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d78e8f-b0e3-4dc8-98ac-da71eae66758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:51.031236 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d78e8f-b0e3-4dc8-98ac-da71eae66758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:51.032074 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d78e8f-b0e3-4dc8-98ac-da71eae66758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:51.034138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d78e8f-b0e3-4dc8-98ac-da71eae66758 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:51.068270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 692/1391] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:51.077277 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d78e8f-b0e3-4dc8-98ac-da71eae66758 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:51.088759 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f6d78e8f-b0e3-4dc8-98ac-da71eae66758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:51.115048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 700/1392] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:24:51.116204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbada4f-aca8-477f-8cb5-ff20b4e7866a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:51.127647 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d78e8f-b0e3-4dc8-98ac-da71eae66758 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:51.141670 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe5433-d83b-4f90-97a9-13ff088aaa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:51.142349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbada4f-aca8-477f-8cb5-ff20b4e7866a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:51.142643 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5433-d83b-4f90-97a9-13ff088aaa93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:51.143570 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5433-d83b-4f90-97a9-13ff088aaa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:51.144129 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5433-d83b-4f90-97a9-13ff088aaa93 admin admin] PATH_INFO: `/v3/projects/5e1a1f34daba4db8b446ac88ff64e5c0` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:51.147192 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe5433-d83b-4f90-97a9-13ff088aaa93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e1a1f34daba4db8b446ac88ff64e5c0)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:51.155716 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe5433-d83b-4f90-97a9-13ff088aaa93 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:51.156392 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cb712-ccb1-4a8a-abd8-472f4e6d4568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:51.157078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cb712-ccb1-4a8a-abd8-472f4e6d4568 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:51.157587 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cb712-ccb1-4a8a-abd8-472f4e6d4568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:51.158065 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cb712-ccb1-4a8a-abd8-472f4e6d4568 admin admin] PATH_INFO: `/v3/projects/6351bf33dfc443b392bf12b1e990b4ab/users/452f57b8376847fba2d6fa615a6cf4c6/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:51.196942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864cb712-ccb1-4a8a-abd8-472f4e6d4568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6351bf33dfc443b392bf12b1e990b4ab, user_id=452f57b8376847fba2d6fa615a6cf4c6, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:51.200053 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864cb712-ccb1-4a8a-abd8-472f4e6d4568 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:51.226749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 701/1393] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:51 2022] PUT /identity/v3/projects/6351bf33dfc443b392bf12b1e990b4ab/users/452f57b8376847fba2d6fa615a6cf4c6/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:51.228442 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14cada-81b8-490b-96cd-3ac7007a762d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:51.228932 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14cada-81b8-490b-96cd-3ac7007a762d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:51.229397 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14cada-81b8-490b-96cd-3ac7007a762d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:51.243323 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dfbe5433-d83b-4f90-97a9-13ff088aaa93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e1a1f34daba4db8b446ac88ff64e5c0', 'request_id': 'req-dfbe5433-d83b-4f90-97a9-13ff088aaa93'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:51.267348 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dfbe5433-d83b-4f90-97a9-13ff088aaa93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e1a1f34daba4db8b446ac88ff64e5c0', 'request_id': 'req-dfbe5433-d83b-4f90-97a9-13ff088aaa93'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:51.268923 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5f14cada-81b8-490b-96cd-3ac7007a762d None None] MFA Rules not processed for user `df6a4914e6f0486683abf7740dd0c863`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:51.271036 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5f14cada-81b8-490b-96cd-3ac7007a762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:51.289998 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dfbe5433-d83b-4f90-97a9-13ff088aaa93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e1a1f34daba4db8b446ac88ff64e5c0', 'request_id': 'req-dfbe5433-d83b-4f90-97a9-13ff088aaa93'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:51.311218 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dfbe5433-d83b-4f90-97a9-13ff088aaa93 admin admin] The token cache is being invalidate because project 5e1a1f34daba4db8b446ac88ff64e5c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:24:51.311603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dfbe5433-d83b-4f90-97a9-13ff088aaa93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:51.312716 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dfbe5433-d83b-4f90-97a9-13ff088aaa93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:51.314877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 693/1394] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:24:51 2022] DELETE /identity/v3/projects/5e1a1f34daba4db8b446ac88ff64e5c0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:51.316540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d515a2-debf-40a4-b0d0-c75743e1f1fa None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:51.316877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d515a2-debf-40a4-b0d0-c75743e1f1fa None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:51.317707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d515a2-debf-40a4-b0d0-c75743e1f1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:51.393421 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-16d515a2-debf-40a4-b0d0-c75743e1f1fa None None] MFA Rules not processed for user `452f57b8376847fba2d6fa615a6cf4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:51.398550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-16d515a2-debf-40a4-b0d0-c75743e1f1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:51.399072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 702/1395] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:51.400196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14cada-81b8-490b-96cd-3ac7007a762d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:51.404129 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5f14cada-81b8-490b-96cd-3ac7007a762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:51.550244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14cada-81b8-490b-96cd-3ac7007a762d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:51.566532 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2346ee5-1a2d-49e7-85f2-dae9d7b72f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:51.567531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2346ee5-1a2d-49e7-85f2-dae9d7b72f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:51.568067 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2346ee5-1a2d-49e7-85f2-dae9d7b72f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:51.568508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2346ee5-1a2d-49e7-85f2-dae9d7b72f93 admin admin] PATH_INFO: `/v3/projects/22f80ca651ba48c4bafd51bc07f622b4` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:51.569993 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2346ee5-1a2d-49e7-85f2-dae9d7b72f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f80ca651ba48c4bafd51bc07f622b4)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:51.572129 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2346ee5-1a2d-49e7-85f2-dae9d7b72f93 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:51.725213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b2346ee5-1a2d-49e7-85f2-dae9d7b72f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f80ca651ba48c4bafd51bc07f622b4', 'request_id': 'req-b2346ee5-1a2d-49e7-85f2-dae9d7b72f93'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:51.726928 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b2346ee5-1a2d-49e7-85f2-dae9d7b72f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f80ca651ba48c4bafd51bc07f622b4', 'request_id': 'req-b2346ee5-1a2d-49e7-85f2-dae9d7b72f93'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:51.731681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:51.745817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b2346ee5-1a2d-49e7-85f2-dae9d7b72f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f80ca651ba48c4bafd51bc07f622b4', 'request_id': 'req-b2346ee5-1a2d-49e7-85f2-dae9d7b72f93'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:51.785441 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b2346ee5-1a2d-49e7-85f2-dae9d7b72f93 admin admin] The token cache is being invalidate because project 22f80ca651ba48c4bafd51bc07f622b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:24:51.785897 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b2346ee5-1a2d-49e7-85f2-dae9d7b72f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:51.786910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b2346ee5-1a2d-49e7-85f2-dae9d7b72f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:51.789450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 703/1396] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:24:51 2022] DELETE /identity/v3/projects/22f80ca651ba48c4bafd51bc07f622b4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:51.793227 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12990e0-b069-4657-9547-d46429076d2b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:51.795306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12990e0-b069-4657-9547-d46429076d2b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:51.795702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12990e0-b069-4657-9547-d46429076d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:51.867062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a12990e0-b069-4657-9547-d46429076d2b None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:51.872983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a12990e0-b069-4657-9547-d46429076d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:52.036733 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 694/1397] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 721 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:52.037914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d515a2-debf-40a4-b0d0-c75743e1f1fa None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:52.039961 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-16d515a2-debf-40a4-b0d0-c75743e1f1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:52.075292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 704/1398] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:52.076519 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12990e0-b069-4657-9547-d46429076d2b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:52.080641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a12990e0-b069-4657-9547-d46429076d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:52.103217 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:52.107685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12990e0-b069-4657-9547-d46429076d2b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:52.123667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343a1c-87ab-43cf-80f4-d856145ea13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:52.124593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343a1c-87ab-43cf-80f4-d856145ea13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:52.124998 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343a1c-87ab-43cf-80f4-d856145ea13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:52.125376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343a1c-87ab-43cf-80f4-d856145ea13c admin admin] PATH_INFO: `/v3/users/7bf9343478e346fe8186a2a46d6d42a3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:52.130913 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3343a1c-87ab-43cf-80f4-d856145ea13c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf9343478e346fe8186a2a46d6d42a3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:52.133459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3343a1c-87ab-43cf-80f4-d856145ea13c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:52.213361 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d515a2-debf-40a4-b0d0-c75743e1f1fa None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:52.234817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e3343a1c-87ab-43cf-80f4-d856145ea13c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf9343478e346fe8186a2a46d6d42a3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:52.236208 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e3343a1c-87ab-43cf-80f4-d856145ea13c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf9343478e346fe8186a2a46d6d42a3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:52.250525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e3343a1c-87ab-43cf-80f4-d856145ea13c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf9343478e346fe8186a2a46d6d42a3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:52.254295 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e3343a1c-87ab-43cf-80f4-d856145ea13c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf9343478e346fe8186a2a46d6d42a3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:52.267228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e3343a1c-87ab-43cf-80f4-d856145ea13c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf9343478e346fe8186a2a46d6d42a3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:52.302994 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 705/1399] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:24:52 2022] DELETE /identity/v3/users/7bf9343478e346fe8186a2a46d6d42a3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:52.303872 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343a1c-87ab-43cf-80f4-d856145ea13c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:52.337704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e3343a1c-87ab-43cf-80f4-d856145ea13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:52.340402 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd231f-c790-4d8a-85ce-62e6302cad42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:52.341118 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd231f-c790-4d8a-85ce-62e6302cad42 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:52.341469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd231f-c790-4d8a-85ce-62e6302cad42 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:52.342443 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd231f-c790-4d8a-85ce-62e6302cad42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:52.346178 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fbcd231f-c790-4d8a-85ce-62e6302cad42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:52.489488 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd231f-c790-4d8a-85ce-62e6302cad42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:52.492439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343a1c-87ab-43cf-80f4-d856145ea13c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:52.494457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd231f-c790-4d8a-85ce-62e6302cad42 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:52.505649 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875bb04-d3ad-4af3-8b6a-a26da983c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:52.506409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875bb04-d3ad-4af3-8b6a-a26da983c560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:52.506753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875bb04-d3ad-4af3-8b6a-a26da983c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:52.507112 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875bb04-d3ad-4af3-8b6a-a26da983c560 admin admin] PATH_INFO: `/v3/users/4f85da82b19d41c28ecfda8f276d5ad6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:52.508502 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875bb04-d3ad-4af3-8b6a-a26da983c560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f85da82b19d41c28ecfda8f276d5ad6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:52.512215 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875bb04-d3ad-4af3-8b6a-a26da983c560 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:52.515673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 695/1400] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:52.530443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:52.532887 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd231f-c790-4d8a-85ce-62e6302cad42 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:52.536196 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fbcd231f-c790-4d8a-85ce-62e6302cad42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:52.582781 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd231f-c790-4d8a-85ce-62e6302cad42 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:52.604584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a71ff9-3817-4a04-a709-efeeee210332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:52.605376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a71ff9-3817-4a04-a709-efeeee210332 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:52.605994 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a71ff9-3817-4a04-a709-efeeee210332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:52.606365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a71ff9-3817-4a04-a709-efeeee210332 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:52.607462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a71ff9-3817-4a04-a709-efeeee210332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:52.609636 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a71ff9-3817-4a04-a709-efeeee210332 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:52.646600 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f875bb04-d3ad-4af3-8b6a-a26da983c560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f85da82b19d41c28ecfda8f276d5ad6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:52.647605 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f875bb04-d3ad-4af3-8b6a-a26da983c560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f85da82b19d41c28ecfda8f276d5ad6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:52.669975 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 696/1401] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:52 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:52.671440 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068150d-ba52-4c3f-a021-dbc21903d8e3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:52.671827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068150d-ba52-4c3f-a021-dbc21903d8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:52.672604 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068150d-ba52-4c3f-a021-dbc21903d8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:52.677943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f875bb04-d3ad-4af3-8b6a-a26da983c560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f85da82b19d41c28ecfda8f276d5ad6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:52.680313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f875bb04-d3ad-4af3-8b6a-a26da983c560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f85da82b19d41c28ecfda8f276d5ad6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:52.700798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f875bb04-d3ad-4af3-8b6a-a26da983c560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f85da82b19d41c28ecfda8f276d5ad6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:52.757391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3068150d-ba52-4c3f-a021-dbc21903d8e3 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:52.758749 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3068150d-ba52-4c3f-a021-dbc21903d8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:52.794082 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 706/1402] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:24:52 2022] DELETE /identity/v3/users/4f85da82b19d41c28ecfda8f276d5ad6 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:52.798056 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74c954-9437-48d5-bf05-33d1fdcbcab5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:52.798347 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74c954-9437-48d5-bf05-33d1fdcbcab5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:52.802135 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74c954-9437-48d5-bf05-33d1fdcbcab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:52.811522 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:52.854774 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 697/1403] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:52.856649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068150d-ba52-4c3f-a021-dbc21903d8e3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:52.860577 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3068150d-ba52-4c3f-a021-dbc21903d8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:52.885599 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068150d-ba52-4c3f-a021-dbc21903d8e3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:52.891415 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cc74c954-9437-48d5-bf05-33d1fdcbcab5 None None] MFA Rules not processed for user `38b48da35205469abf5aa714dacfe6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:52.895432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cc74c954-9437-48d5-bf05-33d1fdcbcab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:53.007674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a47cc0-10d2-4276-ae47-af6867777e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:53.008821 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a47cc0-10d2-4276-ae47-af6867777e51 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:53.009435 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a47cc0-10d2-4276-ae47-af6867777e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:53.009908 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a47cc0-10d2-4276-ae47-af6867777e51 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:53.011277 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a47cc0-10d2-4276-ae47-af6867777e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:53.016738 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a47cc0-10d2-4276-ae47-af6867777e51 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:53.047148 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 707/1404] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:53.054230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea58ed-c48c-4392-80ba-90afe40b06bb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:53.054681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea58ed-c48c-4392-80ba-90afe40b06bb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:53.055135 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea58ed-c48c-4392-80ba-90afe40b06bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:53.080297 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 698/1405] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:52 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:53.090654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a47cc0-10d2-4276-ae47-af6867777e51 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:53.108971 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a47cc0-10d2-4276-ae47-af6867777e51 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:53.118354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ea141-dab4-44b6-be30-6dd1973adfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:53.119161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ea141-dab4-44b6-be30-6dd1973adfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:53.119548 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ea141-dab4-44b6-be30-6dd1973adfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:53.119861 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-62ea58ed-c48c-4392-80ba-90afe40b06bb None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:53.120324 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ea141-dab4-44b6-be30-6dd1973adfe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:53.121098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ea141-dab4-44b6-be30-6dd1973adfe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:24:53.121508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ea141-dab4-44b6-be30-6dd1973adfe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:53.123335 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-62ea58ed-c48c-4392-80ba-90afe40b06bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:53.123461 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ea141-dab4-44b6-be30-6dd1973adfe1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:53.147372 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 699/1407] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:24:53.147849 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 708/1407] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:53.149383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea58ed-c48c-4392-80ba-90afe40b06bb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:53.152649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ea141-dab4-44b6-be30-6dd1973adfe1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:53.156475 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-875ea141-dab4-44b6-be30-6dd1973adfe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:53.170214 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea58ed-c48c-4392-80ba-90afe40b06bb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:53.183318 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99861ef2-d8c0-4196-ac5e-cf75b64849ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:53.185285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99861ef2-d8c0-4196-ac5e-cf75b64849ca admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:53.188875 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99861ef2-d8c0-4196-ac5e-cf75b64849ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:53.189333 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99861ef2-d8c0-4196-ac5e-cf75b64849ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:53.190168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99861ef2-d8c0-4196-ac5e-cf75b64849ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:53.193912 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99861ef2-d8c0-4196-ac5e-cf75b64849ca admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:53.219646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 709/1408] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:53.220837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99861ef2-d8c0-4196-ac5e-cf75b64849ca admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:53.247980 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99861ef2-d8c0-4196-ac5e-cf75b64849ca admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:53.263875 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3460d-a643-4b03-a522-809a6e452b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:53.265528 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3460d-a643-4b03-a522-809a6e452b07 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:53.266514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3460d-a643-4b03-a522-809a6e452b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:53.267180 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3460d-a643-4b03-a522-809a6e452b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:53.268458 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3460d-a643-4b03-a522-809a6e452b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:53.271128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3460d-a643-4b03-a522-809a6e452b07 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:53.314572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 710/1409] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:53 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:53.315613 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3460d-a643-4b03-a522-809a6e452b07 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:53.318539 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ea141-dab4-44b6-be30-6dd1973adfe1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:53.391331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:53.399457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:53.440397 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bba24-0ac9-47e4-9e1c-966510eb6cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:53.441050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bba24-0ac9-47e4-9e1c-966510eb6cd2 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:53.441334 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bba24-0ac9-47e4-9e1c-966510eb6cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:53.441606 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bba24-0ac9-47e4-9e1c-966510eb6cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:53.451753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3460d-a643-4b03-a522-809a6e452b07 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:53.459173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2528b3-bd43-4234-a0f1-801d6d6b1990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:53.461409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2528b3-bd43-4234-a0f1-801d6d6b1990 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:53.463455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2528b3-bd43-4234-a0f1-801d6d6b1990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:53.463854 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2528b3-bd43-4234-a0f1-801d6d6b1990 admin admin] PATH_INFO: `/v3/projects/df86aa7ed4784dab80cc4283b8aea2c0/users/2d634ab3d6ba4c8bba061a6cb09ae5ff/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:53.494745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2528b3-bd43-4234-a0f1-801d6d6b1990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df86aa7ed4784dab80cc4283b8aea2c0, user_id=2d634ab3d6ba4c8bba061a6cb09ae5ff, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:53.498354 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2528b3-bd43-4234-a0f1-801d6d6b1990 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:53.520989 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 711/1410] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:53 2022] PUT /identity/v3/projects/df86aa7ed4784dab80cc4283b8aea2c0/users/2d634ab3d6ba4c8bba061a6cb09ae5ff/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:53.522694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2528b3-bd43-4234-a0f1-801d6d6b1990 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:53.528258 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4a2528b3-bd43-4234-a0f1-801d6d6b1990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:53.577056 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bba24-0ac9-47e4-9e1c-966510eb6cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:53.580052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bba24-0ac9-47e4-9e1c-966510eb6cd2 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:53.595500 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 700/1411] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:53.596652 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bba24-0ac9-47e4-9e1c-966510eb6cd2 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:53.608835 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2528b3-bd43-4234-a0f1-801d6d6b1990 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:53.609242 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bba24-0ac9-47e4-9e1c-966510eb6cd2 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:53.613195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc8475-a2cd-4f5d-96c7-d6bc2fdaf7c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:53.616099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc8475-a2cd-4f5d-96c7-d6bc2fdaf7c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:53.616487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc8475-a2cd-4f5d-96c7-d6bc2fdaf7c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:53.616863 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc8475-a2cd-4f5d-96c7-d6bc2fdaf7c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:53.738305 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e28a5-f2cc-4d6d-bb20-9e2064669362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:53.739808 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e28a5-f2cc-4d6d-bb20-9e2064669362 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:53.740113 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e28a5-f2cc-4d6d-bb20-9e2064669362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:53.740389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e28a5-f2cc-4d6d-bb20-9e2064669362 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:53.743493 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e28a5-f2cc-4d6d-bb20-9e2064669362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:53.751814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e28a5-f2cc-4d6d-bb20-9e2064669362 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:53.776835 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc8475-a2cd-4f5d-96c7-d6bc2fdaf7c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:53.782205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc8475-a2cd-4f5d-96c7-d6bc2fdaf7c7 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:53.806507 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 712/1412] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:53.807786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc8475-a2cd-4f5d-96c7-d6bc2fdaf7c7 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:53.815679 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 701/1413] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:53 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:53.820294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306fef5-3efa-49b2-9a7c-eae01a136127 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:53.821395 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306fef5-3efa-49b2-9a7c-eae01a136127 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:53.821671 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306fef5-3efa-49b2-9a7c-eae01a136127 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:53.822037 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc8475-a2cd-4f5d-96c7-d6bc2fdaf7c7 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:53.825665 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 702/1414] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 17 10:24:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:24:53.826496 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306fef5-3efa-49b2-9a7c-eae01a136127 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:53.830474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c00e3-e615-494f-a98f-3b0247b6dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:53.831361 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c00e3-e615-494f-a98f-3b0247b6dba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:53.832168 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7306fef5-3efa-49b2-9a7c-eae01a136127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:53.833377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c00e3-e615-494f-a98f-3b0247b6dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:53.833942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c00e3-e615-494f-a98f-3b0247b6dba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:53.834795 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c00e3-e615-494f-a98f-3b0247b6dba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:53.836651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c00e3-e615-494f-a98f-3b0247b6dba4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:53.852570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 713/1415] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:53.854219 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c00e3-e615-494f-a98f-3b0247b6dba4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:53.869349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c00e3-e615-494f-a98f-3b0247b6dba4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:53.875744 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f42b44-cc4c-4d50-a683-7036d741dd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:53.876922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f42b44-cc4c-4d50-a683-7036d741dd5f admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:53.877429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f42b44-cc4c-4d50-a683-7036d741dd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:53.878084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f42b44-cc4c-4d50-a683-7036d741dd5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:53.879889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f42b44-cc4c-4d50-a683-7036d741dd5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:53.882723 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f42b44-cc4c-4d50-a683-7036d741dd5f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:53.883834 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306fef5-3efa-49b2-9a7c-eae01a136127 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:53.902105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 714/1416] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:53.904602 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0dc64-13d1-4991-9156-655ce92a2b74 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:53.905241 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0dc64-13d1-4991-9156-655ce92a2b74 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:53.905715 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0dc64-13d1-4991-9156-655ce92a2b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:53.915346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b0de8-8e8f-4035-8586-329685075765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:53.916034 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b0de8-8e8f-4035-8586-329685075765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:53.916320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b0de8-8e8f-4035-8586-329685075765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:53.916594 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b0de8-8e8f-4035-8586-329685075765 admin admin] PATH_INFO: `/v3/projects/fa496b5f16654c50bf8f071a70f437f1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:53.917757 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b0de8-8e8f-4035-8586-329685075765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa496b5f16654c50bf8f071a70f437f1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:53.919716 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b0de8-8e8f-4035-8586-329685075765 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:54.033698 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e8b0dc64-13d1-4991-9156-655ce92a2b74 None None] MFA Rules not processed for user `98030e60807e44ec928488e904ca24c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:54.037685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e8b0dc64-13d1-4991-9156-655ce92a2b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:54.055120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3e9b0de8-8e8f-4035-8586-329685075765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa496b5f16654c50bf8f071a70f437f1', 'request_id': 'req-3e9b0de8-8e8f-4035-8586-329685075765'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:54.069462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3e9b0de8-8e8f-4035-8586-329685075765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa496b5f16654c50bf8f071a70f437f1', 'request_id': 'req-3e9b0de8-8e8f-4035-8586-329685075765'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:54.085291 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3e9b0de8-8e8f-4035-8586-329685075765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa496b5f16654c50bf8f071a70f437f1', 'request_id': 'req-3e9b0de8-8e8f-4035-8586-329685075765'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:54.109811 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:54.127017 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3e9b0de8-8e8f-4035-8586-329685075765 admin admin] The token cache is being invalidate because project fa496b5f16654c50bf8f071a70f437f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:24:54.131554 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3e9b0de8-8e8f-4035-8586-329685075765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:54.133732 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3e9b0de8-8e8f-4035-8586-329685075765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:54.143378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 703/1417] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:24:53 2022] DELETE /identity/v3/projects/fa496b5f16654c50bf8f071a70f437f1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:54.145860 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b0de8-8e8f-4035-8586-329685075765 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:54.160181 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3e9b0de8-8e8f-4035-8586-329685075765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:54.176673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:54.271180 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 715/1418] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 17 10:24:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:54.272520 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0dc64-13d1-4991-9156-655ce92a2b74 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:54.275867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e8b0dc64-13d1-4991-9156-655ce92a2b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:54.486524 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b0de8-8e8f-4035-8586-329685075765 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:54.500524 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462dc86-7805-4a98-8e1c-ffb50714f69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:54.501158 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462dc86-7805-4a98-8e1c-ffb50714f69d admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:54.501437 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462dc86-7805-4a98-8e1c-ffb50714f69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:54.501711 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462dc86-7805-4a98-8e1c-ffb50714f69d admin admin] PATH_INFO: `/v3/projects/df86aa7ed4784dab80cc4283b8aea2c0/users/2d634ab3d6ba4c8bba061a6cb09ae5ff/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:54.511529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462dc86-7805-4a98-8e1c-ffb50714f69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=df86aa7ed4784dab80cc4283b8aea2c0, user_id=2d634ab3d6ba4c8bba061a6cb09ae5ff, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:54.521220 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462dc86-7805-4a98-8e1c-ffb50714f69d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:54.558540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 704/1419] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:54 2022] PUT /identity/v3/projects/df86aa7ed4784dab80cc4283b8aea2c0/users/2d634ab3d6ba4c8bba061a6cb09ae5ff/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:54.565584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6093-868c-4c67-ab15-5d3507d1d1fc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:54.565868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6093-868c-4c67-ab15-5d3507d1d1fc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:54.566150 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6093-868c-4c67-ab15-5d3507d1d1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:54.591169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0dc64-13d1-4991-9156-655ce92a2b74 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:54.665320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fa7b6093-868c-4c67-ab15-5d3507d1d1fc None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:54.666578 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fa7b6093-868c-4c67-ab15-5d3507d1d1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:54.749522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5dd50c-9578-4de3-8381-cfb69f9bb7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:54.750179 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5dd50c-9578-4de3-8381-cfb69f9bb7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:54.750484 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5dd50c-9578-4de3-8381-cfb69f9bb7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:54.751109 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5dd50c-9578-4de3-8381-cfb69f9bb7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:54.752156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5dd50c-9578-4de3-8381-cfb69f9bb7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:54.755112 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5dd50c-9578-4de3-8381-cfb69f9bb7e4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:54.787694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 716/1420] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:54.788909 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5dd50c-9578-4de3-8381-cfb69f9bb7e4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:54.795479 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ef5dd50c-9578-4de3-8381-cfb69f9bb7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:54.884514 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 705/1421] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:54.886187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bacba6-74b8-4920-8004-cab94a55a843 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:54.887089 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bacba6-74b8-4920-8004-cab94a55a843 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:54.888596 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bacba6-74b8-4920-8004-cab94a55a843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:54.969243 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5dd50c-9578-4de3-8381-cfb69f9bb7e4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:54.978077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b986c00-0e16-4e74-ad27-350f9a1b5597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:54.979030 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b986c00-0e16-4e74-ad27-350f9a1b5597 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:54.979474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b986c00-0e16-4e74-ad27-350f9a1b5597 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:54.980119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b986c00-0e16-4e74-ad27-350f9a1b5597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:55.001365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-60bacba6-74b8-4920-8004-cab94a55a843 None None] MFA Rules not processed for user `2d634ab3d6ba4c8bba061a6cb09ae5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:55.002338 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b986c00-0e16-4e74-ad27-350f9a1b5597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:55.003044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-60bacba6-74b8-4920-8004-cab94a55a843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:55.005154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b986c00-0e16-4e74-ad27-350f9a1b5597 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:55.034325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 717/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:55.035304 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b986c00-0e16-4e74-ad27-350f9a1b5597 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:55.049692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b986c00-0e16-4e74-ad27-350f9a1b5597 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:55.056678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc281-0ac1-4c57-87a0-01fd0206ba5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:55.057565 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc281-0ac1-4c57-87a0-01fd0206ba5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:55.057855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc281-0ac1-4c57-87a0-01fd0206ba5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:55.058139 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc281-0ac1-4c57-87a0-01fd0206ba5f admin admin] PATH_INFO: `/v3/projects/e6e00a486ee446f8bda912ac6fbc7c31/users/6caffab075a74c05b68076c86d002c42/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:55.096329 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcc281-0ac1-4c57-87a0-01fd0206ba5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e00a486ee446f8bda912ac6fbc7c31, user_id=6caffab075a74c05b68076c86d002c42, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:55.099520 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcc281-0ac1-4c57-87a0-01fd0206ba5f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:55.149038 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:55.167660 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 718/1423] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:55 2022] PUT /identity/v3/projects/e6e00a486ee446f8bda912ac6fbc7c31/users/6caffab075a74c05b68076c86d002c42/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:55.169258 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc736c-b80c-45d5-83c1-3e7a7c139d55 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:55.169552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc736c-b80c-45d5-83c1-3e7a7c139d55 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:55.169833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc736c-b80c-45d5-83c1-3e7a7c139d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:55.204592 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a0cc736c-b80c-45d5-83c1-3e7a7c139d55 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:55.206080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a0cc736c-b80c-45d5-83c1-3e7a7c139d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:55.217511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 706/1424] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:55.217511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048139c-3f8a-4390-a6e4-b149bd6b61e8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:55.217511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048139c-3f8a-4390-a6e4-b149bd6b61e8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:55.217511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048139c-3f8a-4390-a6e4-b149bd6b61e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:55.267057 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9048139c-3f8a-4390-a6e4-b149bd6b61e8 None None] MFA Rules not processed for user `b8532a4cfb224d75aab98dddf1dcd0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:55.270977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9048139c-3f8a-4390-a6e4-b149bd6b61e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:55.288962 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:55.391752 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 719/1425] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:55.393493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7ba7-f968-4b51-9c3e-2445033c2d69 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:55.393783 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7ba7-f968-4b51-9c3e-2445033c2d69 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:55.394186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7ba7-f968-4b51-9c3e-2445033c2d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:55.430879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-69de7ba7-f968-4b51-9c3e-2445033c2d69 None None] MFA Rules not processed for user `9bc07aa85f5643cfb89280a136496619`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:55.432154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-69de7ba7-f968-4b51-9c3e-2445033c2d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:55.474410 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 707/1426] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:55.475940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338282c-3077-4ecb-b486-9dde9c2c7e64 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:55.476388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338282c-3077-4ecb-b486-9dde9c2c7e64 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:55.476630 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338282c-3077-4ecb-b486-9dde9c2c7e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:55.531159 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5338282c-3077-4ecb-b486-9dde9c2c7e64 None None] MFA Rules not processed for user `6caffab075a74c05b68076c86d002c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:55.534222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5338282c-3077-4ecb-b486-9dde9c2c7e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:55.635125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 720/1427] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:55.637238 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de7ba7-f968-4b51-9c3e-2445033c2d69 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:55.644378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-69de7ba7-f968-4b51-9c3e-2445033c2d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:55.705946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 708/1428] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:55.707228 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338282c-3077-4ecb-b486-9dde9c2c7e64 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:55.713880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5338282c-3077-4ecb-b486-9dde9c2c7e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:55.772057 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338282c-3077-4ecb-b486-9dde9c2c7e64 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:55.780093 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:55.781383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:55.781664 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:55.781937 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880 admin admin] PATH_INFO: `/v3/projects/7f13da24ba3741b9945460cd7742a681` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:55.783135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f13da24ba3741b9945460cd7742a681)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:55.785877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:55.840769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de7ba7-f968-4b51-9c3e-2445033c2d69 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:55.867154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e67da-a96d-4fc1-8f92-de0a3a7588b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:55.867798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e67da-a96d-4fc1-8f92-de0a3a7588b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:55.868233 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e67da-a96d-4fc1-8f92-de0a3a7588b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:55.868525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e67da-a96d-4fc1-8f92-de0a3a7588b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:55.895359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f13da24ba3741b9945460cd7742a681', 'request_id': 'req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:55.918272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f13da24ba3741b9945460cd7742a681', 'request_id': 'req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:55.930839 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f13da24ba3741b9945460cd7742a681', 'request_id': 'req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:55.961569 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880 admin admin] The token cache is being invalidate because project 7f13da24ba3741b9945460cd7742a681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:24:55.961861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:55.963355 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:55.967239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 709/1429] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:24:55 2022] DELETE /identity/v3/projects/7f13da24ba3741b9945460cd7742a681 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:55.969809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:55.974017 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:55.974431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:56.007691 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e67da-a96d-4fc1-8f92-de0a3a7588b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:56.009285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e67da-a96d-4fc1-8f92-de0a3a7588b4 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:56.017949 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:56.039815 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 721/1430] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:56.041319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054e554-4b95-4565-97f6-a30a3f6f5706 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:56.041615 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054e554-4b95-4565-97f6-a30a3f6f5706 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:56.041900 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054e554-4b95-4565-97f6-a30a3f6f5706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:56.093486 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b054e554-4b95-4565-97f6-a30a3f6f5706 None None] MFA Rules not processed for user `b8532a4cfb224d75aab98dddf1dcd0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:56.100038 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b054e554-4b95-4565-97f6-a30a3f6f5706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:56.117718 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f9880-0ba2-4cb5-8d55-8bbe12b05880 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:56.131721 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b394bd6-950f-40c0-b70c-7e66e4fa90f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:56.132876 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b394bd6-950f-40c0-b70c-7e66e4fa90f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:56.133164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b394bd6-950f-40c0-b70c-7e66e4fa90f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:56.144491 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b394bd6-950f-40c0-b70c-7e66e4fa90f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:56.145373 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b394bd6-950f-40c0-b70c-7e66e4fa90f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:24:56.146035 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b394bd6-950f-40c0-b70c-7e66e4fa90f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:56.150975 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b394bd6-950f-40c0-b70c-7e66e4fa90f1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:56.181009 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 710/1431] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:24:56.181009 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b394bd6-950f-40c0-b70c-7e66e4fa90f1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:56.185239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7b394bd6-950f-40c0-b70c-7e66e4fa90f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:56.281342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 722/1432] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:56.282000 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054e554-4b95-4565-97f6-a30a3f6f5706 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:56.284137 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b054e554-4b95-4565-97f6-a30a3f6f5706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:56.307084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054e554-4b95-4565-97f6-a30a3f6f5706 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:56.313819 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49bcb0-de19-4fb4-b999-b17c1c6b1b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:56.314957 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49bcb0-de19-4fb4-b999-b17c1c6b1b1b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:56.315332 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49bcb0-de19-4fb4-b999-b17c1c6b1b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:56.315959 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49bcb0-de19-4fb4-b999-b17c1c6b1b1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:56.317344 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49bcb0-de19-4fb4-b999-b17c1c6b1b1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:56.320751 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49bcb0-de19-4fb4-b999-b17c1c6b1b1b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:56.391847 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 723/1433] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:56 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:56.393651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49bcb0-de19-4fb4-b999-b17c1c6b1b1b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:56.397232 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b394bd6-950f-40c0-b70c-7e66e4fa90f1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:56.397517 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-db49bcb0-de19-4fb4-b999-b17c1c6b1b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:56.492958 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49bcb0-de19-4fb4-b999-b17c1c6b1b1b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:56.498611 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b3b53-708a-4a60-9884-501847e4b9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:56.499489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b3b53-708a-4a60-9884-501847e4b9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:56.500655 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b3b53-708a-4a60-9884-501847e4b9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:56.500655 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b3b53-708a-4a60-9884-501847e4b9ea admin admin] PATH_INFO: `/v3/users/3283a856f4644457a20f84124a9574fd` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:56.501370 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b3b53-708a-4a60-9884-501847e4b9ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=3283a856f4644457a20f84124a9574fd)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:56.503244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b3b53-708a-4a60-9884-501847e4b9ea admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:56.503583 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c11a8a-be4c-47b0-a74b-36f43136bee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:56.504754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c11a8a-be4c-47b0-a74b-36f43136bee3 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:56.505047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c11a8a-be4c-47b0-a74b-36f43136bee3 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:56.505297 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c11a8a-be4c-47b0-a74b-36f43136bee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:56.518635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e6c11a8a-be4c-47b0-a74b-36f43136bee3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:56.571789 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-575b3b53-708a-4a60-9884-501847e4b9ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3283a856f4644457a20f84124a9574fd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:56.572944 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-575b3b53-708a-4a60-9884-501847e4b9ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3283a856f4644457a20f84124a9574fd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:56.591787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-575b3b53-708a-4a60-9884-501847e4b9ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3283a856f4644457a20f84124a9574fd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:56.592697 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-575b3b53-708a-4a60-9884-501847e4b9ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3283a856f4644457a20f84124a9574fd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:56.603592 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-575b3b53-708a-4a60-9884-501847e4b9ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3283a856f4644457a20f84124a9574fd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:56.605144 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:56.627655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:56.633272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c11a8a-be4c-47b0-a74b-36f43136bee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:56.635314 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c11a8a-be4c-47b0-a74b-36f43136bee3 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:56.648058 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 711/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:56.649010 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c11a8a-be4c-47b0-a74b-36f43136bee3 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:56.660479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c11a8a-be4c-47b0-a74b-36f43136bee3 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:56.666230 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c3a5c-5bac-42a1-bc8e-a015d0b6f015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:56.666868 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 724/1435] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:24:56 2022] DELETE /identity/v3/users/3283a856f4644457a20f84124a9574fd => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:56.668017 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b3b53-708a-4a60-9884-501847e4b9ea admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:56.669907 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c3a5c-5bac-42a1-bc8e-a015d0b6f015 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:56.670615 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c3a5c-5bac-42a1-bc8e-a015d0b6f015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:56.670615 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c3a5c-5bac-42a1-bc8e-a015d0b6f015 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:56.672509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c3a5c-5bac-42a1-bc8e-a015d0b6f015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:56.674687 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c3a5c-5bac-42a1-bc8e-a015d0b6f015 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:56.685540 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-575b3b53-708a-4a60-9884-501847e4b9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:56.721921 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 712/1436] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:56 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:56.721921 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c3a5c-5bac-42a1-bc8e-a015d0b6f015 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:56.725810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d60c3a5c-5bac-42a1-bc8e-a015d0b6f015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:56.833260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b3b53-708a-4a60-9884-501847e4b9ea admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:56.903785 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c3a5c-5bac-42a1-bc8e-a015d0b6f015 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:56.921882 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5a836-b034-4618-a466-e39a6efbb83b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd52eee25ef347e1ae905cc3cba17284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:56.922684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5a836-b034-4618-a466-e39a6efbb83b service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:56.922970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5a836-b034-4618-a466-e39a6efbb83b service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:56.923474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5a836-b034-4618-a466-e39a6efbb83b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:56.927629 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ccb5a836-b034-4618-a466-e39a6efbb83b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:56.952060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5a836-b034-4618-a466-e39a6efbb83b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:56.955569 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc39e0d-6a78-46bd-ac84-bb626940e3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:56.956236 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc39e0d-6a78-46bd-ac84-bb626940e3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:56.956604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc39e0d-6a78-46bd-ac84-bb626940e3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:56.956863 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc39e0d-6a78-46bd-ac84-bb626940e3d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:56.957578 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc39e0d-6a78-46bd-ac84-bb626940e3d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:56.959607 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc39e0d-6a78-46bd-ac84-bb626940e3d3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:56.962155 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5a836-b034-4618-a466-e39a6efbb83b service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:56.982402 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 713/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:56.983327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5a836-b034-4618-a466-e39a6efbb83b service placement] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:56.984791 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ccb5a836-b034-4618-a466-e39a6efbb83b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:57.005694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 725/1438] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:56 2022] POST /identity/v3/users => generated 292 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:57.006673 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc39e0d-6a78-46bd-ac84-bb626940e3d3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:57.009592 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4bc39e0d-6a78-46bd-ac84-bb626940e3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:57.114100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5a836-b034-4618-a466-e39a6efbb83b service placement] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:57.132366 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc39e0d-6a78-46bd-ac84-bb626940e3d3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:57.133806 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ef339-b541-47f7-ad1c-9591be0b6593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:57.134363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ef339-b541-47f7-ad1c-9591be0b6593 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:57.134756 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ef339-b541-47f7-ad1c-9591be0b6593 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:57.135162 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ef339-b541-47f7-ad1c-9591be0b6593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:57.138982 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-052ef339-b541-47f7-ad1c-9591be0b6593 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:57.147034 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553befe6-dfd5-4e61-b561-5e6a78b52b52 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d634ab3d6ba4c8bba061a6cb09ae5ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df86aa7ed4784dab80cc4283b8aea2c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:57.147756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553befe6-dfd5-4e61-b561-5e6a78b52b52 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:57.148080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553befe6-dfd5-4e61-b561-5e6a78b52b52 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:57.148359 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553befe6-dfd5-4e61-b561-5e6a78b52b52 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:57.149030 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553befe6-dfd5-4e61-b561-5e6a78b52b52 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:24:57.149342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553befe6-dfd5-4e61-b561-5e6a78b52b52 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:57.153678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553befe6-dfd5-4e61-b561-5e6a78b52b52 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:57.185160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 726/1439] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:24:57.186234 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553befe6-dfd5-4e61-b561-5e6a78b52b52 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:57.189252 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-553befe6-dfd5-4e61-b561-5e6a78b52b52 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:57.226884 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553befe6-dfd5-4e61-b561-5e6a78b52b52 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:57.242663 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a91ad-1488-4c0a-aec2-10cfa9da32f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:57.243326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a91ad-1488-4c0a-aec2-10cfa9da32f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:57.243627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a91ad-1488-4c0a-aec2-10cfa9da32f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:57.243889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a91ad-1488-4c0a-aec2-10cfa9da32f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:57.244591 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a91ad-1488-4c0a-aec2-10cfa9da32f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:57.246608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a91ad-1488-4c0a-aec2-10cfa9da32f0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:57.272398 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:57.282856 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ef339-b541-47f7-ad1c-9591be0b6593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:57.294631 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ef339-b541-47f7-ad1c-9591be0b6593 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:57.300280 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:57.303720 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 727/1440] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:24:57 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:57.304463 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a91ad-1488-4c0a-aec2-10cfa9da32f0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:57.327274 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 714/1441] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:24:57.327680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ef339-b541-47f7-ad1c-9591be0b6593 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:57.339391 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a91ad-1488-4c0a-aec2-10cfa9da32f0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:57.362141 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa21b9b-a9ce-4361-addd-d8cb2e83f416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:57.365594 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa21b9b-a9ce-4361-addd-d8cb2e83f416 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:57.365819 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa21b9b-a9ce-4361-addd-d8cb2e83f416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:57.366097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa21b9b-a9ce-4361-addd-d8cb2e83f416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:57.366769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa21b9b-a9ce-4361-addd-d8cb2e83f416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:57.368467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa21b9b-a9ce-4361-addd-d8cb2e83f416 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:57.373114 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ef339-b541-47f7-ad1c-9591be0b6593 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:57.386592 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fcc69-da69-424b-9985-057b276dec28 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d634ab3d6ba4c8bba061a6cb09ae5ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df86aa7ed4784dab80cc4283b8aea2c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:57.387245 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fcc69-da69-424b-9985-057b276dec28 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:57.387517 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fcc69-da69-424b-9985-057b276dec28 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:57.387813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fcc69-da69-424b-9985-057b276dec28 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:57.388471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fcc69-da69-424b-9985-057b276dec28 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:57.390441 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fcc69-da69-424b-9985-057b276dec28 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:57.425705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 728/1442] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:57.429630 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa21b9b-a9ce-4361-addd-d8cb2e83f416 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:57.456229 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa21b9b-a9ce-4361-addd-d8cb2e83f416 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:57.471858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bd224-b86e-4bb3-a7e9-696e003b6bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:57.472964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bd224-b86e-4bb3-a7e9-696e003b6bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:57.473510 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bd224-b86e-4bb3-a7e9-696e003b6bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:57.475147 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bd224-b86e-4bb3-a7e9-696e003b6bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:57.476058 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bd224-b86e-4bb3-a7e9-696e003b6bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:57.483832 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 715/1443] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:57 2022] POST /identity/v3/projects => generated 354 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:57.484791 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fcc69-da69-424b-9985-057b276dec28 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:57.486378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bd224-b86e-4bb3-a7e9-696e003b6bd2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:57.512756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 729/1444] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:57.512756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bd224-b86e-4bb3-a7e9-696e003b6bd2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:57.532400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bd224-b86e-4bb3-a7e9-696e003b6bd2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:57.596982 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fcc69-da69-424b-9985-057b276dec28 tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:57.603705 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f703b-cd47-4938-b92b-c2dfaa44683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:57.604635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f703b-cd47-4938-b92b-c2dfaa44683e admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:57.605093 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f703b-cd47-4938-b92b-c2dfaa44683e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:57.606017 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f703b-cd47-4938-b92b-c2dfaa44683e admin admin] PATH_INFO: `/v3/projects/f2d55d4699114407bdd1f2ef47f6d1a5/users/5916cb5cd9644bcc894cc8e0c70ea974/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:57.667307 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f703b-cd47-4938-b92b-c2dfaa44683e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d55d4699114407bdd1f2ef47f6d1a5, user_id=5916cb5cd9644bcc894cc8e0c70ea974, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:57.687324 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f703b-cd47-4938-b92b-c2dfaa44683e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:57.719048 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 716/1445] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:57 2022] PUT /identity/v3/projects/f2d55d4699114407bdd1f2ef47f6d1a5/users/5916cb5cd9644bcc894cc8e0c70ea974/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:57.720450 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f703b-cd47-4938-b92b-c2dfaa44683e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:57.752967 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22393121-b69a-4b77-a6e3-46ee53f1149b tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d634ab3d6ba4c8bba061a6cb09ae5ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df86aa7ed4784dab80cc4283b8aea2c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:57.753671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22393121-b69a-4b77-a6e3-46ee53f1149b tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:57.753951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22393121-b69a-4b77-a6e3-46ee53f1149b tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:57.755079 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22393121-b69a-4b77-a6e3-46ee53f1149b tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:57.756200 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22393121-b69a-4b77-a6e3-46ee53f1149b tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:24:57.757104 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22393121-b69a-4b77-a6e3-46ee53f1149b tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:57.758743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22393121-b69a-4b77-a6e3-46ee53f1149b tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:57.802707 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 730/1446] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:24:57.806836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22393121-b69a-4b77-a6e3-46ee53f1149b tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:57.808651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-22393121-b69a-4b77-a6e3-46ee53f1149b tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:57.855432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22393121-b69a-4b77-a6e3-46ee53f1149b tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:57.864963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f703b-cd47-4938-b92b-c2dfaa44683e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:57.875009 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d067475-24e0-4840-99fe-d697811ff04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:57.875676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d067475-24e0-4840-99fe-d697811ff04a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:57.875968 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d067475-24e0-4840-99fe-d697811ff04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:57.878516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d067475-24e0-4840-99fe-d697811ff04a admin admin] PATH_INFO: `/v3/projects/3744fa929d6548518d549f79983e1d9c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:57.882423 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d067475-24e0-4840-99fe-d697811ff04a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3744fa929d6548518d549f79983e1d9c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:57.886290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cf295-7567-4216-9bb8-fb7a3cc3f385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:57.886448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d067475-24e0-4840-99fe-d697811ff04a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:57.887013 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cf295-7567-4216-9bb8-fb7a3cc3f385 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:57.887191 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cf295-7567-4216-9bb8-fb7a3cc3f385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:57.887463 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cf295-7567-4216-9bb8-fb7a3cc3f385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:57.888148 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cf295-7567-4216-9bb8-fb7a3cc3f385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:57.891751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cf295-7567-4216-9bb8-fb7a3cc3f385 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:57.934781 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 717/1447] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:57.934781 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cf295-7567-4216-9bb8-fb7a3cc3f385 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:57.957630 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cf295-7567-4216-9bb8-fb7a3cc3f385 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:57.964082 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264a378-1b6e-4bd8-a77c-f80b90e61b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:57.964879 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264a378-1b6e-4bd8-a77c-f80b90e61b6f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:57.965258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264a378-1b6e-4bd8-a77c-f80b90e61b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:57.965750 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264a378-1b6e-4bd8-a77c-f80b90e61b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:57.966584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264a378-1b6e-4bd8-a77c-f80b90e61b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:57.968876 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264a378-1b6e-4bd8-a77c-f80b90e61b6f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:57.988022 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 718/1448] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:24:57.991743 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264a378-1b6e-4bd8-a77c-f80b90e61b6f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:58.065017 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3d067475-24e0-4840-99fe-d697811ff04a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3744fa929d6548518d549f79983e1d9c', 'request_id': 'req-3d067475-24e0-4840-99fe-d697811ff04a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:58.085152 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3d067475-24e0-4840-99fe-d697811ff04a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3744fa929d6548518d549f79983e1d9c', 'request_id': 'req-3d067475-24e0-4840-99fe-d697811ff04a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:58.087828 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:58.103528 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3d067475-24e0-4840-99fe-d697811ff04a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3744fa929d6548518d549f79983e1d9c', 'request_id': 'req-3d067475-24e0-4840-99fe-d697811ff04a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:58.125931 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264a378-1b6e-4bd8-a77c-f80b90e61b6f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:58.160061 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3d067475-24e0-4840-99fe-d697811ff04a admin admin] The token cache is being invalidate because project 3744fa929d6548518d549f79983e1d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:24:58.160519 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3d067475-24e0-4840-99fe-d697811ff04a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:58.168386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3d067475-24e0-4840-99fe-d697811ff04a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:58.173704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 731/1449] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:24:57 2022] DELETE /identity/v3/projects/3744fa929d6548518d549f79983e1d9c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:58.174866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d067475-24e0-4840-99fe-d697811ff04a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:58.182107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3d067475-24e0-4840-99fe-d697811ff04a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:58.266995 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acb704-c3f6-4633-9c59-b2d3f941366d tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d634ab3d6ba4c8bba061a6cb09ae5ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df86aa7ed4784dab80cc4283b8aea2c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:58.267645 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acb704-c3f6-4633-9c59-b2d3f941366d tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:58.267972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acb704-c3f6-4633-9c59-b2d3f941366d tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:58.268254 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acb704-c3f6-4633-9c59-b2d3f941366d tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] PATH_INFO: `/v3/projects/7a84054a612b44ea9b71dd22840c8249` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:58.271225 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acb704-c3f6-4633-9c59-b2d3f941366d tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7a84054a612b44ea9b71dd22840c8249)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:58.273980 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acb704-c3f6-4633-9c59-b2d3f941366d tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:58.385610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:58.420568 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70acb704-c3f6-4633-9c59-b2d3f941366d tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a84054a612b44ea9b71dd22840c8249', 'request_id': 'req-70acb704-c3f6-4633-9c59-b2d3f941366d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:58.433889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d067475-24e0-4840-99fe-d697811ff04a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:58.450318 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70acb704-c3f6-4633-9c59-b2d3f941366d tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a84054a612b44ea9b71dd22840c8249', 'request_id': 'req-70acb704-c3f6-4633-9c59-b2d3f941366d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:58.465696 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70acb704-c3f6-4633-9c59-b2d3f941366d tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a84054a612b44ea9b71dd22840c8249', 'request_id': 'req-70acb704-c3f6-4633-9c59-b2d3f941366d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:58.502888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70acb704-c3f6-4633-9c59-b2d3f941366d tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] The token cache is being invalidate because project 7a84054a612b44ea9b71dd22840c8249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:24:58.503211 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70acb704-c3f6-4633-9c59-b2d3f941366d tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:58.504778 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70acb704-c3f6-4633-9c59-b2d3f941366d tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:58.511547 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 719/1450] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:24:57 2022] DELETE /identity/v3/projects/7a84054a612b44ea9b71dd22840c8249 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:58.511547 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acb704-c3f6-4633-9c59-b2d3f941366d tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:58.524261 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-70acb704-c3f6-4633-9c59-b2d3f941366d tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:58.635541 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0c0ae-1d29-47d3-9eb3-d5b44f96582b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:58.637387 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0c0ae-1d29-47d3-9eb3-d5b44f96582b admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:58.637809 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0c0ae-1d29-47d3-9eb3-d5b44f96582b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:58.638255 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0c0ae-1d29-47d3-9eb3-d5b44f96582b admin admin] PATH_INFO: `/v3/projects/801dbc831e3449198ffca18debc76a79/users/825f4860cc7e4ea0b49f2fd6831ea22f/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:58.714825 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0c0ae-1d29-47d3-9eb3-d5b44f96582b admin admin] RBAC: Authorizing `identity:create_grant(project_id=801dbc831e3449198ffca18debc76a79, user_id=825f4860cc7e4ea0b49f2fd6831ea22f, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:58.715622 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acb704-c3f6-4633-9c59-b2d3f941366d tempest-VolumeQuotaClassesTest-1035140519 tempest-VolumeQuotaClassesTest-1035140519-project-admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:58.718723 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0c0ae-1d29-47d3-9eb3-d5b44f96582b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:58.730617 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84937018-f19f-45dd-a5d7-2dd84b1a654d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:58.733305 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84937018-f19f-45dd-a5d7-2dd84b1a654d admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:58.734517 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84937018-f19f-45dd-a5d7-2dd84b1a654d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:58.734900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84937018-f19f-45dd-a5d7-2dd84b1a654d admin admin] PATH_INFO: `/v3/projects/f2d55d4699114407bdd1f2ef47f6d1a5/users/5916cb5cd9644bcc894cc8e0c70ea974/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:58.740105 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84937018-f19f-45dd-a5d7-2dd84b1a654d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d55d4699114407bdd1f2ef47f6d1a5, user_id=5916cb5cd9644bcc894cc8e0c70ea974, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:58.744856 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84937018-f19f-45dd-a5d7-2dd84b1a654d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:58.758274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 732/1451] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:58 2022] PUT /identity/v3/projects/801dbc831e3449198ffca18debc76a79/users/825f4860cc7e4ea0b49f2fd6831ea22f/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:58.760474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0c0ae-1d29-47d3-9eb3-d5b44f96582b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:58.778719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ade0c0ae-1d29-47d3-9eb3-d5b44f96582b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:58.785017 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 720/1452] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:24:58 2022] PUT /identity/v3/projects/f2d55d4699114407bdd1f2ef47f6d1a5/users/5916cb5cd9644bcc894cc8e0c70ea974/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:58.797027 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9c9a-733d-45af-aa30-064f9abc95ea None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:58.797424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9c9a-733d-45af-aa30-064f9abc95ea None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:58.797800 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9c9a-733d-45af-aa30-064f9abc95ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:58.859470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-84ce9c9a-733d-45af-aa30-064f9abc95ea None None] MFA Rules not processed for user `38b48da35205469abf5aa714dacfe6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:58.866370 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-84ce9c9a-733d-45af-aa30-064f9abc95ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:58.906607 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:58.992296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0c0ae-1d29-47d3-9eb3-d5b44f96582b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:59.008444 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 721/1453] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:59.010433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca0437-9d2d-41b9-87fe-beb94bff8422 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:59.011203 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca0437-9d2d-41b9-87fe-beb94bff8422 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:59.011769 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca0437-9d2d-41b9-87fe-beb94bff8422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:59.069178 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bfca0437-9d2d-41b9-87fe-beb94bff8422 None None] MFA Rules not processed for user `825f4860cc7e4ea0b49f2fd6831ea22f`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:59.071880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bfca0437-9d2d-41b9-87fe-beb94bff8422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:59.124805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748312a-28db-41b7-8e67-4a5c9e34871f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:59.125982 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748312a-28db-41b7-8e67-4a5c9e34871f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:59.127971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748312a-28db-41b7-8e67-4a5c9e34871f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:59.128448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748312a-28db-41b7-8e67-4a5c9e34871f admin admin] PATH_INFO: `/v3/users/0ed0bcd4868941a6885e0cea9389978b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:59.131910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748312a-28db-41b7-8e67-4a5c9e34871f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ed0bcd4868941a6885e0cea9389978b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:59.136704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748312a-28db-41b7-8e67-4a5c9e34871f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:59.213073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:59.258758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 722/1454] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:59.265870 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a37a8-3b53-4bc8-8635-e17255d0af7c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:59.268686 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a37a8-3b53-4bc8-8635-e17255d0af7c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:59.270224 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a37a8-3b53-4bc8-8635-e17255d0af7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:59.275220 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d748312a-28db-41b7-8e67-4a5c9e34871f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ed0bcd4868941a6885e0cea9389978b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:59.278338 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d748312a-28db-41b7-8e67-4a5c9e34871f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ed0bcd4868941a6885e0cea9389978b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:59.307146 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d748312a-28db-41b7-8e67-4a5c9e34871f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ed0bcd4868941a6885e0cea9389978b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:59.309945 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d748312a-28db-41b7-8e67-4a5c9e34871f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ed0bcd4868941a6885e0cea9389978b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:59.333216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d748312a-28db-41b7-8e67-4a5c9e34871f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ed0bcd4868941a6885e0cea9389978b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:59.381688 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-509a37a8-3b53-4bc8-8635-e17255d0af7c None None] MFA Rules not processed for user `5916cb5cd9644bcc894cc8e0c70ea974`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:24:59.382961 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-509a37a8-3b53-4bc8-8635-e17255d0af7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:59.430503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 733/1455] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:24:58 2022] DELETE /identity/v3/users/0ed0bcd4868941a6885e0cea9389978b => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:24:59.430503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748312a-28db-41b7-8e67-4a5c9e34871f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:59.436151 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d748312a-28db-41b7-8e67-4a5c9e34871f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:59.672068 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 723/1456] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:24:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:24:59.672932 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a37a8-3b53-4bc8-8635-e17255d0af7c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:59.683812 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-509a37a8-3b53-4bc8-8635-e17255d0af7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:59.708989 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a37a8-3b53-4bc8-8635-e17255d0af7c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:59.723682 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f6ba6-82fc-4c4d-9118-9204ed831b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:59.724356 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f6ba6-82fc-4c4d-9118-9204ed831b1a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:59.724731 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f6ba6-82fc-4c4d-9118-9204ed831b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:59.724897 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f6ba6-82fc-4c4d-9118-9204ed831b1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:59.725603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f6ba6-82fc-4c4d-9118-9204ed831b1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:59.734753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748312a-28db-41b7-8e67-4a5c9e34871f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:24:59.742519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f6ba6-82fc-4c4d-9118-9204ed831b1a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:59.777241 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3351b3-0649-4939-81d6-e95f3eb99c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:24:59.777949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3351b3-0649-4939-81d6-e95f3eb99c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:24:59.778228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3351b3-0649-4939-81d6-e95f3eb99c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:24:59.778502 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3351b3-0649-4939-81d6-e95f3eb99c53 admin admin] PATH_INFO: `/v3/users/452f57b8376847fba2d6fa615a6cf4c6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:24:59.779724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3351b3-0649-4939-81d6-e95f3eb99c53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=452f57b8376847fba2d6fa615a6cf4c6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:24:59.782125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3351b3-0649-4939-81d6-e95f3eb99c53 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:24:59.906153 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 724/1457] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:24:59 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:24:59.910977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f6ba6-82fc-4c4d-9118-9204ed831b1a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:24:59.917415 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f52f6ba6-82fc-4c4d-9118-9204ed831b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:24:59.930058 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8e3351b3-0649-4939-81d6-e95f3eb99c53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452f57b8376847fba2d6fa615a6cf4c6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:59.936464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8e3351b3-0649-4939-81d6-e95f3eb99c53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452f57b8376847fba2d6fa615a6cf4c6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:59.965638 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8e3351b3-0649-4939-81d6-e95f3eb99c53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452f57b8376847fba2d6fa615a6cf4c6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:59.967815 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8e3351b3-0649-4939-81d6-e95f3eb99c53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452f57b8376847fba2d6fa615a6cf4c6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:24:59.983464 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:59.999530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8e3351b3-0649-4939-81d6-e95f3eb99c53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452f57b8376847fba2d6fa615a6cf4c6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:00.079381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 734/1458] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:24:59 2022] DELETE /identity/v3/users/452f57b8376847fba2d6fa615a6cf4c6 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:00.080312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3351b3-0649-4939-81d6-e95f3eb99c53 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:00.088554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8e3351b3-0649-4939-81d6-e95f3eb99c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:00.136562 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f6ba6-82fc-4c4d-9118-9204ed831b1a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:00.216189 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:00.282174 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c49d4-adc8-43e3-87fb-57ea04919c82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:00.283444 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c49d4-adc8-43e3-87fb-57ea04919c82 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:00.284110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c49d4-adc8-43e3-87fb-57ea04919c82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:00.284720 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c49d4-adc8-43e3-87fb-57ea04919c82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:00.287228 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-db3c49d4-adc8-43e3-87fb-57ea04919c82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:00.330866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3351b3-0649-4939-81d6-e95f3eb99c53 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:00.341754 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6df668-6f3b-40b1-a6b6-b7e41421bf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:00.342393 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6df668-6f3b-40b1-a6b6-b7e41421bf17 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:00.342676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6df668-6f3b-40b1-a6b6-b7e41421bf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:00.343044 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6df668-6f3b-40b1-a6b6-b7e41421bf17 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:00.343921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6df668-6f3b-40b1-a6b6-b7e41421bf17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:00.346046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6df668-6f3b-40b1-a6b6-b7e41421bf17 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:00.399200 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 735/1459] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:00 2022] POST /identity/v3/users => generated 299 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:00.406376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc226e-db79-461b-b270-870dd57c04f3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:00.406667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc226e-db79-461b-b270-870dd57c04f3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:00.406949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc226e-db79-461b-b270-870dd57c04f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:00.446111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c49d4-adc8-43e3-87fb-57ea04919c82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:00.447842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c49d4-adc8-43e3-87fb-57ea04919c82 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:00.448177 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a1dc226e-db79-461b-b270-870dd57c04f3 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:00.449429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a1dc226e-db79-461b-b270-870dd57c04f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:00.476148 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 725/1460] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:24:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:00.477926 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368a0fe-01f3-4dbf-861a-833578b8d80c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:00.479554 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368a0fe-01f3-4dbf-861a-833578b8d80c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:00.480084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368a0fe-01f3-4dbf-861a-833578b8d80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:00.484869 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 736/1461] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:00.485845 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc226e-db79-461b-b270-870dd57c04f3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:00.507267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc226e-db79-461b-b270-870dd57c04f3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:00.527418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0e83d-4e78-4c43-82a7-09134128e092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:00.528131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0e83d-4e78-4c43-82a7-09134128e092 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:00.528415 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0e83d-4e78-4c43-82a7-09134128e092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:00.528688 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0e83d-4e78-4c43-82a7-09134128e092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:00.529374 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0e83d-4e78-4c43-82a7-09134128e092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:00.530322 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1368a0fe-01f3-4dbf-861a-833578b8d80c None None] MFA Rules not processed for user `b8532a4cfb224d75aab98dddf1dcd0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:00.533818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1368a0fe-01f3-4dbf-861a-833578b8d80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:00.538606 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0e83d-4e78-4c43-82a7-09134128e092 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:00.591037 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 737/1462] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:00.602783 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0e83d-4e78-4c43-82a7-09134128e092 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:00.633395 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0e83d-4e78-4c43-82a7-09134128e092 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:00.664533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8276b91-5fe2-4c15-86ad-cc867b67080f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:00.665755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8276b91-5fe2-4c15-86ad-cc867b67080f admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:00.668431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8276b91-5fe2-4c15-86ad-cc867b67080f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:00.668876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8276b91-5fe2-4c15-86ad-cc867b67080f admin admin] PATH_INFO: `/v3/projects/a7c91bf74dee4bbc96422ace75376fb9/users/0cae65997d954f50b775fb4aafbe9d60/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:00.706597 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8276b91-5fe2-4c15-86ad-cc867b67080f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c91bf74dee4bbc96422ace75376fb9, user_id=0cae65997d954f50b775fb4aafbe9d60, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:00.712198 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8276b91-5fe2-4c15-86ad-cc867b67080f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:00.720007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 726/1463] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:00.721936 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368a0fe-01f3-4dbf-861a-833578b8d80c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:00.728508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1368a0fe-01f3-4dbf-861a-833578b8d80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:00.743474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 738/1464] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:00 2022] PUT /identity/v3/projects/a7c91bf74dee4bbc96422ace75376fb9/users/0cae65997d954f50b775fb4aafbe9d60/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:00.747679 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8276b91-5fe2-4c15-86ad-cc867b67080f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:00.789903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:00.861209 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368a0fe-01f3-4dbf-861a-833578b8d80c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:00.916491 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8276b91-5fe2-4c15-86ad-cc867b67080f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:00.931900 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b86647-3ec8-4f62-a186-e41387682f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:00.932769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b86647-3ec8-4f62-a186-e41387682f6a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:00.934368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b86647-3ec8-4f62-a186-e41387682f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:00.934791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b86647-3ec8-4f62-a186-e41387682f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:00.936786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b86647-3ec8-4f62-a186-e41387682f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:00.943259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b86647-3ec8-4f62-a186-e41387682f6a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:00.968448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 739/1465] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:00.972583 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b86647-3ec8-4f62-a186-e41387682f6a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:01.020828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b86647-3ec8-4f62-a186-e41387682f6a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:01.037750 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f24e25-d6a2-4b1e-a9f5-1a92b09aa238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:01.040876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f24e25-d6a2-4b1e-a9f5-1a92b09aa238 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:01.043176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f24e25-d6a2-4b1e-a9f5-1a92b09aa238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:01.043618 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f24e25-d6a2-4b1e-a9f5-1a92b09aa238 admin admin] PATH_INFO: `/v3/projects/a7c91bf74dee4bbc96422ace75376fb9/users/0cae65997d954f50b775fb4aafbe9d60/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:01.048809 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f24e25-d6a2-4b1e-a9f5-1a92b09aa238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c91bf74dee4bbc96422ace75376fb9, user_id=0cae65997d954f50b775fb4aafbe9d60, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:01.049630 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343f3c0-dc21-4445-aceb-dd1bf4efe714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:01.052815 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343f3c0-dc21-4445-aceb-dd1bf4efe714 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:01.056115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343f3c0-dc21-4445-aceb-dd1bf4efe714 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:01.056660 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343f3c0-dc21-4445-aceb-dd1bf4efe714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:01.059142 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f24e25-d6a2-4b1e-a9f5-1a92b09aa238 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:01.091573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343f3c0-dc21-4445-aceb-dd1bf4efe714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:01.095296 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343f3c0-dc21-4445-aceb-dd1bf4efe714 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:01.113703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 740/1466] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:00 2022] PUT /identity/v3/projects/a7c91bf74dee4bbc96422ace75376fb9/users/0cae65997d954f50b775fb4aafbe9d60/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:01.113703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae2641-1790-4d37-8f1f-fe5ca38f1c5f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:01.113703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae2641-1790-4d37-8f1f-fe5ca38f1c5f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:01.113703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae2641-1790-4d37-8f1f-fe5ca38f1c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:01.139523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 727/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:01.141092 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40494381-328a-49ab-bfe1-510e18ca3505 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:01.141389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40494381-328a-49ab-bfe1-510e18ca3505 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:01.141657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40494381-328a-49ab-bfe1-510e18ca3505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:01.177888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-96ae2641-1790-4d37-8f1f-fe5ca38f1c5f None None] MFA Rules not processed for user `9bc07aa85f5643cfb89280a136496619`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:01.179403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-96ae2641-1790-4d37-8f1f-fe5ca38f1c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:01.214176 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-40494381-328a-49ab-bfe1-510e18ca3505 None None] MFA Rules not processed for user `0cae65997d954f50b775fb4aafbe9d60`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:01.219669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-40494381-328a-49ab-bfe1-510e18ca3505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:01.299662 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:01.336516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 741/1468] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:01.438388 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae2641-1790-4d37-8f1f-fe5ca38f1c5f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:01.439878 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-96ae2641-1790-4d37-8f1f-fe5ca38f1c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:01.456581 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 728/1469] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:01.464270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40494381-328a-49ab-bfe1-510e18ca3505 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:01.467982 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-40494381-328a-49ab-bfe1-510e18ca3505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:01.628937 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae2641-1790-4d37-8f1f-fe5ca38f1c5f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:01.630657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40494381-328a-49ab-bfe1-510e18ca3505 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:01.640564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecacea-d205-47fb-8c75-d092d5a45615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:01.642765 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e04ed-5fd6-4abb-ae82-e948106b2593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:01.643131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecacea-d205-47fb-8c75-d092d5a45615 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:01.643427 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e04ed-5fd6-4abb-ae82-e948106b2593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:01.643567 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecacea-d205-47fb-8c75-d092d5a45615 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:01.643712 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e04ed-5fd6-4abb-ae82-e948106b2593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:01.643808 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecacea-d205-47fb-8c75-d092d5a45615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:01.644015 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e04ed-5fd6-4abb-ae82-e948106b2593 admin admin] PATH_INFO: `/v3/users/6caffab075a74c05b68076c86d002c42` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:01.647595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e04ed-5fd6-4abb-ae82-e948106b2593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6caffab075a74c05b68076c86d002c42)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:01.648001 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-43ecacea-d205-47fb-8c75-d092d5a45615 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:01.652228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e04ed-5fd6-4abb-ae82-e948106b2593 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:01.719237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:01.757363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-813e04ed-5fd6-4abb-ae82-e948106b2593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6caffab075a74c05b68076c86d002c42'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:01.759144 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-813e04ed-5fd6-4abb-ae82-e948106b2593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6caffab075a74c05b68076c86d002c42'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:01.812068 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-813e04ed-5fd6-4abb-ae82-e948106b2593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6caffab075a74c05b68076c86d002c42'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:01.814125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-813e04ed-5fd6-4abb-ae82-e948106b2593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6caffab075a74c05b68076c86d002c42'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:01.828265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-813e04ed-5fd6-4abb-ae82-e948106b2593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6caffab075a74c05b68076c86d002c42'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:01.883638 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecacea-d205-47fb-8c75-d092d5a45615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:01.890533 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecacea-d205-47fb-8c75-d092d5a45615 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:01.898056 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 742/1470] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:01 2022] DELETE /identity/v3/users/6caffab075a74c05b68076c86d002c42 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:01.910242 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3e91d-d63c-4d27-877f-d25f5576e64e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:01.910665 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3e91d-d63c-4d27-877f-d25f5576e64e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:01.910951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3e91d-d63c-4d27-877f-d25f5576e64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:01.941703 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 729/1471] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:01.943306 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd426b-c699-4b84-bc48-516cafb62533 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:01.946718 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd426b-c699-4b84-bc48-516cafb62533 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:01.948206 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd426b-c699-4b84-bc48-516cafb62533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:02.008068 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-36cd426b-c699-4b84-bc48-516cafb62533 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:02.009652 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-36cd426b-c699-4b84-bc48-516cafb62533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:02.112728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e4d3e91d-d63c-4d27-877f-d25f5576e64e None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:02.114867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e4d3e91d-d63c-4d27-877f-d25f5576e64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:02.242984 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 730/1472] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:02.247151 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1cb46-494f-4822-88a5-aad747fb7203 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:02.247151 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1cb46-494f-4822-88a5-aad747fb7203 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:02.247566 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1cb46-494f-4822-88a5-aad747fb7203 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:02.251878 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 731/1473] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 17 10:25:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:25:02.255545 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1cb46-494f-4822-88a5-aad747fb7203 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:02.259703 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e7a1cb46-494f-4822-88a5-aad747fb7203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:02.276474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:02.353915 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 743/1474] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 17 10:25:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:02.355058 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdc2fe-a74b-40d5-961f-d0ae6ba37bfc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:02.355346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdc2fe-a74b-40d5-961f-d0ae6ba37bfc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:02.355618 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdc2fe-a74b-40d5-961f-d0ae6ba37bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:02.396908 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-93bdc2fe-a74b-40d5-961f-d0ae6ba37bfc None None] MFA Rules not processed for user `98030e60807e44ec928488e904ca24c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:02.398123 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-93bdc2fe-a74b-40d5-961f-d0ae6ba37bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:02.432774 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1cb46-494f-4822-88a5-aad747fb7203 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:02.446848 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1eaa2-87f3-404b-a08a-ff4822166db2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:02.447481 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1eaa2-87f3-404b-a08a-ff4822166db2 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:02.447800 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1eaa2-87f3-404b-a08a-ff4822166db2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:02.448106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1eaa2-87f3-404b-a08a-ff4822166db2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:02.477114 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1eaa2-87f3-404b-a08a-ff4822166db2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:02.480240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1eaa2-87f3-404b-a08a-ff4822166db2 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:02.522111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 732/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:02.558946 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 744/1476] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 17 10:25:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:02.598400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1eaa2-87f3-404b-a08a-ff4822166db2 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:02.608582 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1eaa2-87f3-404b-a08a-ff4822166db2 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:02.621194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92cbc2-4abc-444e-abbb-b1de31fad77c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:02.621434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92cbc2-4abc-444e-abbb-b1de31fad77c service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:02.621782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92cbc2-4abc-444e-abbb-b1de31fad77c service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:02.622011 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92cbc2-4abc-444e-abbb-b1de31fad77c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:02.640830 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92cbc2-4abc-444e-abbb-b1de31fad77c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:02.642356 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92cbc2-4abc-444e-abbb-b1de31fad77c service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:02.653413 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdc2fe-a74b-40d5-961f-d0ae6ba37bfc None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:02.655091 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-93bdc2fe-a74b-40d5-961f-d0ae6ba37bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:02.689406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 733/1477] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:02.862572 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997f5b0-4de3-4506-a932-6f39497157b3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:02.862872 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997f5b0-4de3-4506-a932-6f39497157b3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:02.863158 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997f5b0-4de3-4506-a932-6f39497157b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:02.933546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9997f5b0-4de3-4506-a932-6f39497157b3 None None] MFA Rules not processed for user `98030e60807e44ec928488e904ca24c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:02.940602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9997f5b0-4de3-4506-a932-6f39497157b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:02.979869 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 734/1478] 10.222.0.40 () {58 vars in 1015 bytes} [Mon Oct 17 10:25:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:02.992008 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdc2fe-a74b-40d5-961f-d0ae6ba37bfc None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:02.998669 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcab043-1571-4735-9600-a884af2c131f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:02.999335 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcab043-1571-4735-9600-a884af2c131f service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:02.999595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcab043-1571-4735-9600-a884af2c131f service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:02.999869 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcab043-1571-4735-9600-a884af2c131f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:03.013824 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcab043-1571-4735-9600-a884af2c131f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:03.016575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcab043-1571-4735-9600-a884af2c131f service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:03.117121 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 745/1479] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:25:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 17 10:25:03.246831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997f5b0-4de3-4506-a932-6f39497157b3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:03.249011 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9997f5b0-4de3-4506-a932-6f39497157b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:03.269152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997f5b0-4de3-4506-a932-6f39497157b3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:03.282400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4637f69-6ac4-4efb-97c0-7979b76f0f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:03.283262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637f69-6ac4-4efb-97c0-7979b76f0f4a service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:03.284527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637f69-6ac4-4efb-97c0-7979b76f0f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:03.285048 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637f69-6ac4-4efb-97c0-7979b76f0f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:03.298110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4637f69-6ac4-4efb-97c0-7979b76f0f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:03.300322 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4637f69-6ac4-4efb-97c0-7979b76f0f4a service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:03.324000 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 735/1480] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:04.717926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcab043-1571-4735-9600-a884af2c131f service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:04.719392 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6fcab043-1571-4735-9600-a884af2c131f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:04.786846 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcab043-1571-4735-9600-a884af2c131f service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:04.824656 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0eca21-fd47-4baf-a499-0263d9026942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:04.826848 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eca21-fd47-4baf-a499-0263d9026942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:04.827130 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eca21-fd47-4baf-a499-0263d9026942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:04.827404 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eca21-fd47-4baf-a499-0263d9026942 admin admin] PATH_INFO: `/v3/projects/e6e00a486ee446f8bda912ac6fbc7c31` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:04.842185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0eca21-fd47-4baf-a499-0263d9026942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e00a486ee446f8bda912ac6fbc7c31)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:04.851791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0eca21-fd47-4baf-a499-0263d9026942 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:05.033354 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6e0eca21-fd47-4baf-a499-0263d9026942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e00a486ee446f8bda912ac6fbc7c31', 'request_id': 'req-6e0eca21-fd47-4baf-a499-0263d9026942'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:05.051904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6e0eca21-fd47-4baf-a499-0263d9026942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e00a486ee446f8bda912ac6fbc7c31', 'request_id': 'req-6e0eca21-fd47-4baf-a499-0263d9026942'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:05.072144 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6e0eca21-fd47-4baf-a499-0263d9026942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e00a486ee446f8bda912ac6fbc7c31', 'request_id': 'req-6e0eca21-fd47-4baf-a499-0263d9026942'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:05.086434 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:05.113053 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6e0eca21-fd47-4baf-a499-0263d9026942 admin admin] The token cache is being invalidate because project e6e00a486ee446f8bda912ac6fbc7c31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:05.116207 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6e0eca21-fd47-4baf-a499-0263d9026942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:05.117806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6e0eca21-fd47-4baf-a499-0263d9026942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:05.123973 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 746/1481] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:04 2022] DELETE /identity/v3/projects/e6e00a486ee446f8bda912ac6fbc7c31 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:05.128637 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4637f69-6ac4-4efb-97c0-7979b76f0f4a service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:05.156226 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4637f69-6ac4-4efb-97c0-7979b76f0f4a service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:05.210895 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:05.276695 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ca421-56ac-45a6-bc9c-5756a15c7567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:05.277797 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ca421-56ac-45a6-bc9c-5756a15c7567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:05.278792 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ca421-56ac-45a6-bc9c-5756a15c7567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:05.279105 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ca421-56ac-45a6-bc9c-5756a15c7567 admin admin] PATH_INFO: `/v3/users/5916cb5cd9644bcc894cc8e0c70ea974` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:05.283611 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ca421-56ac-45a6-bc9c-5756a15c7567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5916cb5cd9644bcc894cc8e0c70ea974)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:05.285152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ca421-56ac-45a6-bc9c-5756a15c7567 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:05.321344 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0eca21-fd47-4baf-a499-0263d9026942 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:05.324115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6e0eca21-fd47-4baf-a499-0263d9026942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:05.349576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0eca21-fd47-4baf-a499-0263d9026942 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:05.361682 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0efb54-a41a-46b5-a0cf-db13e4466b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:05.362974 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0efb54-a41a-46b5-a0cf-db13e4466b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:05.363475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0efb54-a41a-46b5-a0cf-db13e4466b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:05.363887 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0efb54-a41a-46b5-a0cf-db13e4466b95 admin admin] PATH_INFO: `/v3/projects/85bfe589ecd54c66b288f79f138be596` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:05.365794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0efb54-a41a-46b5-a0cf-db13e4466b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85bfe589ecd54c66b288f79f138be596)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:05.368124 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0efb54-a41a-46b5-a0cf-db13e4466b95 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:05.447201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-300ca421-56ac-45a6-bc9c-5756a15c7567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5916cb5cd9644bcc894cc8e0c70ea974'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:05.448031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-300ca421-56ac-45a6-bc9c-5756a15c7567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5916cb5cd9644bcc894cc8e0c70ea974'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:05.466633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-300ca421-56ac-45a6-bc9c-5756a15c7567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5916cb5cd9644bcc894cc8e0c70ea974'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:05.467630 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-300ca421-56ac-45a6-bc9c-5756a15c7567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5916cb5cd9644bcc894cc8e0c70ea974'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:05.483571 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-300ca421-56ac-45a6-bc9c-5756a15c7567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5916cb5cd9644bcc894cc8e0c70ea974'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:05.514832 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea0efb54-a41a-46b5-a0cf-db13e4466b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85bfe589ecd54c66b288f79f138be596', 'request_id': 'req-ea0efb54-a41a-46b5-a0cf-db13e4466b95'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:05.534254 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 736/1482] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:05 2022] DELETE /identity/v3/users/5916cb5cd9644bcc894cc8e0c70ea974 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:05.538090 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea0efb54-a41a-46b5-a0cf-db13e4466b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85bfe589ecd54c66b288f79f138be596', 'request_id': 'req-ea0efb54-a41a-46b5-a0cf-db13e4466b95'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:05.575639 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea0efb54-a41a-46b5-a0cf-db13e4466b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85bfe589ecd54c66b288f79f138be596', 'request_id': 'req-ea0efb54-a41a-46b5-a0cf-db13e4466b95'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:05.634713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea0efb54-a41a-46b5-a0cf-db13e4466b95 admin admin] The token cache is being invalidate because project 85bfe589ecd54c66b288f79f138be596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:05.635904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea0efb54-a41a-46b5-a0cf-db13e4466b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:05.640382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea0efb54-a41a-46b5-a0cf-db13e4466b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:05.647454 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 747/1483] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:05 2022] DELETE /identity/v3/projects/85bfe589ecd54c66b288f79f138be596 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:05.654646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d79cd7-447e-4471-8f72-e4ff3b2fd86e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:05.654932 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d79cd7-447e-4471-8f72-e4ff3b2fd86e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:05.655202 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d79cd7-447e-4471-8f72-e4ff3b2fd86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:05.745629 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-46d79cd7-447e-4471-8f72-e4ff3b2fd86e None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:05.749975 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-46d79cd7-447e-4471-8f72-e4ff3b2fd86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:05.935545 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 737/1484] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:05.943657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37e3c-83ec-4bf8-a2ec-99ca42541763 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:05.944763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37e3c-83ec-4bf8-a2ec-99ca42541763 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:05.945303 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37e3c-83ec-4bf8-a2ec-99ca42541763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:06.012404 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-93b37e3c-83ec-4bf8-a2ec-99ca42541763 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:06.017269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-93b37e3c-83ec-4bf8-a2ec-99ca42541763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:06.048681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 748/1485] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:06.053188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d79cd7-447e-4471-8f72-e4ff3b2fd86e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:06.085964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d79cd7-447e-4471-8f72-e4ff3b2fd86e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:06.092855 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91060387-2ccc-4ad7-93e0-162891bb591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:06.093790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91060387-2ccc-4ad7-93e0-162891bb591d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:06.094214 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91060387-2ccc-4ad7-93e0-162891bb591d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:06.094633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91060387-2ccc-4ad7-93e0-162891bb591d admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:06.095430 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91060387-2ccc-4ad7-93e0-162891bb591d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:06.095864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91060387-2ccc-4ad7-93e0-162891bb591d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:06.098485 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91060387-2ccc-4ad7-93e0-162891bb591d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:06.139431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 738/1486] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:25:06.143621 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37e3c-83ec-4bf8-a2ec-99ca42541763 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:06.156652 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37e3c-83ec-4bf8-a2ec-99ca42541763 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:06.168218 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6711e0f-906b-447f-9f7c-58d28f04c3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:06.169181 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6711e0f-906b-447f-9f7c-58d28f04c3cd admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:06.169495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6711e0f-906b-447f-9f7c-58d28f04c3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:06.172110 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6711e0f-906b-447f-9f7c-58d28f04c3cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:06.172799 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6711e0f-906b-447f-9f7c-58d28f04c3cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:06.177225 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6711e0f-906b-447f-9f7c-58d28f04c3cd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:06.235833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 749/1487] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:06 2022] POST /identity/v3/projects => generated 359 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:06.240791 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91060387-2ccc-4ad7-93e0-162891bb591d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:06.261099 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91060387-2ccc-4ad7-93e0-162891bb591d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:06.274375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6711e0f-906b-447f-9f7c-58d28f04c3cd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:06.280179 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b6711e0f-906b-447f-9f7c-58d28f04c3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:06.457931 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:06.563353 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1ac6e-2590-4439-8312-697ab7fc77e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:06.564270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1ac6e-2590-4439-8312-697ab7fc77e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:06.568351 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1ac6e-2590-4439-8312-697ab7fc77e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:06.569980 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1ac6e-2590-4439-8312-697ab7fc77e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:06.570896 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1ac6e-2590-4439-8312-697ab7fc77e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:06.579453 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1ac6e-2590-4439-8312-697ab7fc77e5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:06.606466 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6711e0f-906b-447f-9f7c-58d28f04c3cd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:06.629383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:06.632555 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:06.635725 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:06.636116 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2 admin admin] PATH_INFO: `/v3/projects/6351bf33dfc443b392bf12b1e990b4ab` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:06.643087 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6351bf33dfc443b392bf12b1e990b4ab)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:06.655650 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:06.657840 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 739/1488] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:06 2022] POST /identity/v3/users => generated 280 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:06.659883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1ac6e-2590-4439-8312-697ab7fc77e5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:06.711525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1ac6e-2590-4439-8312-697ab7fc77e5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:06.738281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40458804-c392-4cc2-a899-490310d9b065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:06.741854 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40458804-c392-4cc2-a899-490310d9b065 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:06.743202 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40458804-c392-4cc2-a899-490310d9b065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:06.745762 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40458804-c392-4cc2-a899-490310d9b065 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:06.746649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40458804-c392-4cc2-a899-490310d9b065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:06.754868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40458804-c392-4cc2-a899-490310d9b065 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:06.774230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6351bf33dfc443b392bf12b1e990b4ab', 'request_id': 'req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:06.778226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:06.793353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6351bf33dfc443b392bf12b1e990b4ab', 'request_id': 'req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:06.805681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 740/1489] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:06.809531 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40458804-c392-4cc2-a899-490310d9b065 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:06.812586 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6351bf33dfc443b392bf12b1e990b4ab', 'request_id': 'req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:06.842345 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40458804-c392-4cc2-a899-490310d9b065 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:06.884304 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2 admin admin] The token cache is being invalidate because project 6351bf33dfc443b392bf12b1e990b4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:06.884629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:06.888662 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:06.907771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 750/1490] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:06 2022] DELETE /identity/v3/projects/6351bf33dfc443b392bf12b1e990b4ab => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:06.913869 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:06.920239 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:07.080937 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d13b7-856d-475f-a7e9-66864e6a4f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:07.081639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d13b7-856d-475f-a7e9-66864e6a4f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:07.081920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d13b7-856d-475f-a7e9-66864e6a4f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:07.082708 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d13b7-856d-475f-a7e9-66864e6a4f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:07.083491 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d13b7-856d-475f-a7e9-66864e6a4f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:07.095858 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d13b7-856d-475f-a7e9-66864e6a4f99 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:07.132921 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 741/1491] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:07.138564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d13b7-856d-475f-a7e9-66864e6a4f99 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:07.140574 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e07d13b7-856d-475f-a7e9-66864e6a4f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:07.172471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d13b7-856d-475f-a7e9-66864e6a4f99 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:07.194445 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5f26c-8ae3-4f6e-a2ba-a8bc2af78aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:07.195236 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5f26c-8ae3-4f6e-a2ba-a8bc2af78aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:07.196942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5f26c-8ae3-4f6e-a2ba-a8bc2af78aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:07.198554 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5f26c-8ae3-4f6e-a2ba-a8bc2af78aa2 admin admin] PATH_INFO: `/v3/projects/62b224f9763443aa972687a461ecdc02/users/fdca30b3f76043949fee5bf485af705b/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:07.251715 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5f26c-8ae3-4f6e-a2ba-a8bc2af78aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b224f9763443aa972687a461ecdc02, user_id=fdca30b3f76043949fee5bf485af705b, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:07.258048 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5f26c-8ae3-4f6e-a2ba-a8bc2af78aa2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:07.289613 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 742/1492] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:07 2022] PUT /identity/v3/projects/62b224f9763443aa972687a461ecdc02/users/fdca30b3f76043949fee5bf485af705b/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:07.310124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d3d46-d140-48c2-af26-3b87f3ae3a97 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:07.310433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d3d46-d140-48c2-af26-3b87f3ae3a97 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:07.310722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d3d46-d140-48c2-af26-3b87f3ae3a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:07.377631 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-381d3d46-d140-48c2-af26-3b87f3ae3a97 None None] MFA Rules not processed for user `fdca30b3f76043949fee5bf485af705b`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:07.382006 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-381d3d46-d140-48c2-af26-3b87f3ae3a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:07.420625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472512f1-657a-4c86-a5e9-8da6ed9dc9a2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:07.668920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 743/1493] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:07.718979 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d3d46-d140-48c2-af26-3b87f3ae3a97 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:07.721248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-381d3d46-d140-48c2-af26-3b87f3ae3a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:07.740876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c529b-45cf-4046-9a8a-d6971e95c794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:07.741545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c529b-45cf-4046-9a8a-d6971e95c794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:07.741824 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c529b-45cf-4046-9a8a-d6971e95c794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:07.742109 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c529b-45cf-4046-9a8a-d6971e95c794 admin admin] PATH_INFO: `/v3/users/2d634ab3d6ba4c8bba061a6cb09ae5ff` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:07.748797 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c529b-45cf-4046-9a8a-d6971e95c794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d634ab3d6ba4c8bba061a6cb09ae5ff)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:07.763808 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c529b-45cf-4046-9a8a-d6971e95c794 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:07.781876 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:07.904585 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0f8c529b-45cf-4046-9a8a-d6971e95c794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d634ab3d6ba4c8bba061a6cb09ae5ff'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:07.916795 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0f8c529b-45cf-4046-9a8a-d6971e95c794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d634ab3d6ba4c8bba061a6cb09ae5ff'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:07.922274 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d3d46-d140-48c2-af26-3b87f3ae3a97 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:07.928511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a882a-08ed-4c00-9131-5b6e6d53aac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:07.929450 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a882a-08ed-4c00-9131-5b6e6d53aac8 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:07.930425 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a882a-08ed-4c00-9131-5b6e6d53aac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:07.930881 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a882a-08ed-4c00-9131-5b6e6d53aac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:07.934471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0f8c529b-45cf-4046-9a8a-d6971e95c794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d634ab3d6ba4c8bba061a6cb09ae5ff'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:07.935249 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0f8c529b-45cf-4046-9a8a-d6971e95c794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d634ab3d6ba4c8bba061a6cb09ae5ff'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:07.947093 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a882a-08ed-4c00-9131-5b6e6d53aac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:07.950453 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a882a-08ed-4c00-9131-5b6e6d53aac8 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:07.960529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0f8c529b-45cf-4046-9a8a-d6971e95c794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d634ab3d6ba4c8bba061a6cb09ae5ff'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:07.985309 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 744/1494] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:25:08.013024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 751/1495] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:06 2022] DELETE /identity/v3/users/2d634ab3d6ba4c8bba061a6cb09ae5ff => generated 0 bytes in 1101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:08.026139 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a882a-08ed-4c00-9131-5b6e6d53aac8 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:08.092416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a882a-08ed-4c00-9131-5b6e6d53aac8 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:08.234895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c529b-45cf-4046-9a8a-d6971e95c794 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:08.236678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0f8c529b-45cf-4046-9a8a-d6971e95c794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:08.255949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:08.317069 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07208198-eb6c-4eef-92bf-8388e3028cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:08.320976 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208198-eb6c-4eef-92bf-8388e3028cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:08.322281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208198-eb6c-4eef-92bf-8388e3028cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:08.322779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208198-eb6c-4eef-92bf-8388e3028cb5 admin admin] PATH_INFO: `/v3/users/fdca30b3f76043949fee5bf485af705b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:08.328848 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07208198-eb6c-4eef-92bf-8388e3028cb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdca30b3f76043949fee5bf485af705b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:08.335641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07208198-eb6c-4eef-92bf-8388e3028cb5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:08.460908 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c529b-45cf-4046-9a8a-d6971e95c794 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:08.471650 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a93078-d32d-4685-9a53-98c882a29d3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:08.472356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a93078-d32d-4685-9a53-98c882a29d3d service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:08.472750 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a93078-d32d-4685-9a53-98c882a29d3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:08.473632 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a93078-d32d-4685-9a53-98c882a29d3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:08.475985 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-07208198-eb6c-4eef-92bf-8388e3028cb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdca30b3f76043949fee5bf485af705b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:08.477372 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-81a93078-d32d-4685-9a53-98c882a29d3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:08.477863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-07208198-eb6c-4eef-92bf-8388e3028cb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdca30b3f76043949fee5bf485af705b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:08.510174 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-07208198-eb6c-4eef-92bf-8388e3028cb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdca30b3f76043949fee5bf485af705b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:08.513443 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-07208198-eb6c-4eef-92bf-8388e3028cb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdca30b3f76043949fee5bf485af705b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:08.547712 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-07208198-eb6c-4eef-92bf-8388e3028cb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdca30b3f76043949fee5bf485af705b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:08.679342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a93078-d32d-4685-9a53-98c882a29d3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:08.680883 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a93078-d32d-4685-9a53-98c882a29d3d service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:08.694845 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 745/1496] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:08 2022] DELETE /identity/v3/users/fdca30b3f76043949fee5bf485af705b => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:08.696753 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4348e-3218-4089-a4c0-ed78ddf84d4a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:08.711055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4348e-3218-4089-a4c0-ed78ddf84d4a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:08.711674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4348e-3218-4089-a4c0-ed78ddf84d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:08.717448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 752/1497] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:25:08.788814 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a93078-d32d-4685-9a53-98c882a29d3d service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:08.790338 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-81a93078-d32d-4685-9a53-98c882a29d3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:08.824479 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a93078-d32d-4685-9a53-98c882a29d3d service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:08.841557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-35b4348e-3218-4089-a4c0-ed78ddf84d4a None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:08.854838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-35b4348e-3218-4089-a4c0-ed78ddf84d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:09.007524 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:09.116836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 746/1498] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:09.122117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acacd9-5ed9-4cca-9aaa-6cb99c72ae07 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:09.123320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acacd9-5ed9-4cca-9aaa-6cb99c72ae07 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:09.125309 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acacd9-5ed9-4cca-9aaa-6cb99c72ae07 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:09.137790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 747/1499] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 17 10:25:09 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:25:09.156479 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006da95-2980-4c4b-86c1-899889f1156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:09.157352 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006da95-2980-4c4b-86c1-899889f1156a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:09.157783 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006da95-2980-4c4b-86c1-899889f1156a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:09.158206 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006da95-2980-4c4b-86c1-899889f1156a admin admin] PATH_INFO: `/v3/projects/f2d55d4699114407bdd1f2ef47f6d1a5` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:09.159789 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006da95-2980-4c4b-86c1-899889f1156a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d55d4699114407bdd1f2ef47f6d1a5)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:09.162006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006da95-2980-4c4b-86c1-899889f1156a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:09.249175 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1006da95-2980-4c4b-86c1-899889f1156a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d55d4699114407bdd1f2ef47f6d1a5', 'request_id': 'req-1006da95-2980-4c4b-86c1-899889f1156a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:09.273127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1006da95-2980-4c4b-86c1-899889f1156a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d55d4699114407bdd1f2ef47f6d1a5', 'request_id': 'req-1006da95-2980-4c4b-86c1-899889f1156a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:09.276915 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:09.292872 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1006da95-2980-4c4b-86c1-899889f1156a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d55d4699114407bdd1f2ef47f6d1a5', 'request_id': 'req-1006da95-2980-4c4b-86c1-899889f1156a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:09.314503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1006da95-2980-4c4b-86c1-899889f1156a admin admin] The token cache is being invalidate because project f2d55d4699114407bdd1f2ef47f6d1a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:09.315842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1006da95-2980-4c4b-86c1-899889f1156a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:09.320702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1006da95-2980-4c4b-86c1-899889f1156a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:09.322944 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 753/1500] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:08 2022] DELETE /identity/v3/projects/f2d55d4699114407bdd1f2ef47f6d1a5 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:09.340357 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7662d0b-dd84-4bb7-b7b2-31d17080fae9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:09.340840 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7662d0b-dd84-4bb7-b7b2-31d17080fae9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:09.340981 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7662d0b-dd84-4bb7-b7b2-31d17080fae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:09.397168 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f7662d0b-dd84-4bb7-b7b2-31d17080fae9 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:09.401408 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f7662d0b-dd84-4bb7-b7b2-31d17080fae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:09.502699 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc70248-8e5d-4b9d-b15f-e4ffb3a46693 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:09.503331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc70248-8e5d-4b9d-b15f-e4ffb3a46693 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:09.503331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc70248-8e5d-4b9d-b15f-e4ffb3a46693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:09.559829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0cc70248-8e5d-4b9d-b15f-e4ffb3a46693 None None] MFA Rules not processed for user `a80cc7ec3d2d49f88c81403f918a6900`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:09.568393 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0cc70248-8e5d-4b9d-b15f-e4ffb3a46693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:09.670523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 748/1501] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:09.672445 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7662d0b-dd84-4bb7-b7b2-31d17080fae9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:09.680862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f7662d0b-dd84-4bb7-b7b2-31d17080fae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:09.888377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 754/1502] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 17 10:25:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:09.907997 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c8a17-e0fe-40ea-b670-1eab3d3f77f6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:09.909603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c8a17-e0fe-40ea-b670-1eab3d3f77f6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:09.912052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c8a17-e0fe-40ea-b670-1eab3d3f77f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:09.963829 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7662d0b-dd84-4bb7-b7b2-31d17080fae9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:09.976083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595305ff-8cbc-4d92-b973-9ff6204e53d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:09.976736 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595305ff-8cbc-4d92-b973-9ff6204e53d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:09.977020 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595305ff-8cbc-4d92-b973-9ff6204e53d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:09.977300 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595305ff-8cbc-4d92-b973-9ff6204e53d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:09.987344 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-595305ff-8cbc-4d92-b973-9ff6204e53d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:09.988307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e88c8a17-e0fe-40ea-b670-1eab3d3f77f6 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:09.991456 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e88c8a17-e0fe-40ea-b670-1eab3d3f77f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:10.025637 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 755/1503] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:10.027583 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c8a17-e0fe-40ea-b670-1eab3d3f77f6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:10.040260 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595305ff-8cbc-4d92-b973-9ff6204e53d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:10.040260 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595305ff-8cbc-4d92-b973-9ff6204e53d3 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:10.050326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e88c8a17-e0fe-40ea-b670-1eab3d3f77f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:10.076878 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 749/1504] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:10.077769 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595305ff-8cbc-4d92-b973-9ff6204e53d3 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:10.118495 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595305ff-8cbc-4d92-b973-9ff6204e53d3 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:10.129736 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b67613-842e-4afc-a7ec-2ddb5c1463e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:10.130502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b67613-842e-4afc-a7ec-2ddb5c1463e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:10.132633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b67613-842e-4afc-a7ec-2ddb5c1463e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:10.133040 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b67613-842e-4afc-a7ec-2ddb5c1463e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:10.133850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b67613-842e-4afc-a7ec-2ddb5c1463e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:10.137093 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b67613-842e-4afc-a7ec-2ddb5c1463e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:10.138872 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b67613-842e-4afc-a7ec-2ddb5c1463e1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:10.166939 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c8a17-e0fe-40ea-b670-1eab3d3f77f6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:10.184464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb48a2b-e4f4-49b1-90ad-9fd389ac65f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:10.188888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 750/1505] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:25:10.189966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb48a2b-e4f4-49b1-90ad-9fd389ac65f0 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:10.190137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b67613-842e-4afc-a7ec-2ddb5c1463e1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:10.190542 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb48a2b-e4f4-49b1-90ad-9fd389ac65f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:10.190958 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb48a2b-e4f4-49b1-90ad-9fd389ac65f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:10.223802 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b67613-842e-4afc-a7ec-2ddb5c1463e1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:10.237719 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464e19f-895c-4849-af17-1ad703ef46ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:10.239053 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb48a2b-e4f4-49b1-90ad-9fd389ac65f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:10.239670 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e19f-895c-4849-af17-1ad703ef46ae admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:10.240994 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb48a2b-e4f4-49b1-90ad-9fd389ac65f0 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:10.244754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e19f-895c-4849-af17-1ad703ef46ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:10.245237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e19f-895c-4849-af17-1ad703ef46ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:10.246209 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464e19f-895c-4849-af17-1ad703ef46ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:10.248615 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464e19f-895c-4849-af17-1ad703ef46ae admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:10.280760 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 756/1506] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:10.297063 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb48a2b-e4f4-49b1-90ad-9fd389ac65f0 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:10.300511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 751/1507] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:10 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:10.341164 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb48a2b-e4f4-49b1-90ad-9fd389ac65f0 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:10.570523 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c356e62-2fbc-4dc5-ae11-d89fe319fff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:10.572912 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c356e62-2fbc-4dc5-ae11-d89fe319fff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:10.573526 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c356e62-2fbc-4dc5-ae11-d89fe319fff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:10.573973 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c356e62-2fbc-4dc5-ae11-d89fe319fff7 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:10.574819 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c356e62-2fbc-4dc5-ae11-d89fe319fff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:10.578011 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c356e62-2fbc-4dc5-ae11-d89fe319fff7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:10.635982 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 757/1508] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:10 2022] POST /identity/v3/users => generated 284 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:10.640768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464e19f-895c-4849-af17-1ad703ef46ae admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:10.663602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464e19f-895c-4849-af17-1ad703ef46ae admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:10.691562 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba4b96-7037-4a18-8164-667473811ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:10.694699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba4b96-7037-4a18-8164-667473811ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:10.695004 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba4b96-7037-4a18-8164-667473811ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:10.695279 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba4b96-7037-4a18-8164-667473811ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:10.695995 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba4b96-7037-4a18-8164-667473811ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:10.700510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba4b96-7037-4a18-8164-667473811ad6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:10.746329 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 752/1509] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:10.750720 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c356e62-2fbc-4dc5-ae11-d89fe319fff7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:10.766640 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c356e62-2fbc-4dc5-ae11-d89fe319fff7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:10.782617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164421d-251a-4b8c-bb79-879bc5e06057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:10.783478 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164421d-251a-4b8c-bb79-879bc5e06057 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:10.783903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164421d-251a-4b8c-bb79-879bc5e06057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:10.784362 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164421d-251a-4b8c-bb79-879bc5e06057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:10.785162 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164421d-251a-4b8c-bb79-879bc5e06057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:10.787379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164421d-251a-4b8c-bb79-879bc5e06057 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:10.812614 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 758/1510] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:25:10.817522 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba4b96-7037-4a18-8164-667473811ad6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:10.833803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba4b96-7037-4a18-8164-667473811ad6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:10.852703 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee1d80-a754-407f-bd82-4d9069570897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:10.857550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee1d80-a754-407f-bd82-4d9069570897 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:10.858000 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee1d80-a754-407f-bd82-4d9069570897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:10.859825 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee1d80-a754-407f-bd82-4d9069570897 admin admin] PATH_INFO: `/v3/projects/f9a49d84ae9e4ad8bd5c9f3076f6cdc0/users/dcf38039e797455090b88cda5827bc8d/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:10.908616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee1d80-a754-407f-bd82-4d9069570897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a49d84ae9e4ad8bd5c9f3076f6cdc0, user_id=dcf38039e797455090b88cda5827bc8d, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:10.917758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee1d80-a754-407f-bd82-4d9069570897 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:10.956906 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 753/1511] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:10 2022] PUT /identity/v3/projects/f9a49d84ae9e4ad8bd5c9f3076f6cdc0/users/dcf38039e797455090b88cda5827bc8d/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:10.968638 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35947245-1c25-4481-87dc-bf81c8cbd414 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:10.969189 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35947245-1c25-4481-87dc-bf81c8cbd414 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:10.969859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35947245-1c25-4481-87dc-bf81c8cbd414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:11.034039 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-35947245-1c25-4481-87dc-bf81c8cbd414 None None] MFA Rules not processed for user `dcf38039e797455090b88cda5827bc8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:11.038162 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-35947245-1c25-4481-87dc-bf81c8cbd414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:11.135154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:11.282072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 759/1512] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:11.287415 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee1d80-a754-407f-bd82-4d9069570897 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:11.324828 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:11.437446 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee1d80-a754-407f-bd82-4d9069570897 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:11.443950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec1152-192b-44d1-8b9f-84ade14bde38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:11.444853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec1152-192b-44d1-8b9f-84ade14bde38 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:11.445134 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec1152-192b-44d1-8b9f-84ade14bde38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:11.445409 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec1152-192b-44d1-8b9f-84ade14bde38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:11.446055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec1152-192b-44d1-8b9f-84ade14bde38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:11.449416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec1152-192b-44d1-8b9f-84ade14bde38 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:11.499818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 754/1513] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:11 2022] POST /identity/v3/projects => generated 367 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:11.505347 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35947245-1c25-4481-87dc-bf81c8cbd414 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:11.554363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35947245-1c25-4481-87dc-bf81c8cbd414 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:11.717307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5032fdc-e850-49e4-b8c0-e47734257e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:11.719423 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5032fdc-e850-49e4-b8c0-e47734257e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:11.719715 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5032fdc-e850-49e4-b8c0-e47734257e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:11.722659 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5032fdc-e850-49e4-b8c0-e47734257e55 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:11.723595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5032fdc-e850-49e4-b8c0-e47734257e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:11.736913 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5032fdc-e850-49e4-b8c0-e47734257e55 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:11.811264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 760/1514] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:11 2022] POST /identity/v3/users => generated 290 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:11.814028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec1152-192b-44d1-8b9f-84ade14bde38 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:11.839157 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec1152-192b-44d1-8b9f-84ade14bde38 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:11.851476 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9db4a6-00ed-4eb4-9bff-bcbd46106674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:11.854629 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9db4a6-00ed-4eb4-9bff-bcbd46106674 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:11.856390 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9db4a6-00ed-4eb4-9bff-bcbd46106674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:11.857627 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9db4a6-00ed-4eb4-9bff-bcbd46106674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:11.858870 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9db4a6-00ed-4eb4-9bff-bcbd46106674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:11.868587 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9db4a6-00ed-4eb4-9bff-bcbd46106674 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:11.918819 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5032fdc-e850-49e4-b8c0-e47734257e55 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:11.921003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 755/1515] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:25:11.943351 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5032fdc-e850-49e4-b8c0-e47734257e55 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:11.962346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333dc02-2719-4701-a9b2-cf2429e6fe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:11.962607 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9db4a6-00ed-4eb4-9bff-bcbd46106674 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:11.962995 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333dc02-2719-4701-a9b2-cf2429e6fe08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:11.963284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333dc02-2719-4701-a9b2-cf2429e6fe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:11.964995 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3a9db4a6-00ed-4eb4-9bff-bcbd46106674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:11.966636 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333dc02-2719-4701-a9b2-cf2429e6fe08 admin admin] PATH_INFO: `/v3/projects/1ab9516aa6aa4d63b082d817f46ed257/users/330500a26bf64550b3e68fdd97061d89/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:12.000583 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9db4a6-00ed-4eb4-9bff-bcbd46106674 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:12.015258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165389f-f81f-4983-adca-58bd46deb178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:12.018194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165389f-f81f-4983-adca-58bd46deb178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:12.018787 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165389f-f81f-4983-adca-58bd46deb178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:12.019153 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165389f-f81f-4983-adca-58bd46deb178 admin admin] PATH_INFO: `/v3/projects/df86aa7ed4784dab80cc4283b8aea2c0` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:12.023330 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165389f-f81f-4983-adca-58bd46deb178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df86aa7ed4784dab80cc4283b8aea2c0)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:12.047863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165389f-f81f-4983-adca-58bd46deb178 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:12.057147 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333dc02-2719-4701-a9b2-cf2429e6fe08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab9516aa6aa4d63b082d817f46ed257, user_id=330500a26bf64550b3e68fdd97061d89, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:12.088912 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333dc02-2719-4701-a9b2-cf2429e6fe08 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:12.119222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 761/1516] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:11 2022] PUT /identity/v3/projects/1ab9516aa6aa4d63b082d817f46ed257/users/330500a26bf64550b3e68fdd97061d89/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:12.125237 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333dc02-2719-4701-a9b2-cf2429e6fe08 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:12.189152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2165389f-f81f-4983-adca-58bd46deb178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df86aa7ed4784dab80cc4283b8aea2c0', 'request_id': 'req-2165389f-f81f-4983-adca-58bd46deb178'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:12.200893 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2165389f-f81f-4983-adca-58bd46deb178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df86aa7ed4784dab80cc4283b8aea2c0', 'request_id': 'req-2165389f-f81f-4983-adca-58bd46deb178'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:12.216766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2165389f-f81f-4983-adca-58bd46deb178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df86aa7ed4784dab80cc4283b8aea2c0', 'request_id': 'req-2165389f-f81f-4983-adca-58bd46deb178'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:12.293374 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2165389f-f81f-4983-adca-58bd46deb178 admin admin] The token cache is being invalidate because project df86aa7ed4784dab80cc4283b8aea2c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:12.295529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2165389f-f81f-4983-adca-58bd46deb178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:12.299274 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2165389f-f81f-4983-adca-58bd46deb178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:12.304454 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 756/1517] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:11 2022] DELETE /identity/v3/projects/df86aa7ed4784dab80cc4283b8aea2c0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:12.320623 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f20d4-7bd0-4099-a6cd-27412888b754 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:12.326642 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f20d4-7bd0-4099-a6cd-27412888b754 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:12.327520 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f20d4-7bd0-4099-a6cd-27412888b754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:12.336773 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333dc02-2719-4701-a9b2-cf2429e6fe08 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:12.403252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-188f20d4-7bd0-4099-a6cd-27412888b754 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:12.406072 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-188f20d4-7bd0-4099-a6cd-27412888b754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:12.436664 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:12.504715 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d63f51-0f35-420a-bffe-662abe762d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:12.510325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d63f51-0f35-420a-bffe-662abe762d5d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:12.510662 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d63f51-0f35-420a-bffe-662abe762d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:12.510945 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d63f51-0f35-420a-bffe-662abe762d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:12.513311 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d63f51-0f35-420a-bffe-662abe762d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:12.518559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d63f51-0f35-420a-bffe-662abe762d5d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:12.541683 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 757/1518] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:12.543191 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d2c0e-f79b-4e30-96b9-5714e67092d0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:12.543480 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d2c0e-f79b-4e30-96b9-5714e67092d0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:12.543753 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d2c0e-f79b-4e30-96b9-5714e67092d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:12.553797 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 762/1519] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:12.554884 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d63f51-0f35-420a-bffe-662abe762d5d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:12.559229 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-42d63f51-0f35-420a-bffe-662abe762d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:12.587575 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9a8d2c0e-f79b-4e30-96b9-5714e67092d0 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:12.588877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9a8d2c0e-f79b-4e30-96b9-5714e67092d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:12.591625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d63f51-0f35-420a-bffe-662abe762d5d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:12.599480 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b040d3-a61a-40d9-b6f2-44cdb34c2317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:12.600144 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b040d3-a61a-40d9-b6f2-44cdb34c2317 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:12.600428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b040d3-a61a-40d9-b6f2-44cdb34c2317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:12.600707 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b040d3-a61a-40d9-b6f2-44cdb34c2317 admin admin] PATH_INFO: `/v3/projects/1ab9516aa6aa4d63b082d817f46ed257/users/330500a26bf64550b3e68fdd97061d89/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:12.604342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b040d3-a61a-40d9-b6f2-44cdb34c2317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab9516aa6aa4d63b082d817f46ed257, user_id=330500a26bf64550b3e68fdd97061d89, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:12.607024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b040d3-a61a-40d9-b6f2-44cdb34c2317 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:12.614235 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 758/1520] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:12.618739 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d2c0e-f79b-4e30-96b9-5714e67092d0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:12.638368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d2c0e-f79b-4e30-96b9-5714e67092d0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:12.653534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 763/1521] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:12 2022] PUT /identity/v3/projects/1ab9516aa6aa4d63b082d817f46ed257/users/330500a26bf64550b3e68fdd97061d89/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:12.653775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:12.658934 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42c405-78ba-4f7d-a158-5a6f10be1373 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:12.659276 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42c405-78ba-4f7d-a158-5a6f10be1373 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:12.659467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42c405-78ba-4f7d-a158-5a6f10be1373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:12.727412 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cc42c405-78ba-4f7d-a158-5a6f10be1373 None None] MFA Rules not processed for user `330500a26bf64550b3e68fdd97061d89`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:12.730969 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cc42c405-78ba-4f7d-a158-5a6f10be1373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:12.808858 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3cd05-4e54-4297-ade0-8fcfe3e1a40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:12.809554 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3cd05-4e54-4297-ade0-8fcfe3e1a40a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:12.809770 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3cd05-4e54-4297-ade0-8fcfe3e1a40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:12.810886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3cd05-4e54-4297-ade0-8fcfe3e1a40a admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:12.811559 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3cd05-4e54-4297-ade0-8fcfe3e1a40a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:12.811965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3cd05-4e54-4297-ade0-8fcfe3e1a40a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:12.813503 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3cd05-4e54-4297-ade0-8fcfe3e1a40a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:12.851236 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 759/1522] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:25:12.852381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3cd05-4e54-4297-ade0-8fcfe3e1a40a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:12.880125 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3cd05-4e54-4297-ade0-8fcfe3e1a40a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:12.890222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a6266-c2b3-4bba-9808-146525ebe762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:12.891295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a6266-c2b3-4bba-9808-146525ebe762 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:12.891870 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a6266-c2b3-4bba-9808-146525ebe762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:12.892266 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a6266-c2b3-4bba-9808-146525ebe762 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:12.893060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a6266-c2b3-4bba-9808-146525ebe762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:12.895173 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a6266-c2b3-4bba-9808-146525ebe762 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:12.947859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 764/1523] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:12.963681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42c405-78ba-4f7d-a158-5a6f10be1373 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:12.964182 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 760/1524] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:12 2022] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:12.968517 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cc42c405-78ba-4f7d-a158-5a6f10be1373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:12.968672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a6266-c2b3-4bba-9808-146525ebe762 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:13.116990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42c405-78ba-4f7d-a158-5a6f10be1373 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:13.158822 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a6266-c2b3-4bba-9808-146525ebe762 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:13.172596 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94be5e-8fcf-4921-a3e4-7d5d1c3bca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:13.173424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94be5e-8fcf-4921-a3e4-7d5d1c3bca44 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:13.173757 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94be5e-8fcf-4921-a3e4-7d5d1c3bca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:13.174034 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94be5e-8fcf-4921-a3e4-7d5d1c3bca44 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:13.175513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94be5e-8fcf-4921-a3e4-7d5d1c3bca44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:13.178143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94be5e-8fcf-4921-a3e4-7d5d1c3bca44 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:13.233152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 761/1525] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:12 2022] POST /identity/v3/users => generated 296 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:13.238252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94be5e-8fcf-4921-a3e4-7d5d1c3bca44 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:13.245056 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b35e78-a434-4d45-ad27-9fbe9dbff6b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:13.245998 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b35e78-a434-4d45-ad27-9fbe9dbff6b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:13.246410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b35e78-a434-4d45-ad27-9fbe9dbff6b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:13.246669 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b35e78-a434-4d45-ad27-9fbe9dbff6b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:13.283996 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94be5e-8fcf-4921-a3e4-7d5d1c3bca44 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:13.294086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:13.309318 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e45b3-3fa9-4d77-8dee-10df6d93583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:13.311900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e45b3-3fa9-4d77-8dee-10df6d93583c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:13.313026 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e45b3-3fa9-4d77-8dee-10df6d93583c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:13.314963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e45b3-3fa9-4d77-8dee-10df6d93583c admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:13.315799 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e45b3-3fa9-4d77-8dee-10df6d93583c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:13.319643 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e45b3-3fa9-4d77-8dee-10df6d93583c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:13.375598 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 762/1526] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:13.380221 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e45b3-3fa9-4d77-8dee-10df6d93583c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:13.414470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e45b3-3fa9-4d77-8dee-10df6d93583c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:13.433705 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d8e18-aae2-4771-ba80-2b8eecfd0651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:13.435186 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8e18-aae2-4771-ba80-2b8eecfd0651 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:13.435412 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8e18-aae2-4771-ba80-2b8eecfd0651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:13.435967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8e18-aae2-4771-ba80-2b8eecfd0651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:13.437548 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d8e18-aae2-4771-ba80-2b8eecfd0651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:13.442568 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d8e18-aae2-4771-ba80-2b8eecfd0651 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:13.482523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 763/1527] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:13.482719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b35e78-a434-4d45-ad27-9fbe9dbff6b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:13.482972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d8e18-aae2-4771-ba80-2b8eecfd0651 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:13.484798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b35e78-a434-4d45-ad27-9fbe9dbff6b7 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:13.509633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d8e18-aae2-4771-ba80-2b8eecfd0651 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:13.518399 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 765/1528] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:13.522130 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ffdd1-e785-4668-a125-814017760f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:13.522869 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ffdd1-e785-4668-a125-814017760f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:13.523079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ffdd1-e785-4668-a125-814017760f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:13.523359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ffdd1-e785-4668-a125-814017760f45 admin admin] PATH_INFO: `/v3/projects/a743e4094282432e82cc3992f3d34063/users/dfd0df87d7564b84820760bc04ed2bbb/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:13.548080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ffdd1-e785-4668-a125-814017760f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a743e4094282432e82cc3992f3d34063, user_id=dfd0df87d7564b84820760bc04ed2bbb, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:13.552959 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ffdd1-e785-4668-a125-814017760f45 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:13.598885 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 764/1529] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:13 2022] PUT /identity/v3/projects/a743e4094282432e82cc3992f3d34063/users/dfd0df87d7564b84820760bc04ed2bbb/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:13.610220 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60febc5b-f234-4a8a-9fd0-f53786f7c15f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:13.610624 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60febc5b-f234-4a8a-9fd0-f53786f7c15f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:13.611001 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60febc5b-f234-4a8a-9fd0-f53786f7c15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:13.627047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ffdd1-e785-4668-a125-814017760f45 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:13.630453 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ce9ffdd1-e785-4668-a125-814017760f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:13.683096 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:13.696727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-60febc5b-f234-4a8a-9fd0-f53786f7c15f None None] MFA Rules not processed for user `dfd0df87d7564b84820760bc04ed2bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:13.701162 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-60febc5b-f234-4a8a-9fd0-f53786f7c15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:13.775075 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ffdd1-e785-4668-a125-814017760f45 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:13.781679 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461596df-61d3-49e2-8115-7679600ef10b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:13.783495 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461596df-61d3-49e2-8115-7679600ef10b service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:13.783638 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461596df-61d3-49e2-8115-7679600ef10b service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:13.788419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461596df-61d3-49e2-8115-7679600ef10b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:13.792407 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-461596df-61d3-49e2-8115-7679600ef10b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:13.873681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 766/1530] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:13.878898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60febc5b-f234-4a8a-9fd0-f53786f7c15f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:13.933707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461596df-61d3-49e2-8115-7679600ef10b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:13.935301 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461596df-61d3-49e2-8115-7679600ef10b service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:13.959977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 765/1531] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:25:14.154059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60febc5b-f234-4a8a-9fd0-f53786f7c15f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:14.173749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acc5b9-4f94-48a5-b998-d692140fb845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:14.174365 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc5b9-4f94-48a5-b998-d692140fb845 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:14.174651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc5b9-4f94-48a5-b998-d692140fb845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:14.174928 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc5b9-4f94-48a5-b998-d692140fb845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:14.186072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acc5b9-4f94-48a5-b998-d692140fb845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:14.188439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acc5b9-4f94-48a5-b998-d692140fb845 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:14.248835 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461596df-61d3-49e2-8115-7679600ef10b service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:14.250398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-461596df-61d3-49e2-8115-7679600ef10b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:14.278761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461596df-61d3-49e2-8115-7679600ef10b service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:14.288753 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93853fa-275d-4281-9f11-c399f525a611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:14.291253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93853fa-275d-4281-9f11-c399f525a611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:14.291654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93853fa-275d-4281-9f11-c399f525a611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:14.292619 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93853fa-275d-4281-9f11-c399f525a611 admin admin] PATH_INFO: `/v3/projects/62b224f9763443aa972687a461ecdc02` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:14.295076 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93853fa-275d-4281-9f11-c399f525a611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b224f9763443aa972687a461ecdc02)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:14.302201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93853fa-275d-4281-9f11-c399f525a611 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:14.307112 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 767/1532] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:13 2022] POST /identity/v3/projects => generated 393 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:14.310498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acc5b9-4f94-48a5-b998-d692140fb845 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:14.459606 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:14.505682 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b93853fa-275d-4281-9f11-c399f525a611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b224f9763443aa972687a461ecdc02', 'request_id': 'req-b93853fa-275d-4281-9f11-c399f525a611'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:14.540971 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b93853fa-275d-4281-9f11-c399f525a611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b224f9763443aa972687a461ecdc02', 'request_id': 'req-b93853fa-275d-4281-9f11-c399f525a611'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:14.569188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b93853fa-275d-4281-9f11-c399f525a611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b224f9763443aa972687a461ecdc02', 'request_id': 'req-b93853fa-275d-4281-9f11-c399f525a611'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:14.600235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acc5b9-4f94-48a5-b998-d692140fb845 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:14.609024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b93853fa-275d-4281-9f11-c399f525a611 admin admin] The token cache is being invalidate because project 62b224f9763443aa972687a461ecdc02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:14.609316 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b93853fa-275d-4281-9f11-c399f525a611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:14.614078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b93853fa-275d-4281-9f11-c399f525a611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:14.621798 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 766/1533] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:14 2022] DELETE /identity/v3/projects/62b224f9763443aa972687a461ecdc02 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:14.626375 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e941b-d094-4042-999b-88222a54dd29 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:14.626651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e941b-d094-4042-999b-88222a54dd29 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:14.626930 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e941b-d094-4042-999b-88222a54dd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:14.708506 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-740e941b-d094-4042-999b-88222a54dd29 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:14.721897 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-740e941b-d094-4042-999b-88222a54dd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:14.816450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42a008-9058-42ad-93b2-e0c3196a8472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:14.818141 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42a008-9058-42ad-93b2-e0c3196a8472 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:14.818442 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42a008-9058-42ad-93b2-e0c3196a8472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:14.818866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42a008-9058-42ad-93b2-e0c3196a8472 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:14.819547 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42a008-9058-42ad-93b2-e0c3196a8472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:14.821802 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42a008-9058-42ad-93b2-e0c3196a8472 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:14.919336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:14.935113 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 767/1534] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:14.936294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e941b-d094-4042-999b-88222a54dd29 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:14.937928 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-740e941b-d094-4042-999b-88222a54dd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:14.940223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 768/1535] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:14 2022] POST /identity/v3/users => generated 303 bytes in 633 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:14.947971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053af927-679c-43df-ab8e-3945eff23538 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:14.953275 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053af927-679c-43df-ab8e-3945eff23538 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:14.956978 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053af927-679c-43df-ab8e-3945eff23538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:14.978496 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e941b-d094-4042-999b-88222a54dd29 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:14.984449 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71de4e7-f1fb-40a5-ad35-5e1c18b4a0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:14.985183 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de4e7-f1fb-40a5-ad35-5e1c18b4a0ec admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:14.985595 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de4e7-f1fb-40a5-ad35-5e1c18b4a0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:14.986019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de4e7-f1fb-40a5-ad35-5e1c18b4a0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:14.986942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71de4e7-f1fb-40a5-ad35-5e1c18b4a0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:14.989037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71de4e7-f1fb-40a5-ad35-5e1c18b4a0ec admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:15.015365 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-053af927-679c-43df-ab8e-3945eff23538 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:15.020383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 768/1536] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:15.025358 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-053af927-679c-43df-ab8e-3945eff23538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:15.025673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71de4e7-f1fb-40a5-ad35-5e1c18b4a0ec admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:15.047402 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 769/1537] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:15.051676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053af927-679c-43df-ab8e-3945eff23538 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:15.056100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71de4e7-f1fb-40a5-ad35-5e1c18b4a0ec admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:15.072735 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053af927-679c-43df-ab8e-3945eff23538 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:15.085263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fc775-e97b-4424-baa6-e472add07c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:15.086050 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fc775-e97b-4424-baa6-e472add07c57 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:15.086388 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fc775-e97b-4424-baa6-e472add07c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:15.086668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fc775-e97b-4424-baa6-e472add07c57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:15.087489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fc775-e97b-4424-baa6-e472add07c57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:15.088101 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fc775-e97b-4424-baa6-e472add07c57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:15.089724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fc775-e97b-4424-baa6-e472add07c57 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:15.093918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ba45b-deb9-4bef-b9f6-f18e6fe5691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:15.095138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ba45b-deb9-4bef-b9f6-f18e6fe5691f admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:15.095138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ba45b-deb9-4bef-b9f6-f18e6fe5691f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:15.095138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ba45b-deb9-4bef-b9f6-f18e6fe5691f admin admin] PATH_INFO: `/v3/projects/aa2da5ebae274daaa384bf0a74f388f7/users/8e96f30a19ee410089ab101f8ec6f700/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:15.114422 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 770/1538] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:25:15.118842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fc775-e97b-4424-baa6-e472add07c57 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:15.136360 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ba45b-deb9-4bef-b9f6-f18e6fe5691f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2da5ebae274daaa384bf0a74f388f7, user_id=8e96f30a19ee410089ab101f8ec6f700, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:15.140345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fc775-e97b-4424-baa6-e472add07c57 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:15.144735 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ba45b-deb9-4bef-b9f6-f18e6fe5691f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:15.154004 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a093bb-9e9a-4605-9271-0cb4ae2f313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:15.155494 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a093bb-9e9a-4605-9271-0cb4ae2f313e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:15.155916 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a093bb-9e9a-4605-9271-0cb4ae2f313e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:15.156353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a093bb-9e9a-4605-9271-0cb4ae2f313e admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:15.157475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a093bb-9e9a-4605-9271-0cb4ae2f313e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:15.170205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a093bb-9e9a-4605-9271-0cb4ae2f313e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:15.180477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 769/1539] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:15 2022] PUT /identity/v3/projects/aa2da5ebae274daaa384bf0a74f388f7/users/8e96f30a19ee410089ab101f8ec6f700/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:15.182390 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ba45b-deb9-4bef-b9f6-f18e6fe5691f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:15.255539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 771/1540] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:15 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:15.261114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a093bb-9e9a-4605-9271-0cb4ae2f313e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:15.304277 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ba45b-deb9-4bef-b9f6-f18e6fe5691f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:15.429005 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a093bb-9e9a-4605-9271-0cb4ae2f313e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:15.451282 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9abee-90fa-4573-83a5-414303c350de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:15.454390 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9abee-90fa-4573-83a5-414303c350de admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:15.455473 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9abee-90fa-4573-83a5-414303c350de admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:15.455859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9abee-90fa-4573-83a5-414303c350de admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:15.456778 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9abee-90fa-4573-83a5-414303c350de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:15.459503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9abee-90fa-4573-83a5-414303c350de admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:15.492655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01719db5-0c39-4c27-a17b-e0dba006f874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:15.493863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01719db5-0c39-4c27-a17b-e0dba006f874 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:15.494316 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01719db5-0c39-4c27-a17b-e0dba006f874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:15.494884 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01719db5-0c39-4c27-a17b-e0dba006f874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:15.496962 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01719db5-0c39-4c27-a17b-e0dba006f874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:15.500441 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01719db5-0c39-4c27-a17b-e0dba006f874 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:15.526704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 772/1541] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:15 2022] POST /identity/v3/users => generated 288 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:15.529049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9abee-90fa-4573-83a5-414303c350de admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:15.562709 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9abee-90fa-4573-83a5-414303c350de admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:15.562949 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 770/1542] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:15.564108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01719db5-0c39-4c27-a17b-e0dba006f874 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:15.570506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f957479-e491-42f4-ae78-8169972fb17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:15.572567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f957479-e491-42f4-ae78-8169972fb17e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:15.573143 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f957479-e491-42f4-ae78-8169972fb17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:15.573877 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f957479-e491-42f4-ae78-8169972fb17e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:15.574235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f957479-e491-42f4-ae78-8169972fb17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:15.577373 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f957479-e491-42f4-ae78-8169972fb17e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:15.580012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01719db5-0c39-4c27-a17b-e0dba006f874 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:15.589039 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2338aef-7f3c-47a7-ad90-87d72b9c55a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:15.590219 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2338aef-7f3c-47a7-ad90-87d72b9c55a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:15.590697 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2338aef-7f3c-47a7-ad90-87d72b9c55a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:15.591628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:15.591840 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2338aef-7f3c-47a7-ad90-87d72b9c55a1 admin admin] PATH_INFO: `/v3/projects/aa2da5ebae274daaa384bf0a74f388f7/users/8e96f30a19ee410089ab101f8ec6f700/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:15.595253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2338aef-7f3c-47a7-ad90-87d72b9c55a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2da5ebae274daaa384bf0a74f388f7, user_id=8e96f30a19ee410089ab101f8ec6f700, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:15.598826 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 773/1543] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:15.599071 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2338aef-7f3c-47a7-ad90-87d72b9c55a1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:15.609512 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f957479-e491-42f4-ae78-8169972fb17e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:15.627994 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 771/1544] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:15 2022] PUT /identity/v3/projects/aa2da5ebae274daaa384bf0a74f388f7/users/8e96f30a19ee410089ab101f8ec6f700/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:15.628933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51754-1c2f-4b1a-aa27-5533cca3ef10 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:15.629328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51754-1c2f-4b1a-aa27-5533cca3ef10 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:15.629688 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51754-1c2f-4b1a-aa27-5533cca3ef10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:15.635627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f957479-e491-42f4-ae78-8169972fb17e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:15.725794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-29f51754-1c2f-4b1a-aa27-5533cca3ef10 None None] MFA Rules not processed for user `8e96f30a19ee410089ab101f8ec6f700`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:15.727878 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-29f51754-1c2f-4b1a-aa27-5533cca3ef10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:15.868578 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3320ee-b250-4a01-b873-d4c241aaf28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:15.869715 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3320ee-b250-4a01-b873-d4c241aaf28f admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:15.870140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3320ee-b250-4a01-b873-d4c241aaf28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:15.870635 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3320ee-b250-4a01-b873-d4c241aaf28f admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:15.871685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3320ee-b250-4a01-b873-d4c241aaf28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:15.874750 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3320ee-b250-4a01-b873-d4c241aaf28f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:15.931500 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 774/1545] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:15.932692 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:15.933810 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3320ee-b250-4a01-b873-d4c241aaf28f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:15.939542 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bb3320ee-b250-4a01-b873-d4c241aaf28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:15.999631 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3320ee-b250-4a01-b873-d4c241aaf28f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:16.030263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b39e55-ec76-4ebd-bb82-dc138cae3cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:16.030980 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b39e55-ec76-4ebd-bb82-dc138cae3cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:16.031198 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b39e55-ec76-4ebd-bb82-dc138cae3cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:16.031474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b39e55-ec76-4ebd-bb82-dc138cae3cc1 admin admin] PATH_INFO: `/v3/users/825f4860cc7e4ea0b49f2fd6831ea22f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:16.033759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b39e55-ec76-4ebd-bb82-dc138cae3cc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=825f4860cc7e4ea0b49f2fd6831ea22f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:16.036646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b39e55-ec76-4ebd-bb82-dc138cae3cc1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:16.039241 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 772/1546] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:15 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:16.040669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95735ad7-b147-4b45-9806-4ce6427c4474 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:16.040940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95735ad7-b147-4b45-9806-4ce6427c4474 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:16.041241 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95735ad7-b147-4b45-9806-4ce6427c4474 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:16.045118 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 773/1547] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 17 10:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:25:16.045867 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95735ad7-b147-4b45-9806-4ce6427c4474 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:16.076099 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95735ad7-b147-4b45-9806-4ce6427c4474 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:16.089766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e4e97-1cbf-4856-893d-4578d09fcf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:16.090676 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e4e97-1cbf-4856-893d-4578d09fcf64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:16.090676 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e4e97-1cbf-4856-893d-4578d09fcf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:16.091098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e4e97-1cbf-4856-893d-4578d09fcf64 admin admin] PATH_INFO: `/v3/projects/d6bdb02ff0604646a4e18f2029e518b1/users/0912b1b271284a56a0701564de47d2f3/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:16.151235 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e4e97-1cbf-4856-893d-4578d09fcf64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6bdb02ff0604646a4e18f2029e518b1, user_id=0912b1b271284a56a0701564de47d2f3, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:16.171326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-13b39e55-ec76-4ebd-bb82-dc138cae3cc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825f4860cc7e4ea0b49f2fd6831ea22f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:16.171513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e4e97-1cbf-4856-893d-4578d09fcf64 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:16.172175 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-13b39e55-ec76-4ebd-bb82-dc138cae3cc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825f4860cc7e4ea0b49f2fd6831ea22f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:16.183623 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-13b39e55-ec76-4ebd-bb82-dc138cae3cc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825f4860cc7e4ea0b49f2fd6831ea22f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:16.184673 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-13b39e55-ec76-4ebd-bb82-dc138cae3cc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825f4860cc7e4ea0b49f2fd6831ea22f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:16.198423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 774/1548] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:16 2022] PUT /identity/v3/projects/d6bdb02ff0604646a4e18f2029e518b1/users/0912b1b271284a56a0701564de47d2f3/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:16.199072 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e4e97-1cbf-4856-893d-4578d09fcf64 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:16.218796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-794e4e97-1cbf-4856-893d-4578d09fcf64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:16.220266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-13b39e55-ec76-4ebd-bb82-dc138cae3cc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825f4860cc7e4ea0b49f2fd6831ea22f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:16.250262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 775/1549] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:15 2022] DELETE /identity/v3/users/825f4860cc7e4ea0b49f2fd6831ea22f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:16.251769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68649fe5-6177-4c6b-963e-40c50a636cfe None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:16.252090 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68649fe5-6177-4c6b-963e-40c50a636cfe None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:16.252366 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68649fe5-6177-4c6b-963e-40c50a636cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:16.304778 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-68649fe5-6177-4c6b-963e-40c50a636cfe None None] MFA Rules not processed for user `0912b1b271284a56a0701564de47d2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:16.306703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-68649fe5-6177-4c6b-963e-40c50a636cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:16.350641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e4e97-1cbf-4856-893d-4578d09fcf64 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:16.462412 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:16.486493 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a270921-dce7-46f4-ac26-f960e9312824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:16.486735 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 776/1550] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:16.487256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a270921-dce7-46f4-ac26-f960e9312824 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:16.487557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a270921-dce7-46f4-ac26-f960e9312824 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:16.487948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a270921-dce7-46f4-ac26-f960e9312824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:16.491244 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3a270921-dce7-46f4-ac26-f960e9312824 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:16.493176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4b861-9857-4f95-8691-1ee698336608 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:16.494587 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4b861-9857-4f95-8691-1ee698336608 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:16.495621 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4b861-9857-4f95-8691-1ee698336608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:16.646824 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-eaf4b861-9857-4f95-8691-1ee698336608 None None] MFA Rules not processed for user `a80cc7ec3d2d49f88c81403f918a6900`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:16.648325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-eaf4b861-9857-4f95-8691-1ee698336608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:16.813112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a270921-dce7-46f4-ac26-f960e9312824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:16.815494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a270921-dce7-46f4-ac26-f960e9312824 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:16.817536 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 777/1551] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 17 10:25:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:16.819016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07601ec9-5618-4e5e-87d6-643e41d353fa None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:16.819401 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07601ec9-5618-4e5e-87d6-643e41d353fa None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:16.819632 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07601ec9-5618-4e5e-87d6-643e41d353fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:16.855970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 775/1552] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:16 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:16.862419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-07601ec9-5618-4e5e-87d6-643e41d353fa None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:16.864028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a270921-dce7-46f4-ac26-f960e9312824 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:16.864864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-07601ec9-5618-4e5e-87d6-643e41d353fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:16.866853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3a270921-dce7-46f4-ac26-f960e9312824 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:16.884861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a270921-dce7-46f4-ac26-f960e9312824 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:16.902734 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c71be0-fbe5-4355-befa-9626be8f8816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:16.903308 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c71be0-fbe5-4355-befa-9626be8f8816 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:16.903589 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c71be0-fbe5-4355-befa-9626be8f8816 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:16.908604 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c71be0-fbe5-4355-befa-9626be8f8816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:16.947216 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c71be0-fbe5-4355-befa-9626be8f8816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:16.959058 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c71be0-fbe5-4355-befa-9626be8f8816 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:17.036538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 776/1553] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:17.075867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 778/1554] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:17.142684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c71be0-fbe5-4355-befa-9626be8f8816 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:17.151042 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c1c71be0-fbe5-4355-befa-9626be8f8816 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:17.211253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:17.219041 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07601ec9-5618-4e5e-87d6-643e41d353fa None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:17.234609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07601ec9-5618-4e5e-87d6-643e41d353fa None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:17.257145 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f3dbc-b25c-4d6d-9c0b-d63e40b18dc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:17.257926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f3dbc-b25c-4d6d-9c0b-d63e40b18dc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:17.258211 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f3dbc-b25c-4d6d-9c0b-d63e40b18dc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:17.258481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f3dbc-b25c-4d6d-9c0b-d63e40b18dc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:17.266309 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7e0f3dbc-b25c-4d6d-9c0b-d63e40b18dc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:17.341507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c71be0-fbe5-4355-befa-9626be8f8816 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:17.352591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be4ac8-f61b-48eb-8eaf-4837ac1485f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:17.353227 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be4ac8-f61b-48eb-8eaf-4837ac1485f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:17.353510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be4ac8-f61b-48eb-8eaf-4837ac1485f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:17.353787 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be4ac8-f61b-48eb-8eaf-4837ac1485f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:17.377488 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be4ac8-f61b-48eb-8eaf-4837ac1485f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:17.381658 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be4ac8-f61b-48eb-8eaf-4837ac1485f1 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:17.381835 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f3dbc-b25c-4d6d-9c0b-d63e40b18dc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:17.383310 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f3dbc-b25c-4d6d-9c0b-d63e40b18dc8 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:17.395808 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 779/1555] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:25:17.402634 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 777/1556] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:17.466390 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f3dbc-b25c-4d6d-9c0b-d63e40b18dc8 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:17.467860 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7e0f3dbc-b25c-4d6d-9c0b-d63e40b18dc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:17.486706 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f3dbc-b25c-4d6d-9c0b-d63e40b18dc8 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:17.496906 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f9eab-85c5-437c-8031-f7ebf11ef230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:17.497785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f9eab-85c5-437c-8031-f7ebf11ef230 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:17.498215 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f9eab-85c5-437c-8031-f7ebf11ef230 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:17.498633 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f9eab-85c5-437c-8031-f7ebf11ef230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:17.508324 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f9eab-85c5-437c-8031-f7ebf11ef230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:17.510145 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f9eab-85c5-437c-8031-f7ebf11ef230 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:17.523469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 780/1557] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:18.270766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be4ac8-f61b-48eb-8eaf-4837ac1485f1 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:18.272687 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d3be4ac8-f61b-48eb-8eaf-4837ac1485f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:18.313065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be4ac8-f61b-48eb-8eaf-4837ac1485f1 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:18.328102 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b73215-2c35-4ade-8f48-1029ac5ef234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:18.328730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b73215-2c35-4ade-8f48-1029ac5ef234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:18.329185 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b73215-2c35-4ade-8f48-1029ac5ef234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:18.329518 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b73215-2c35-4ade-8f48-1029ac5ef234 admin admin] PATH_INFO: `/v3/projects/801dbc831e3449198ffca18debc76a79` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:18.331686 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b73215-2c35-4ade-8f48-1029ac5ef234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=801dbc831e3449198ffca18debc76a79)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:18.333979 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b73215-2c35-4ade-8f48-1029ac5ef234 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:18.433139 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-23b73215-2c35-4ade-8f48-1029ac5ef234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801dbc831e3449198ffca18debc76a79', 'request_id': 'req-23b73215-2c35-4ade-8f48-1029ac5ef234'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:18.446341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-23b73215-2c35-4ade-8f48-1029ac5ef234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801dbc831e3449198ffca18debc76a79', 'request_id': 'req-23b73215-2c35-4ade-8f48-1029ac5ef234'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:18.458537 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-23b73215-2c35-4ade-8f48-1029ac5ef234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801dbc831e3449198ffca18debc76a79', 'request_id': 'req-23b73215-2c35-4ade-8f48-1029ac5ef234'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:18.477875 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-23b73215-2c35-4ade-8f48-1029ac5ef234 admin admin] The token cache is being invalidate because project 801dbc831e3449198ffca18debc76a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:18.478188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-23b73215-2c35-4ade-8f48-1029ac5ef234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:18.479469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-23b73215-2c35-4ade-8f48-1029ac5ef234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:18.485657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 778/1558] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:18 2022] DELETE /identity/v3/projects/801dbc831e3449198ffca18debc76a79 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:18.486189 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f9eab-85c5-437c-8031-f7ebf11ef230 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:18.506517 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f9eab-85c5-437c-8031-f7ebf11ef230 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:18.526867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:18.614089 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd730c-d547-4d0c-9a24-2ea839fb30a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:18.615097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd730c-d547-4d0c-9a24-2ea839fb30a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:18.615613 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd730c-d547-4d0c-9a24-2ea839fb30a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:18.615823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd730c-d547-4d0c-9a24-2ea839fb30a3 admin admin] PATH_INFO: `/v3/users/0cae65997d954f50b775fb4aafbe9d60` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:18.618085 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd730c-d547-4d0c-9a24-2ea839fb30a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cae65997d954f50b775fb4aafbe9d60)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:18.620725 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd730c-d547-4d0c-9a24-2ea839fb30a3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:18.695797 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4ddd730c-d547-4d0c-9a24-2ea839fb30a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cae65997d954f50b775fb4aafbe9d60'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:18.697815 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4ddd730c-d547-4d0c-9a24-2ea839fb30a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cae65997d954f50b775fb4aafbe9d60'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:18.716659 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4ddd730c-d547-4d0c-9a24-2ea839fb30a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cae65997d954f50b775fb4aafbe9d60'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:18.717447 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4ddd730c-d547-4d0c-9a24-2ea839fb30a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cae65997d954f50b775fb4aafbe9d60'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:18.731216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4ddd730c-d547-4d0c-9a24-2ea839fb30a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cae65997d954f50b775fb4aafbe9d60'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:18.778876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 781/1559] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:18 2022] DELETE /identity/v3/users/0cae65997d954f50b775fb4aafbe9d60 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:19.114244 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b73215-2c35-4ade-8f48-1029ac5ef234 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:19.116922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-23b73215-2c35-4ade-8f48-1029ac5ef234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:19.160807 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b73215-2c35-4ade-8f48-1029ac5ef234 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:19.299599 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc124fe6-aa86-4824-af28-acc4097e2a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:19.300225 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc124fe6-aa86-4824-af28-acc4097e2a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:19.300602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc124fe6-aa86-4824-af28-acc4097e2a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:19.302827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc124fe6-aa86-4824-af28-acc4097e2a6f admin admin] PATH_INFO: `/v3/users/dcf38039e797455090b88cda5827bc8d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:19.304603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc124fe6-aa86-4824-af28-acc4097e2a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcf38039e797455090b88cda5827bc8d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:19.309041 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc124fe6-aa86-4824-af28-acc4097e2a6f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:19.389799 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:19.415104 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cc124fe6-aa86-4824-af28-acc4097e2a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcf38039e797455090b88cda5827bc8d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:19.416388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cc124fe6-aa86-4824-af28-acc4097e2a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcf38039e797455090b88cda5827bc8d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:19.429898 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cc124fe6-aa86-4824-af28-acc4097e2a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcf38039e797455090b88cda5827bc8d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:19.430738 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cc124fe6-aa86-4824-af28-acc4097e2a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcf38039e797455090b88cda5827bc8d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:19.454481 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cc124fe6-aa86-4824-af28-acc4097e2a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcf38039e797455090b88cda5827bc8d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:19.488066 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd730c-d547-4d0c-9a24-2ea839fb30a3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:19.489929 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4ddd730c-d547-4d0c-9a24-2ea839fb30a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:19.495820 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 779/1560] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:19 2022] DELETE /identity/v3/users/dcf38039e797455090b88cda5827bc8d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:19.499877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a7ebf-52dc-4996-aa00-75e082bc9727 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:19.500283 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a7ebf-52dc-4996-aa00-75e082bc9727 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:19.500452 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a7ebf-52dc-4996-aa00-75e082bc9727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:19.513195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd730c-d547-4d0c-9a24-2ea839fb30a3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:19.544648 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-550a7ebf-52dc-4996-aa00-75e082bc9727 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:19.545988 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-550a7ebf-52dc-4996-aa00-75e082bc9727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:19.644216 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 780/1561] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:25:19.657730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a7ebf-52dc-4996-aa00-75e082bc9727 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:19.661063 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-550a7ebf-52dc-4996-aa00-75e082bc9727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:19.717969 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b0ffa-3169-4b1b-908b-52d0c20fb398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:19.719588 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b0ffa-3169-4b1b-908b-52d0c20fb398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:19.719874 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b0ffa-3169-4b1b-908b-52d0c20fb398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:19.720174 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b0ffa-3169-4b1b-908b-52d0c20fb398 admin admin] PATH_INFO: `/v3/projects/a7c91bf74dee4bbc96422ace75376fb9` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:19.724865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b0ffa-3169-4b1b-908b-52d0c20fb398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c91bf74dee4bbc96422ace75376fb9)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:19.735629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b0ffa-3169-4b1b-908b-52d0c20fb398 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:19.800214 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a7ebf-52dc-4996-aa00-75e082bc9727 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:19.800519 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:19.816424 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e20b0ffa-3169-4b1b-908b-52d0c20fb398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c91bf74dee4bbc96422ace75376fb9', 'request_id': 'req-e20b0ffa-3169-4b1b-908b-52d0c20fb398'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:19.833727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e20b0ffa-3169-4b1b-908b-52d0c20fb398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c91bf74dee4bbc96422ace75376fb9', 'request_id': 'req-e20b0ffa-3169-4b1b-908b-52d0c20fb398'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:19.843405 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e20b0ffa-3169-4b1b-908b-52d0c20fb398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c91bf74dee4bbc96422ace75376fb9', 'request_id': 'req-e20b0ffa-3169-4b1b-908b-52d0c20fb398'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:19.860308 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e20b0ffa-3169-4b1b-908b-52d0c20fb398 admin admin] The token cache is being invalidate because project a7c91bf74dee4bbc96422ace75376fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:19.860879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e20b0ffa-3169-4b1b-908b-52d0c20fb398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:19.861744 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e20b0ffa-3169-4b1b-908b-52d0c20fb398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:19.864450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 782/1562] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:19 2022] DELETE /identity/v3/projects/a7c91bf74dee4bbc96422ace75376fb9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:19.870484 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82f4d7-5b48-4c35-9888-62484dd3e492 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:19.872267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82f4d7-5b48-4c35-9888-62484dd3e492 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:19.873749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82f4d7-5b48-4c35-9888-62484dd3e492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:19.886137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b511c7-aaec-46aa-91c3-34c9112d53ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:19.889109 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b511c7-aaec-46aa-91c3-34c9112d53ca service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:19.889318 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b511c7-aaec-46aa-91c3-34c9112d53ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:19.889551 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b511c7-aaec-46aa-91c3-34c9112d53ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:19.896317 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-41b511c7-aaec-46aa-91c3-34c9112d53ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:19.913502 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ab82f4d7-5b48-4c35-9888-62484dd3e492 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:19.914903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ab82f4d7-5b48-4c35-9888-62484dd3e492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:19.935964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:20.014176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 783/1563] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:25:20.028926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c1dab-1026-4c50-b56a-4f363ade628b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:20.029585 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c1dab-1026-4c50-b56a-4f363ade628b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:20.030021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c1dab-1026-4c50-b56a-4f363ade628b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:20.030776 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b511c7-aaec-46aa-91c3-34c9112d53ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:20.032550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b511c7-aaec-46aa-91c3-34c9112d53ca service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:20.062530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-279c1dab-1026-4c50-b56a-4f363ade628b None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:20.064204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-279c1dab-1026-4c50-b56a-4f363ade628b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:20.065055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 781/1564] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:20.090852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 784/1565] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:25:20.092627 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b511c7-aaec-46aa-91c3-34c9112d53ca service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:20.107000 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b511c7-aaec-46aa-91c3-34c9112d53ca service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:20.122621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f316258-723f-4666-9581-7312c6536af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:20.123256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f316258-723f-4666-9581-7312c6536af3 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:20.123646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f316258-723f-4666-9581-7312c6536af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:20.123955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f316258-723f-4666-9581-7312c6536af3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:20.124924 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f316258-723f-4666-9581-7312c6536af3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:20.125201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f316258-723f-4666-9581-7312c6536af3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:20.127313 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f316258-723f-4666-9581-7312c6536af3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:20.146134 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 782/1566] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:25:20.151642 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c1dab-1026-4c50-b56a-4f363ade628b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:20.165978 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c1dab-1026-4c50-b56a-4f363ade628b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:20.172861 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d70d77-29e2-49c5-ae53-1e744be9361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:20.174036 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d70d77-29e2-49c5-ae53-1e744be9361f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:20.174680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d70d77-29e2-49c5-ae53-1e744be9361f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:20.175355 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d70d77-29e2-49c5-ae53-1e744be9361f admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:20.176054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d70d77-29e2-49c5-ae53-1e744be9361f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:20.178777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d70d77-29e2-49c5-ae53-1e744be9361f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:20.246141 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 785/1567] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:20 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:20.248982 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f316258-723f-4666-9581-7312c6536af3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:20.262317 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f316258-723f-4666-9581-7312c6536af3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:20.349159 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234b696-2d67-4c21-9c45-9c4ec008cb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:20.350462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234b696-2d67-4c21-9c45-9c4ec008cb4d admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:20.350903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234b696-2d67-4c21-9c45-9c4ec008cb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:20.351318 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234b696-2d67-4c21-9c45-9c4ec008cb4d admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:20.352256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234b696-2d67-4c21-9c45-9c4ec008cb4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:20.354592 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234b696-2d67-4c21-9c45-9c4ec008cb4d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:20.382876 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 783/1568] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:20 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:20.387221 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d70d77-29e2-49c5-ae53-1e744be9361f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:20.399579 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d70d77-29e2-49c5-ae53-1e744be9361f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:20.405376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f3d58-a50d-4dba-bca0-bc0339f0cc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:20.406299 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f3d58-a50d-4dba-bca0-bc0339f0cc01 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:20.406923 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f3d58-a50d-4dba-bca0-bc0339f0cc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:20.407343 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f3d58-a50d-4dba-bca0-bc0339f0cc01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:20.408645 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f3d58-a50d-4dba-bca0-bc0339f0cc01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:20.410870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f3d58-a50d-4dba-bca0-bc0339f0cc01 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:20.428039 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 786/1569] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:20.429355 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234b696-2d67-4c21-9c45-9c4ec008cb4d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:20.444169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234b696-2d67-4c21-9c45-9c4ec008cb4d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:20.450464 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1404c8f-beb6-4c31-aaae-2a5bc27254d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:20.451082 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1404c8f-beb6-4c31-aaae-2a5bc27254d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:20.451361 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1404c8f-beb6-4c31-aaae-2a5bc27254d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:20.451632 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1404c8f-beb6-4c31-aaae-2a5bc27254d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:20.452608 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1404c8f-beb6-4c31-aaae-2a5bc27254d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:20.454235 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1404c8f-beb6-4c31-aaae-2a5bc27254d5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:20.469366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 784/1570] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:20.470535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f3d58-a50d-4dba-bca0-bc0339f0cc01 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:20.472350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-744f3d58-a50d-4dba-bca0-bc0339f0cc01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:20.474157 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1404c8f-beb6-4c31-aaae-2a5bc27254d5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:20.489924 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f3d58-a50d-4dba-bca0-bc0339f0cc01 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:20.498709 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03712bec-912d-46c8-b5ba-c0e8491dddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:20.499480 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03712bec-912d-46c8-b5ba-c0e8491dddee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:20.499738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03712bec-912d-46c8-b5ba-c0e8491dddee admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:20.500054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03712bec-912d-46c8-b5ba-c0e8491dddee admin admin] PATH_INFO: `/v3/projects/f9a49d84ae9e4ad8bd5c9f3076f6cdc0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:20.501295 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03712bec-912d-46c8-b5ba-c0e8491dddee admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a49d84ae9e4ad8bd5c9f3076f6cdc0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:20.501760 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1404c8f-beb6-4c31-aaae-2a5bc27254d5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:20.503195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03712bec-912d-46c8-b5ba-c0e8491dddee admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:20.506820 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04c60f-d109-4212-89a7-48749051607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:20.507571 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04c60f-d109-4212-89a7-48749051607f admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:20.507849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04c60f-d109-4212-89a7-48749051607f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:20.508175 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04c60f-d109-4212-89a7-48749051607f admin admin] PATH_INFO: `/v3/projects/7aafd5477c314214b63cc7544f443c9f/users/73ecf66d4aad4cc2be423c204d888e9d/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:20.524329 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04c60f-d109-4212-89a7-48749051607f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aafd5477c314214b63cc7544f443c9f, user_id=73ecf66d4aad4cc2be423c204d888e9d, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:20.527180 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04c60f-d109-4212-89a7-48749051607f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:20.541392 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 785/1571] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:20 2022] PUT /identity/v3/projects/7aafd5477c314214b63cc7544f443c9f/users/73ecf66d4aad4cc2be423c204d888e9d/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:20.555174 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0ec0d-77db-4d28-a832-4d537f0676b8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:20.555393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0ec0d-77db-4d28-a832-4d537f0676b8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:20.556011 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0ec0d-77db-4d28-a832-4d537f0676b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:20.558242 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-03712bec-912d-46c8-b5ba-c0e8491dddee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a49d84ae9e4ad8bd5c9f3076f6cdc0', 'request_id': 'req-03712bec-912d-46c8-b5ba-c0e8491dddee'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:20.565994 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-03712bec-912d-46c8-b5ba-c0e8491dddee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a49d84ae9e4ad8bd5c9f3076f6cdc0', 'request_id': 'req-03712bec-912d-46c8-b5ba-c0e8491dddee'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:20.574526 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-03712bec-912d-46c8-b5ba-c0e8491dddee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a49d84ae9e4ad8bd5c9f3076f6cdc0', 'request_id': 'req-03712bec-912d-46c8-b5ba-c0e8491dddee'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:20.586541 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-03712bec-912d-46c8-b5ba-c0e8491dddee admin admin] The token cache is being invalidate because project f9a49d84ae9e4ad8bd5c9f3076f6cdc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:20.586847 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-03712bec-912d-46c8-b5ba-c0e8491dddee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:20.587556 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-03712bec-912d-46c8-b5ba-c0e8491dddee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:20.587672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-45a0ec0d-77db-4d28-a832-4d537f0676b8 None None] MFA Rules not processed for user `73ecf66d4aad4cc2be423c204d888e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:20.588894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-45a0ec0d-77db-4d28-a832-4d537f0676b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:20.589164 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 787/1572] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:20 2022] DELETE /identity/v3/projects/f9a49d84ae9e4ad8bd5c9f3076f6cdc0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:20.592963 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03712bec-912d-46c8-b5ba-c0e8491dddee admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:20.594341 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-03712bec-912d-46c8-b5ba-c0e8491dddee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:20.606275 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:20.645957 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:20.672749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03712bec-912d-46c8-b5ba-c0e8491dddee admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:20.672918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 786/1573] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:25:20.674261 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18eb19-e34c-4386-9a49-4ef0226e8c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:20.674806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18eb19-e34c-4386-9a49-4ef0226e8c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:20.675125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18eb19-e34c-4386-9a49-4ef0226e8c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:20.676318 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18eb19-e34c-4386-9a49-4ef0226e8c74 admin admin] PATH_INFO: `/v3/users/330500a26bf64550b3e68fdd97061d89` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:20.677427 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18eb19-e34c-4386-9a49-4ef0226e8c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=330500a26bf64550b3e68fdd97061d89)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:20.679502 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18eb19-e34c-4386-9a49-4ef0226e8c74 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:20.682441 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0ec0d-77db-4d28-a832-4d537f0676b8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:20.685492 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-45a0ec0d-77db-4d28-a832-4d537f0676b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:20.748086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4f18eb19-e34c-4386-9a49-4ef0226e8c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '330500a26bf64550b3e68fdd97061d89'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:20.748818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4f18eb19-e34c-4386-9a49-4ef0226e8c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '330500a26bf64550b3e68fdd97061d89'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:20.754407 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0ec0d-77db-4d28-a832-4d537f0676b8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:20.758168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4f18eb19-e34c-4386-9a49-4ef0226e8c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '330500a26bf64550b3e68fdd97061d89'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:20.758344 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dfa5e-b515-4973-b9db-09f34dfc728e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:20.758958 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dfa5e-b515-4973-b9db-09f34dfc728e service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:20.759131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4f18eb19-e34c-4386-9a49-4ef0226e8c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '330500a26bf64550b3e68fdd97061d89'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:20.759239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dfa5e-b515-4973-b9db-09f34dfc728e service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:20.759487 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dfa5e-b515-4973-b9db-09f34dfc728e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:20.761322 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-632dfa5e-b515-4973-b9db-09f34dfc728e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:20.770951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4f18eb19-e34c-4386-9a49-4ef0226e8c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '330500a26bf64550b3e68fdd97061d89'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:20.776472 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dfa5e-b515-4973-b9db-09f34dfc728e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:20.777969 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dfa5e-b515-4973-b9db-09f34dfc728e service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:20.788711 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 787/1574] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:25:20.791690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 788/1575] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:20 2022] DELETE /identity/v3/users/330500a26bf64550b3e68fdd97061d89 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:20.810466 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dfa5e-b515-4973-b9db-09f34dfc728e service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:20.811914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-632dfa5e-b515-4973-b9db-09f34dfc728e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:20.827462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dfa5e-b515-4973-b9db-09f34dfc728e service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:20.904032 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bce08e-f88e-4c17-85cd-ebd415aea4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:20.904674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bce08e-f88e-4c17-85cd-ebd415aea4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:20.904952 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bce08e-f88e-4c17-85cd-ebd415aea4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:20.905224 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bce08e-f88e-4c17-85cd-ebd415aea4a5 admin admin] PATH_INFO: `/v3/users/73ecf66d4aad4cc2be423c204d888e9d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:20.906400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bce08e-f88e-4c17-85cd-ebd415aea4a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ecf66d4aad4cc2be423c204d888e9d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:20.908433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bce08e-f88e-4c17-85cd-ebd415aea4a5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:20.959370 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-40bce08e-f88e-4c17-85cd-ebd415aea4a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ecf66d4aad4cc2be423c204d888e9d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:20.960167 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-40bce08e-f88e-4c17-85cd-ebd415aea4a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ecf66d4aad4cc2be423c204d888e9d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:20.967546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-40bce08e-f88e-4c17-85cd-ebd415aea4a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ecf66d4aad4cc2be423c204d888e9d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:20.968677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-40bce08e-f88e-4c17-85cd-ebd415aea4a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ecf66d4aad4cc2be423c204d888e9d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:20.976909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-40bce08e-f88e-4c17-85cd-ebd415aea4a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ecf66d4aad4cc2be423c204d888e9d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:20.998828 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 788/1576] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:20 2022] DELETE /identity/v3/users/73ecf66d4aad4cc2be423c204d888e9d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:21.003332 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84e5cc-ae3b-495c-a31b-9c606b4adeb7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:21.003622 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84e5cc-ae3b-495c-a31b-9c606b4adeb7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:21.004450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84e5cc-ae3b-495c-a31b-9c606b4adeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:21.023493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-bf84e5cc-ae3b-495c-a31b-9c606b4adeb7 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:21.024733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bf84e5cc-ae3b-495c-a31b-9c606b4adeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:21.100241 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bce08e-f88e-4c17-85cd-ebd415aea4a5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:21.101983 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-40bce08e-f88e-4c17-85cd-ebd415aea4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:21.106841 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 789/1577] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:25:21.125549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bce08e-f88e-4c17-85cd-ebd415aea4a5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:21.130460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84e5cc-ae3b-495c-a31b-9c606b4adeb7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:21.131708 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:21.132399 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:21.132681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:21.132936 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bf84e5cc-ae3b-495c-a31b-9c606b4adeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:21.133043 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684 admin admin] PATH_INFO: `/v3/projects/1ab9516aa6aa4d63b082d817f46ed257` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:21.135179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab9516aa6aa4d63b082d817f46ed257)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:21.137259 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:21.148370 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:21.182685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:21.199028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab9516aa6aa4d63b082d817f46ed257', 'request_id': 'req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:21.208563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab9516aa6aa4d63b082d817f46ed257', 'request_id': 'req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:21.211488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84e5cc-ae3b-495c-a31b-9c606b4adeb7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:21.216398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab9516aa6aa4d63b082d817f46ed257', 'request_id': 'req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:21.229989 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684 admin admin] The token cache is being invalidate because project 1ab9516aa6aa4d63b082d817f46ed257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:21.230494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:21.231176 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:21.232943 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 789/1578] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:21 2022] DELETE /identity/v3/projects/1ab9516aa6aa4d63b082d817f46ed257 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:21.237115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:21.238561 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:21.264763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ff773-b12c-4c62-bb87-c0575e9ca9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:21.265379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ff773-b12c-4c62-bb87-c0575e9ca9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:21.265657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ff773-b12c-4c62-bb87-c0575e9ca9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:21.265926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ff773-b12c-4c62-bb87-c0575e9ca9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:21.267687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-152ff773-b12c-4c62-bb87-c0575e9ca9a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:21.314635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a6b70-0c58-4f2e-8612-88c6dd5c6684 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:21.319564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8512d68-717e-4d56-9ea2-94b0124b342b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:21.320429 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8512d68-717e-4d56-9ea2-94b0124b342b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:21.320537 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8512d68-717e-4d56-9ea2-94b0124b342b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:21.320788 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8512d68-717e-4d56-9ea2-94b0124b342b admin admin] PATH_INFO: `/v3/users/0912b1b271284a56a0701564de47d2f3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:21.322598 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8512d68-717e-4d56-9ea2-94b0124b342b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0912b1b271284a56a0701564de47d2f3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:21.324804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8512d68-717e-4d56-9ea2-94b0124b342b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:21.336663 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ff773-b12c-4c62-bb87-c0575e9ca9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:21.338114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ff773-b12c-4c62-bb87-c0575e9ca9a0 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:21.348137 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 790/1579] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:21.349603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03078ede-8c0e-48d6-82c1-2cb2a21e56b8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:21.350113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03078ede-8c0e-48d6-82c1-2cb2a21e56b8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:21.350398 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03078ede-8c0e-48d6-82c1-2cb2a21e56b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:21.373314 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-03078ede-8c0e-48d6-82c1-2cb2a21e56b8 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:21.374402 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-03078ede-8c0e-48d6-82c1-2cb2a21e56b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:21.382492 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 791/1580] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:21.382934 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c8512d68-717e-4d56-9ea2-94b0124b342b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0912b1b271284a56a0701564de47d2f3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:21.383601 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c8512d68-717e-4d56-9ea2-94b0124b342b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0912b1b271284a56a0701564de47d2f3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:21.392642 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb562c-4602-475a-85d0-d085bf04cdb7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:21.392952 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb562c-4602-475a-85d0-d085bf04cdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:21.393055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c8512d68-717e-4d56-9ea2-94b0124b342b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0912b1b271284a56a0701564de47d2f3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:21.393228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb562c-4602-475a-85d0-d085bf04cdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:21.393673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c8512d68-717e-4d56-9ea2-94b0124b342b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0912b1b271284a56a0701564de47d2f3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:21.404588 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c8512d68-717e-4d56-9ea2-94b0124b342b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0912b1b271284a56a0701564de47d2f3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:21.420130 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-82bb562c-4602-475a-85d0-d085bf04cdb7 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:21.421639 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-82bb562c-4602-475a-85d0-d085bf04cdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:21.431595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 792/1581] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:25:21.435565 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb562c-4602-475a-85d0-d085bf04cdb7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:21.439990 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 790/1582] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:21 2022] DELETE /identity/v3/users/0912b1b271284a56a0701564de47d2f3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:21.443962 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e840c3-4beb-474a-8483-81509d8c1483 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:21.444576 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e840c3-4beb-474a-8483-81509d8c1483 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:21.445085 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e840c3-4beb-474a-8483-81509d8c1483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:21.448965 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb562c-4602-475a-85d0-d085bf04cdb7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:21.469768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-23e840c3-4beb-474a-8483-81509d8c1483 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:21.471147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-23e840c3-4beb-474a-8483-81509d8c1483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:21.483551 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:21.545888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb853f-172d-4306-a61d-795318b8fbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:21.546530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb853f-172d-4306-a61d-795318b8fbca admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:21.546786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb853f-172d-4306-a61d-795318b8fbca admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:21.547064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb853f-172d-4306-a61d-795318b8fbca admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:21.547725 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb853f-172d-4306-a61d-795318b8fbca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:21.548070 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb853f-172d-4306-a61d-795318b8fbca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:21.556331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb853f-172d-4306-a61d-795318b8fbca admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:21.579425 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 791/1583] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:21.588343 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 793/1584] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:25:21.589726 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e840c3-4beb-474a-8483-81509d8c1483 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:21.597729 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb853f-172d-4306-a61d-795318b8fbca admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:21.600548 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3acb853f-172d-4306-a61d-795318b8fbca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:21.609144 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e840c3-4beb-474a-8483-81509d8c1483 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:21.618331 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabeabd-4e28-4f72-bd54-046f374021f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:21.618983 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabeabd-4e28-4f72-bd54-046f374021f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:21.619257 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabeabd-4e28-4f72-bd54-046f374021f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:21.619526 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabeabd-4e28-4f72-bd54-046f374021f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:21.620584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabeabd-4e28-4f72-bd54-046f374021f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:21.621429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:21.623970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabeabd-4e28-4f72-bd54-046f374021f2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:21.675569 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb853f-172d-4306-a61d-795318b8fbca admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:21.682730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 792/1585] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:21 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:21.684870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce634af-7fdf-4c10-a9a7-3e00a8fdbd96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:21.684870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce634af-7fdf-4c10-a9a7-3e00a8fdbd96 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:21.684870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce634af-7fdf-4c10-a9a7-3e00a8fdbd96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:21.684870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce634af-7fdf-4c10-a9a7-3e00a8fdbd96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:21.688466 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabeabd-4e28-4f72-bd54-046f374021f2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:21.701250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce634af-7fdf-4c10-a9a7-3e00a8fdbd96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:21.703009 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce634af-7fdf-4c10-a9a7-3e00a8fdbd96 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:21.717532 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 794/1586] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:25:21.772517 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce634af-7fdf-4c10-a9a7-3e00a8fdbd96 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:21.775020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4ce634af-7fdf-4c10-a9a7-3e00a8fdbd96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:21.791859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabeabd-4e28-4f72-bd54-046f374021f2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:21.793319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce634af-7fdf-4c10-a9a7-3e00a8fdbd96 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:21.797108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f59130-722c-4006-9ff0-fe404ce3828d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:21.797794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f59130-722c-4006-9ff0-fe404ce3828d admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:21.798170 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f59130-722c-4006-9ff0-fe404ce3828d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:21.798277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:21.798590 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f59130-722c-4006-9ff0-fe404ce3828d admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:21.798887 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:21.799169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:21.799443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9 admin admin] PATH_INFO: `/v3/projects/7aafd5477c314214b63cc7544f443c9f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:21.799548 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f59130-722c-4006-9ff0-fe404ce3828d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:21.800581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aafd5477c314214b63cc7544f443c9f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:21.801694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f59130-722c-4006-9ff0-fe404ce3828d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:21.802582 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:21.829997 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 793/1587] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:21 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:25:21.830942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f59130-722c-4006-9ff0-fe404ce3828d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:21.833627 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-95f59130-722c-4006-9ff0-fe404ce3828d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:21.847038 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f59130-722c-4006-9ff0-fe404ce3828d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:21.860854 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aafd5477c314214b63cc7544f443c9f', 'request_id': 'req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:21.870478 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aafd5477c314214b63cc7544f443c9f', 'request_id': 'req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:21.877834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aafd5477c314214b63cc7544f443c9f', 'request_id': 'req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:21.890876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9 admin admin] The token cache is being invalidate because project 7aafd5477c314214b63cc7544f443c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:21.891386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:21.892293 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:21.898127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 795/1588] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:21 2022] DELETE /identity/v3/projects/7aafd5477c314214b63cc7544f443c9f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:21.899342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:21.901212 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:21.928674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7cf1c-10a4-4061-af42-766ab81a7841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:21.931255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7cf1c-10a4-4061-af42-766ab81a7841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:21.932254 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7cf1c-10a4-4061-af42-766ab81a7841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:21.932714 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7cf1c-10a4-4061-af42-766ab81a7841 admin admin] PATH_INFO: `/v3/users/dfd0df87d7564b84820760bc04ed2bbb` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:21.934161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7cf1c-10a4-4061-af42-766ab81a7841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfd0df87d7564b84820760bc04ed2bbb)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:21.936160 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7cf1c-10a4-4061-af42-766ab81a7841 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:21.976812 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:22.010598 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf3cb0-7f88-472f-ae53-fda59dcfe6f9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:22.016521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391bb30-e9f1-420f-8f99-464c61f92dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:22.017256 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391bb30-e9f1-420f-8f99-464c61f92dfe admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.017604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391bb30-e9f1-420f-8f99-464c61f92dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.018589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391bb30-e9f1-420f-8f99-464c61f92dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.019312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391bb30-e9f1-420f-8f99-464c61f92dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:22.021082 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391bb30-e9f1-420f-8f99-464c61f92dfe admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:22.037320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 796/1589] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:22.038036 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-44f7cf1c-10a4-4061-af42-766ab81a7841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfd0df87d7564b84820760bc04ed2bbb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:22.038824 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-44f7cf1c-10a4-4061-af42-766ab81a7841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfd0df87d7564b84820760bc04ed2bbb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:22.038979 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430384af-eae5-4861-8f24-005338ac7c5b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.039263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430384af-eae5-4861-8f24-005338ac7c5b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.039531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430384af-eae5-4861-8f24-005338ac7c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.053662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-44f7cf1c-10a4-4061-af42-766ab81a7841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfd0df87d7564b84820760bc04ed2bbb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:22.054415 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-44f7cf1c-10a4-4061-af42-766ab81a7841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfd0df87d7564b84820760bc04ed2bbb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:22.065219 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-430384af-eae5-4861-8f24-005338ac7c5b None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:22.066700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-430384af-eae5-4861-8f24-005338ac7c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:22.076757 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-44f7cf1c-10a4-4061-af42-766ab81a7841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfd0df87d7564b84820760bc04ed2bbb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:22.077189 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 797/1590] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:22.078382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430384af-eae5-4861-8f24-005338ac7c5b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:22.080245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-430384af-eae5-4861-8f24-005338ac7c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:22.096148 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430384af-eae5-4861-8f24-005338ac7c5b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:22.102257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eae8d5-dcde-4d43-b336-899f0fd5bfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:22.103107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eae8d5-dcde-4d43-b336-899f0fd5bfe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.103524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eae8d5-dcde-4d43-b336-899f0fd5bfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.104017 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eae8d5-dcde-4d43-b336-899f0fd5bfe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.104824 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eae8d5-dcde-4d43-b336-899f0fd5bfe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:22.108363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 794/1591] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:21 2022] DELETE /identity/v3/users/dfd0df87d7564b84820760bc04ed2bbb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:22.108363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef79c9-5020-4861-8eb0-e5c879e65bd9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.108363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef79c9-5020-4861-8eb0-e5c879e65bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.108363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef79c9-5020-4861-8eb0-e5c879e65bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.111796 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eae8d5-dcde-4d43-b336-899f0fd5bfe6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:22.127632 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 798/1592] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:22.129175 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712dbc-710d-450d-9381-73c33f778aa6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.129880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712dbc-710d-450d-9381-73c33f778aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.129880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712dbc-710d-450d-9381-73c33f778aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.136015 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-17ef79c9-5020-4861-8eb0-e5c879e65bd9 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:22.137370 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-17ef79c9-5020-4861-8eb0-e5c879e65bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:22.152222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ee712dbc-710d-450d-9381-73c33f778aa6 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:22.153963 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ee712dbc-710d-450d-9381-73c33f778aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:22.172305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:22.231847 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 795/1593] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:22.232842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef79c9-5020-4861-8eb0-e5c879e65bd9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:22.255162 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef79c9-5020-4861-8eb0-e5c879e65bd9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:22.267085 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb86178-b818-4cb2-b690-0b9e006d4c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:22.268236 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb86178-b818-4cb2-b690-0b9e006d4c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.268570 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb86178-b818-4cb2-b690-0b9e006d4c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.269842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb86178-b818-4cb2-b690-0b9e006d4c19 admin admin] PATH_INFO: `/v3/projects/d3f3b9950eed403298c91594ce4dc32f/users/e2594c9f017441489ccf40bbac1160ae/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.282869 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 799/1594] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:22.283960 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee712dbc-710d-450d-9381-73c33f778aa6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:22.294236 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee712dbc-710d-450d-9381-73c33f778aa6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:22.298719 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb86178-b818-4cb2-b690-0b9e006d4c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f3b9950eed403298c91594ce4dc32f, user_id=e2594c9f017441489ccf40bbac1160ae, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:22.299856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56cca1-2f22-4102-9cd8-3aeefb2e2ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:22.300570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56cca1-2f22-4102-9cd8-3aeefb2e2ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.301453 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56cca1-2f22-4102-9cd8-3aeefb2e2ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.301729 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56cca1-2f22-4102-9cd8-3aeefb2e2ef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.302484 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56cca1-2f22-4102-9cd8-3aeefb2e2ef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:22.302850 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56cca1-2f22-4102-9cd8-3aeefb2e2ef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:22.303504 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb86178-b818-4cb2-b690-0b9e006d4c19 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:22.304600 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56cca1-2f22-4102-9cd8-3aeefb2e2ef7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:22.322843 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 800/1595] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:25:22.322843 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56cca1-2f22-4102-9cd8-3aeefb2e2ef7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:22.324949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6f56cca1-2f22-4102-9cd8-3aeefb2e2ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:22.325331 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 796/1596] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:22 2022] PUT /identity/v3/projects/d3f3b9950eed403298c91594ce4dc32f/users/e2594c9f017441489ccf40bbac1160ae/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:22.326486 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb86178-b818-4cb2-b690-0b9e006d4c19 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:22.391833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56cca1-2f22-4102-9cd8-3aeefb2e2ef7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:22.414355 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb86178-b818-4cb2-b690-0b9e006d4c19 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:22.427393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1621bc5-111b-40cb-8578-261ef7bb9c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:22.428037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621bc5-111b-40cb-8578-261ef7bb9c5c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.428313 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621bc5-111b-40cb-8578-261ef7bb9c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.428582 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621bc5-111b-40cb-8578-261ef7bb9c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.429222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1621bc5-111b-40cb-8578-261ef7bb9c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:22.431135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1621bc5-111b-40cb-8578-261ef7bb9c5c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:22.466381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20aeb-d94f-4f47-81dc-4dbc1db84241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:22.468016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20aeb-d94f-4f47-81dc-4dbc1db84241 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.468016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20aeb-d94f-4f47-81dc-4dbc1db84241 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.468016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20aeb-d94f-4f47-81dc-4dbc1db84241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.470942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 797/1597] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:22 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:22.474660 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d80b6c-ed4a-4c4b-b551-8841148263fb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.474951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d80b6c-ed4a-4c4b-b551-8841148263fb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.475469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d80b6c-ed4a-4c4b-b551-8841148263fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.489128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b20aeb-d94f-4f47-81dc-4dbc1db84241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:22.490851 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b20aeb-d94f-4f47-81dc-4dbc1db84241 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:22.500674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:22.507916 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 801/1598] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:22.508267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20aeb-d94f-4f47-81dc-4dbc1db84241 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:22.521823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20aeb-d94f-4f47-81dc-4dbc1db84241 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:22.528198 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-34d80b6c-ed4a-4c4b-b551-8841148263fb None None] MFA Rules not processed for user `e2594c9f017441489ccf40bbac1160ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:22.529536 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-34d80b6c-ed4a-4c4b-b551-8841148263fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:22.624064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182165b0-933b-45fc-8a0d-d3f5e974a90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:22.624806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182165b0-933b-45fc-8a0d-d3f5e974a90f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.625178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182165b0-933b-45fc-8a0d-d3f5e974a90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.625381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182165b0-933b-45fc-8a0d-d3f5e974a90f admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.626434 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182165b0-933b-45fc-8a0d-d3f5e974a90f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:22.630290 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182165b0-933b-45fc-8a0d-d3f5e974a90f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:22.640395 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 798/1599] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:22.640855 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d80b6c-ed4a-4c4b-b551-8841148263fb None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:22.642246 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-34d80b6c-ed4a-4c4b-b551-8841148263fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:22.642863 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:22.656607 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d80b6c-ed4a-4c4b-b551-8841148263fb None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:22.662887 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473369b0-50fa-4951-a2f6-183e223f8f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:22.663526 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473369b0-50fa-4951-a2f6-183e223f8f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.663809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473369b0-50fa-4951-a2f6-183e223f8f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.664148 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473369b0-50fa-4951-a2f6-183e223f8f89 admin admin] PATH_INFO: `/v3/projects/d6bdb02ff0604646a4e18f2029e518b1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.664955 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 802/1600] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:22 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:22.666164 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182165b0-933b-45fc-8a0d-d3f5e974a90f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:22.668577 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473369b0-50fa-4951-a2f6-183e223f8f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6bdb02ff0604646a4e18f2029e518b1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:22.670555 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473369b0-50fa-4951-a2f6-183e223f8f89 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:22.685764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182165b0-933b-45fc-8a0d-d3f5e974a90f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:22.691323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226257d-a4c6-48ea-969c-b9aa33295d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:22.692065 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226257d-a4c6-48ea-969c-b9aa33295d79 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.692350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226257d-a4c6-48ea-969c-b9aa33295d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.692696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226257d-a4c6-48ea-969c-b9aa33295d79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.693474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226257d-a4c6-48ea-969c-b9aa33295d79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:22.704242 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226257d-a4c6-48ea-969c-b9aa33295d79 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:22.755185 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-473369b0-50fa-4951-a2f6-183e223f8f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6bdb02ff0604646a4e18f2029e518b1', 'request_id': 'req-473369b0-50fa-4951-a2f6-183e223f8f89'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:22.764869 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-473369b0-50fa-4951-a2f6-183e223f8f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6bdb02ff0604646a4e18f2029e518b1', 'request_id': 'req-473369b0-50fa-4951-a2f6-183e223f8f89'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:22.765099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 803/1601] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:22 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:22.766499 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226257d-a4c6-48ea-969c-b9aa33295d79 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:22.776676 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-473369b0-50fa-4951-a2f6-183e223f8f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6bdb02ff0604646a4e18f2029e518b1', 'request_id': 'req-473369b0-50fa-4951-a2f6-183e223f8f89'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:22.793281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-473369b0-50fa-4951-a2f6-183e223f8f89 admin admin] The token cache is being invalidate because project d6bdb02ff0604646a4e18f2029e518b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:22.793605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-473369b0-50fa-4951-a2f6-183e223f8f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:22.794258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-473369b0-50fa-4951-a2f6-183e223f8f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:22.800264 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 799/1602] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:22 2022] DELETE /identity/v3/projects/d6bdb02ff0604646a4e18f2029e518b1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:22.800264 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473369b0-50fa-4951-a2f6-183e223f8f89 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:22.805212 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-473369b0-50fa-4951-a2f6-183e223f8f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:22.859572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226257d-a4c6-48ea-969c-b9aa33295d79 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:22.867021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fd3a9-3bd8-4a2d-86d6-a2be1b2e7145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:22.867845 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fd3a9-3bd8-4a2d-86d6-a2be1b2e7145 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.868165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fd3a9-3bd8-4a2d-86d6-a2be1b2e7145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.868548 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fd3a9-3bd8-4a2d-86d6-a2be1b2e7145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.869787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6fd3a9-3bd8-4a2d-86d6-a2be1b2e7145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:22.871700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6fd3a9-3bd8-4a2d-86d6-a2be1b2e7145 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:22.883359 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 804/1603] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:22.884723 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798e046-99e6-4ada-a0ef-21c781322322 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.885019 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798e046-99e6-4ada-a0ef-21c781322322 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.885295 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798e046-99e6-4ada-a0ef-21c781322322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.908309 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f798e046-99e6-4ada-a0ef-21c781322322 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:22.909672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f798e046-99e6-4ada-a0ef-21c781322322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:22.918143 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 805/1604] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:22.918143 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798e046-99e6-4ada-a0ef-21c781322322 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:22.918143 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f798e046-99e6-4ada-a0ef-21c781322322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:22.929437 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473369b0-50fa-4951-a2f6-183e223f8f89 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:22.934090 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798e046-99e6-4ada-a0ef-21c781322322 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:22.934246 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baea0aa-12ec-4a12-bcf6-24bdc23b18a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:22.934887 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baea0aa-12ec-4a12-bcf6-24bdc23b18a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.935167 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baea0aa-12ec-4a12-bcf6-24bdc23b18a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.935504 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baea0aa-12ec-4a12-bcf6-24bdc23b18a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.936141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baea0aa-12ec-4a12-bcf6-24bdc23b18a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:22.938114 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baea0aa-12ec-4a12-bcf6-24bdc23b18a7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:22.939244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad0c3b-e6f3-420a-956f-a29c87b139aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:22.939847 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad0c3b-e6f3-420a-956f-a29c87b139aa admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.940172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad0c3b-e6f3-420a-956f-a29c87b139aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.940513 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad0c3b-e6f3-420a-956f-a29c87b139aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.941098 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad0c3b-e6f3-420a-956f-a29c87b139aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:22.943325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad0c3b-e6f3-420a-956f-a29c87b139aa admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:22.955089 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 806/1605] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:22.956279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac3e89-c082-4363-a2aa-d6647b945be4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.956567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac3e89-c082-4363-a2aa-d6647b945be4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.956833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac3e89-c082-4363-a2aa-d6647b945be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.962882 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 800/1606] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:22 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:22.963982 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baea0aa-12ec-4a12-bcf6-24bdc23b18a7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:22.975306 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baea0aa-12ec-4a12-bcf6-24bdc23b18a7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:22.979135 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-27ac3e89-c082-4363-a2aa-d6647b945be4 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:22.980518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-27ac3e89-c082-4363-a2aa-d6647b945be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:22.980627 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e976919-72b2-425c-9143-1bfa139b626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:22.981256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e976919-72b2-425c-9143-1bfa139b626c admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:22.981539 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e976919-72b2-425c-9143-1bfa139b626c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:22.981813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e976919-72b2-425c-9143-1bfa139b626c admin admin] PATH_INFO: `/v3/projects/c660dc049c654952bb35d516a9fb4d33/users/1dc69d811ab04281a9ad783fa87c5270/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:22.984361 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:22.992450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 807/1607] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:22.993568 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac3e89-c082-4363-a2aa-d6647b945be4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:23.003837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac3e89-c082-4363-a2aa-d6647b945be4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:23.007327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e976919-72b2-425c-9143-1bfa139b626c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c660dc049c654952bb35d516a9fb4d33, user_id=1dc69d811ab04281a9ad783fa87c5270, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:23.009530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9068b-0b7a-4964-8803-42c2be038610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:23.010158 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9068b-0b7a-4964-8803-42c2be038610 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:23.010460 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e976919-72b2-425c-9143-1bfa139b626c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:23.010746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9068b-0b7a-4964-8803-42c2be038610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:23.011029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9068b-0b7a-4964-8803-42c2be038610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:23.011715 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9068b-0b7a-4964-8803-42c2be038610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:23.013466 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9068b-0b7a-4964-8803-42c2be038610 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:23.028788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 808/1608] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:23.028788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9068b-0b7a-4964-8803-42c2be038610 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:23.029033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 801/1609] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:22 2022] PUT /identity/v3/projects/c660dc049c654952bb35d516a9fb4d33/users/1dc69d811ab04281a9ad783fa87c5270/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:23.029033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e976919-72b2-425c-9143-1bfa139b626c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:23.030420 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8cd9068b-0b7a-4964-8803-42c2be038610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:23.043527 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9068b-0b7a-4964-8803-42c2be038610 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:23.104053 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e976919-72b2-425c-9143-1bfa139b626c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:23.108528 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068dbd6-f993-4e2f-9df4-b179df49548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:23.108800 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a936f31-fa24-435f-aad3-b974846bcfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:23.109178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068dbd6-f993-4e2f-9df4-b179df49548b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:23.109392 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a936f31-fa24-435f-aad3-b974846bcfbd admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:23.109566 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068dbd6-f993-4e2f-9df4-b179df49548b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:23.109650 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a936f31-fa24-435f-aad3-b974846bcfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:23.109834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068dbd6-f993-4e2f-9df4-b179df49548b admin admin] PATH_INFO: `/v3/projects/a743e4094282432e82cc3992f3d34063` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:23.109921 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a936f31-fa24-435f-aad3-b974846bcfbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:23.110550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a936f31-fa24-435f-aad3-b974846bcfbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:23.110853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a936f31-fa24-435f-aad3-b974846bcfbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:23.110993 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068dbd6-f993-4e2f-9df4-b179df49548b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a743e4094282432e82cc3992f3d34063)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:23.112471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a936f31-fa24-435f-aad3-b974846bcfbd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:23.112973 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068dbd6-f993-4e2f-9df4-b179df49548b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:23.128026 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 802/1610] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:25:23.128026 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a936f31-fa24-435f-aad3-b974846bcfbd admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:23.138814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a936f31-fa24-435f-aad3-b974846bcfbd admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:23.144447 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84082d0d-cba8-4c33-a6d1-82ec16e4e8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:23.145602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84082d0d-cba8-4c33-a6d1-82ec16e4e8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:23.145864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84082d0d-cba8-4c33-a6d1-82ec16e4e8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:23.146133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84082d0d-cba8-4c33-a6d1-82ec16e4e8a3 admin admin] PATH_INFO: `/v3/projects/59be0959380e4b929dae2a6b01ced2d9/users/7314d102b7cb458c9cc7540e744241a1/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:23.154991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:23.162084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84082d0d-cba8-4c33-a6d1-82ec16e4e8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59be0959380e4b929dae2a6b01ced2d9, user_id=7314d102b7cb458c9cc7540e744241a1, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:23.164852 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84082d0d-cba8-4c33-a6d1-82ec16e4e8a3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:23.167105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6068dbd6-f993-4e2f-9df4-b179df49548b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a743e4094282432e82cc3992f3d34063', 'request_id': 'req-6068dbd6-f993-4e2f-9df4-b179df49548b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:23.175908 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6068dbd6-f993-4e2f-9df4-b179df49548b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a743e4094282432e82cc3992f3d34063', 'request_id': 'req-6068dbd6-f993-4e2f-9df4-b179df49548b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:23.178582 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 803/1611] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:23 2022] PUT /identity/v3/projects/59be0959380e4b929dae2a6b01ced2d9/users/7314d102b7cb458c9cc7540e744241a1/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:23.179953 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc1472-9fce-46e3-8ffc-1d00e481f9bd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:23.180250 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc1472-9fce-46e3-8ffc-1d00e481f9bd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:23.180518 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc1472-9fce-46e3-8ffc-1d00e481f9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:23.182782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6068dbd6-f993-4e2f-9df4-b179df49548b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a743e4094282432e82cc3992f3d34063', 'request_id': 'req-6068dbd6-f993-4e2f-9df4-b179df49548b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:23.195308 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6068dbd6-f993-4e2f-9df4-b179df49548b admin admin] The token cache is being invalidate because project a743e4094282432e82cc3992f3d34063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:23.195813 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6068dbd6-f993-4e2f-9df4-b179df49548b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:23.196574 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6068dbd6-f993-4e2f-9df4-b179df49548b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:23.198120 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 809/1612] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:23 2022] DELETE /identity/v3/projects/a743e4094282432e82cc3992f3d34063 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:23.198935 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068dbd6-f993-4e2f-9df4-b179df49548b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:23.200530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6068dbd6-f993-4e2f-9df4-b179df49548b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:23.209440 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c6dc1472-9fce-46e3-8ffc-1d00e481f9bd None None] MFA Rules not processed for user `1dc69d811ab04281a9ad783fa87c5270`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:23.210659 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c6dc1472-9fce-46e3-8ffc-1d00e481f9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:23.271329 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068dbd6-f993-4e2f-9df4-b179df49548b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:23.288114 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 804/1613] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:23.289417 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc1472-9fce-46e3-8ffc-1d00e481f9bd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:23.290773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c6dc1472-9fce-46e3-8ffc-1d00e481f9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:23.342059 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:23.353745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5605a-b704-40cd-be0f-ab4de543e940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:23.354367 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5605a-b704-40cd-be0f-ab4de543e940 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:23.354645 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5605a-b704-40cd-be0f-ab4de543e940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:23.354917 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5605a-b704-40cd-be0f-ab4de543e940 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:23.355548 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5605a-b704-40cd-be0f-ab4de543e940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:23.357667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5605a-b704-40cd-be0f-ab4de543e940 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:23.367965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc1472-9fce-46e3-8ffc-1d00e481f9bd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:23.373474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d70394-47fe-4586-b2d3-4177c70527ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:23.374775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d70394-47fe-4586-b2d3-4177c70527ce admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:23.375499 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d70394-47fe-4586-b2d3-4177c70527ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:23.375784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d70394-47fe-4586-b2d3-4177c70527ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:23.376497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d70394-47fe-4586-b2d3-4177c70527ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:23.378387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d70394-47fe-4586-b2d3-4177c70527ce admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:23.389253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 805/1614] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:23.390201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d70394-47fe-4586-b2d3-4177c70527ce admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:23.390562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 810/1615] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:23 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:23.391663 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5605a-b704-40cd-be0f-ab4de543e940 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:23.394241 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cca5605a-b704-40cd-be0f-ab4de543e940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:23.395024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-87d70394-47fe-4586-b2d3-4177c70527ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:23.409213 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d70394-47fe-4586-b2d3-4177c70527ce admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:23.462054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5605a-b704-40cd-be0f-ab4de543e940 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:23.465681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8117d-e95b-450a-aa75-0f13cd295c04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:23.466285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8117d-e95b-450a-aa75-0f13cd295c04 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:23.466559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8117d-e95b-450a-aa75-0f13cd295c04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:23.466709 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6211e62-ce74-4b41-a06d-2339f27a47a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:23.467198 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8117d-e95b-450a-aa75-0f13cd295c04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:23.467385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6211e62-ce74-4b41-a06d-2339f27a47a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:23.467681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6211e62-ce74-4b41-a06d-2339f27a47a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:23.467978 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6211e62-ce74-4b41-a06d-2339f27a47a1 admin admin] PATH_INFO: `/v3/users/8e96f30a19ee410089ab101f8ec6f700` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:23.469106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6211e62-ce74-4b41-a06d-2339f27a47a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e96f30a19ee410089ab101f8ec6f700)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:23.471188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6211e62-ce74-4b41-a06d-2339f27a47a1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:23.476816 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:23.520356 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f6211e62-ce74-4b41-a06d-2339f27a47a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e96f30a19ee410089ab101f8ec6f700'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:23.521028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f6211e62-ce74-4b41-a06d-2339f27a47a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e96f30a19ee410089ab101f8ec6f700'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:23.526529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8117d-e95b-450a-aa75-0f13cd295c04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:23.528049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8117d-e95b-450a-aa75-0f13cd295c04 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:23.530671 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f6211e62-ce74-4b41-a06d-2339f27a47a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e96f30a19ee410089ab101f8ec6f700'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:23.531351 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f6211e62-ce74-4b41-a06d-2339f27a47a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e96f30a19ee410089ab101f8ec6f700'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:23.537710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 811/1616] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:23.538583 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8117d-e95b-450a-aa75-0f13cd295c04 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:23.541150 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f6211e62-ce74-4b41-a06d-2339f27a47a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e96f30a19ee410089ab101f8ec6f700'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:23.550525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8117d-e95b-450a-aa75-0f13cd295c04 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:23.556335 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e963678-d714-4b60-b33c-7c1a2a84f094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:23.557004 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963678-d714-4b60-b33c-7c1a2a84f094 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:23.557286 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963678-d714-4b60-b33c-7c1a2a84f094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:23.557568 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963678-d714-4b60-b33c-7c1a2a84f094 admin admin] PATH_INFO: `/v3/projects/59be0959380e4b929dae2a6b01ced2d9/users/7314d102b7cb458c9cc7540e744241a1/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:23.559554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e963678-d714-4b60-b33c-7c1a2a84f094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59be0959380e4b929dae2a6b01ced2d9, user_id=7314d102b7cb458c9cc7540e744241a1, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:23.560353 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 806/1617] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:23 2022] DELETE /identity/v3/users/8e96f30a19ee410089ab101f8ec6f700 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:23.562379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e963678-d714-4b60-b33c-7c1a2a84f094 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:23.564001 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6211e62-ce74-4b41-a06d-2339f27a47a1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:23.565510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f6211e62-ce74-4b41-a06d-2339f27a47a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:23.577207 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 812/1618] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:23 2022] PUT /identity/v3/projects/59be0959380e4b929dae2a6b01ced2d9/users/7314d102b7cb458c9cc7540e744241a1/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:23.589400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8050d7-acb2-4666-b737-45897062d911 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:23.590144 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8050d7-acb2-4666-b737-45897062d911 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:23.590625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8050d7-acb2-4666-b737-45897062d911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:23.626654 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-dd8050d7-acb2-4666-b737-45897062d911 None None] MFA Rules not processed for user `7314d102b7cb458c9cc7540e744241a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:23.629213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dd8050d7-acb2-4666-b737-45897062d911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:23.682436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:23.691715 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6211e62-ce74-4b41-a06d-2339f27a47a1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:23.783301 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 813/1619] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:23.792203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8050d7-acb2-4666-b737-45897062d911 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:23.793955 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dd8050d7-acb2-4666-b737-45897062d911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:23.818852 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb91bd4-b3c5-4a67-a588-b65573474acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:23.819880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb91bd4-b3c5-4a67-a588-b65573474acb admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:23.820244 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb91bd4-b3c5-4a67-a588-b65573474acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:23.820591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb91bd4-b3c5-4a67-a588-b65573474acb admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:23.821661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb91bd4-b3c5-4a67-a588-b65573474acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:23.824127 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb91bd4-b3c5-4a67-a588-b65573474acb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:23.859073 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 807/1620] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:23 2022] POST /identity/v3/users => generated 288 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:23.862681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb91bd4-b3c5-4a67-a588-b65573474acb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:23.890708 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb91bd4-b3c5-4a67-a588-b65573474acb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:23.890971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8050d7-acb2-4666-b737-45897062d911 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:23.896339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4382e6-6c81-43e8-aab1-1001c3d0b6e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:23.897597 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4382e6-6c81-43e8-aab1-1001c3d0b6e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:23.897881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4382e6-6c81-43e8-aab1-1001c3d0b6e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:23.898156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4382e6-6c81-43e8-aab1-1001c3d0b6e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:23.910931 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4382e6-6c81-43e8-aab1-1001c3d0b6e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:23.913681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4382e6-6c81-43e8-aab1-1001c3d0b6e1 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:23.920989 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040076d3-e5aa-4f40-bf7e-a03844f6ca98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:23.921527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040076d3-e5aa-4f40-bf7e-a03844f6ca98 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:23.921830 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040076d3-e5aa-4f40-bf7e-a03844f6ca98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:23.922223 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040076d3-e5aa-4f40-bf7e-a03844f6ca98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:23.923625 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040076d3-e5aa-4f40-bf7e-a03844f6ca98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:23.925635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040076d3-e5aa-4f40-bf7e-a03844f6ca98 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:23.940009 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 808/1621] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:23.944889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040076d3-e5aa-4f40-bf7e-a03844f6ca98 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:23.951107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 814/1622] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:25:23.980290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040076d3-e5aa-4f40-bf7e-a03844f6ca98 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:23.993939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2c4f9-0171-481a-8cec-47e461de9591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:23.994569 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2c4f9-0171-481a-8cec-47e461de9591 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:23.994851 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2c4f9-0171-481a-8cec-47e461de9591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:23.995125 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2c4f9-0171-481a-8cec-47e461de9591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:23.998225 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2c4f9-0171-481a-8cec-47e461de9591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:24.000218 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2c4f9-0171-481a-8cec-47e461de9591 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:24.008874 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4382e6-6c81-43e8-aab1-1001c3d0b6e1 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:24.010419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fe4382e6-6c81-43e8-aab1-1001c3d0b6e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:24.034294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 809/1623] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:24.034563 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4382e6-6c81-43e8-aab1-1001c3d0b6e1 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:24.038667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2c4f9-0171-481a-8cec-47e461de9591 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:24.047770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a587619-a1fd-48d7-a81c-410daf18737e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:24.048444 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a587619-a1fd-48d7-a81c-410daf18737e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:24.048723 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a587619-a1fd-48d7-a81c-410daf18737e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:24.048998 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a587619-a1fd-48d7-a81c-410daf18737e admin admin] PATH_INFO: `/v3/users/e2594c9f017441489ccf40bbac1160ae` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:24.050617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a587619-a1fd-48d7-a81c-410daf18737e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2594c9f017441489ccf40bbac1160ae)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:24.054353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a587619-a1fd-48d7-a81c-410daf18737e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:24.059277 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2c4f9-0171-481a-8cec-47e461de9591 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:24.070304 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e357d0-9441-4f44-8086-298ac7e8a34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:24.072073 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e357d0-9441-4f44-8086-298ac7e8a34f admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:24.072547 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e357d0-9441-4f44-8086-298ac7e8a34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:24.075330 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e357d0-9441-4f44-8086-298ac7e8a34f admin admin] PATH_INFO: `/v3/projects/77b1ec2d9c6b45a991a3388413806941/users/bd699ba19c614f4fa2b6b78c860fe1e8/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:24.116527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e357d0-9441-4f44-8086-298ac7e8a34f admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b1ec2d9c6b45a991a3388413806941, user_id=bd699ba19c614f4fa2b6b78c860fe1e8, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:24.119447 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e357d0-9441-4f44-8086-298ac7e8a34f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:24.123658 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:24.157654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 810/1624] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:24 2022] PUT /identity/v3/projects/77b1ec2d9c6b45a991a3388413806941/users/bd699ba19c614f4fa2b6b78c860fe1e8/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:24.171512 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf44fb5-9cd0-4391-b58d-c0a8cf4b95ab None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:24.172074 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf44fb5-9cd0-4391-b58d-c0a8cf4b95ab None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:24.172429 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf44fb5-9cd0-4391-b58d-c0a8cf4b95ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:24.177543 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2a587619-a1fd-48d7-a81c-410daf18737e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2594c9f017441489ccf40bbac1160ae'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:24.179772 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2a587619-a1fd-48d7-a81c-410daf18737e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2594c9f017441489ccf40bbac1160ae'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:24.196473 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2a587619-a1fd-48d7-a81c-410daf18737e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2594c9f017441489ccf40bbac1160ae'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:24.197705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2a587619-a1fd-48d7-a81c-410daf18737e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2594c9f017441489ccf40bbac1160ae'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:24.216156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2a587619-a1fd-48d7-a81c-410daf18737e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2594c9f017441489ccf40bbac1160ae'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:24.227991 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ecf44fb5-9cd0-4391-b58d-c0a8cf4b95ab None None] MFA Rules not processed for user `bd699ba19c614f4fa2b6b78c860fe1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:24.230282 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ecf44fb5-9cd0-4391-b58d-c0a8cf4b95ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:24.267027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 815/1625] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:24 2022] DELETE /identity/v3/users/e2594c9f017441489ccf40bbac1160ae => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:24.268142 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a587619-a1fd-48d7-a81c-410daf18737e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:24.270242 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2a587619-a1fd-48d7-a81c-410daf18737e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:24.320959 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 811/1626] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:24.322412 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc977cf-f256-467e-997d-dad41e1f6dff None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:24.322739 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc977cf-f256-467e-997d-dad41e1f6dff None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:24.323019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc977cf-f256-467e-997d-dad41e1f6dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:24.341219 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dcc977cf-f256-467e-997d-dad41e1f6dff None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:24.342392 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dcc977cf-f256-467e-997d-dad41e1f6dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:24.343370 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a587619-a1fd-48d7-a81c-410daf18737e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:24.348137 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced25fb-ccd5-40eb-87cf-958acc8bebea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:24.348875 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced25fb-ccd5-40eb-87cf-958acc8bebea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:24.349222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced25fb-ccd5-40eb-87cf-958acc8bebea admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:24.349584 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced25fb-ccd5-40eb-87cf-958acc8bebea admin admin] PATH_INFO: `/v3/projects/aa2da5ebae274daaa384bf0a74f388f7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:24.350008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 812/1627] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:24.350746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc977cf-f256-467e-997d-dad41e1f6dff None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:24.350852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced25fb-ccd5-40eb-87cf-958acc8bebea admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa2da5ebae274daaa384bf0a74f388f7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:24.352037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dcc977cf-f256-467e-997d-dad41e1f6dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:24.352978 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced25fb-ccd5-40eb-87cf-958acc8bebea admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:24.365694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc977cf-f256-467e-997d-dad41e1f6dff None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:24.372610 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39f605-b26c-4f5b-a2eb-a6c837891177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:24.373709 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39f605-b26c-4f5b-a2eb-a6c837891177 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:24.373987 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39f605-b26c-4f5b-a2eb-a6c837891177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:24.374259 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39f605-b26c-4f5b-a2eb-a6c837891177 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:24.374933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39f605-b26c-4f5b-a2eb-a6c837891177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:24.376904 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39f605-b26c-4f5b-a2eb-a6c837891177 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:24.414809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 813/1628] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:24 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:24.416313 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39f605-b26c-4f5b-a2eb-a6c837891177 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:24.416429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ced25fb-ccd5-40eb-87cf-958acc8bebea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa2da5ebae274daaa384bf0a74f388f7', 'request_id': 'req-7ced25fb-ccd5-40eb-87cf-958acc8bebea'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:24.417411 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1a39f605-b26c-4f5b-a2eb-a6c837891177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:24.431440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ced25fb-ccd5-40eb-87cf-958acc8bebea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa2da5ebae274daaa384bf0a74f388f7', 'request_id': 'req-7ced25fb-ccd5-40eb-87cf-958acc8bebea'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:24.438026 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:24.441025 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ced25fb-ccd5-40eb-87cf-958acc8bebea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa2da5ebae274daaa384bf0a74f388f7', 'request_id': 'req-7ced25fb-ccd5-40eb-87cf-958acc8bebea'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:24.466088 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ced25fb-ccd5-40eb-87cf-958acc8bebea admin admin] The token cache is being invalidate because project aa2da5ebae274daaa384bf0a74f388f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:24.466436 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ced25fb-ccd5-40eb-87cf-958acc8bebea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:24.467287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ced25fb-ccd5-40eb-87cf-958acc8bebea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:24.472789 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 816/1629] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:24 2022] DELETE /identity/v3/projects/aa2da5ebae274daaa384bf0a74f388f7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:24.472789 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced25fb-ccd5-40eb-87cf-958acc8bebea admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:24.473898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7ced25fb-ccd5-40eb-87cf-958acc8bebea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:24.523221 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:24.523540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39f605-b26c-4f5b-a2eb-a6c837891177 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:24.532363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ffeeb-6f04-4367-8958-90fa729ada90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:24.534956 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ffeeb-6f04-4367-8958-90fa729ada90 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:24.535468 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ffeeb-6f04-4367-8958-90fa729ada90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:24.535961 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ffeeb-6f04-4367-8958-90fa729ada90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:24.538428 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-727ffeeb-6f04-4367-8958-90fa729ada90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:24.577712 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced25fb-ccd5-40eb-87cf-958acc8bebea admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:24.633546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ffeeb-6f04-4367-8958-90fa729ada90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:24.635647 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ffeeb-6f04-4367-8958-90fa729ada90 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:24.664194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 814/1630] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:24.666344 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37e525-e7e4-40a0-98c7-41de40110f52 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:24.667787 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37e525-e7e4-40a0-98c7-41de40110f52 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:24.668275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37e525-e7e4-40a0-98c7-41de40110f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:24.670122 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819a7a3-8004-4be6-97d6-6cbd77fe6c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:24.670812 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819a7a3-8004-4be6-97d6-6cbd77fe6c56 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:24.671378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819a7a3-8004-4be6-97d6-6cbd77fe6c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:24.671485 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819a7a3-8004-4be6-97d6-6cbd77fe6c56 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:24.672176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819a7a3-8004-4be6-97d6-6cbd77fe6c56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:24.675246 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819a7a3-8004-4be6-97d6-6cbd77fe6c56 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:24.711463 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 817/1631] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:24 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:24.716257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819a7a3-8004-4be6-97d6-6cbd77fe6c56 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:24.720771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5e37e525-e7e4-40a0-98c7-41de40110f52 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:24.727584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5e37e525-e7e4-40a0-98c7-41de40110f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:24.749946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 815/1632] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:24.750747 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819a7a3-8004-4be6-97d6-6cbd77fe6c56 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:24.754424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228216a0-6c5e-4222-ae79-0e3a8997e689 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:24.755244 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228216a0-6c5e-4222-ae79-0e3a8997e689 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:24.755425 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228216a0-6c5e-4222-ae79-0e3a8997e689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:24.758891 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d689e8-02fa-4cda-97f2-a24e53ae8c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:24.759608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d689e8-02fa-4cda-97f2-a24e53ae8c70 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:24.761610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d689e8-02fa-4cda-97f2-a24e53ae8c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:24.762497 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d689e8-02fa-4cda-97f2-a24e53ae8c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:24.764638 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d689e8-02fa-4cda-97f2-a24e53ae8c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:24.766441 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d689e8-02fa-4cda-97f2-a24e53ae8c70 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:24.795050 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 818/1633] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:24.799224 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d689e8-02fa-4cda-97f2-a24e53ae8c70 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:24.799377 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-228216a0-6c5e-4222-ae79-0e3a8997e689 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:24.801016 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-228216a0-6c5e-4222-ae79-0e3a8997e689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:24.812473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 816/1634] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:24.818221 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228216a0-6c5e-4222-ae79-0e3a8997e689 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:24.830568 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d689e8-02fa-4cda-97f2-a24e53ae8c70 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:24.845384 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228216a0-6c5e-4222-ae79-0e3a8997e689 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:24.846988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66ca88-ae0f-4db4-b015-f05bb6bdf0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:24.849589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66ca88-ae0f-4db4-b015-f05bb6bdf0ff admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:24.850080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66ca88-ae0f-4db4-b015-f05bb6bdf0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:24.850365 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66ca88-ae0f-4db4-b015-f05bb6bdf0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:24.851955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01830e1a-d22c-4d44-a288-59d33ceb5c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:24.852643 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01830e1a-d22c-4d44-a288-59d33ceb5c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:24.853019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01830e1a-d22c-4d44-a288-59d33ceb5c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:24.853301 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01830e1a-d22c-4d44-a288-59d33ceb5c88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:24.853536 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66ca88-ae0f-4db4-b015-f05bb6bdf0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:24.853990 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01830e1a-d22c-4d44-a288-59d33ceb5c88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:24.854744 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01830e1a-d22c-4d44-a288-59d33ceb5c88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:24.856357 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01830e1a-d22c-4d44-a288-59d33ceb5c88 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:24.856469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66ca88-ae0f-4db4-b015-f05bb6bdf0ff admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:24.884017 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 819/1635] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:24.884975 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66ca88-ae0f-4db4-b015-f05bb6bdf0ff admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:24.889033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 817/1636] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:25:24.892508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01830e1a-d22c-4d44-a288-59d33ceb5c88 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:24.909055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01830e1a-d22c-4d44-a288-59d33ceb5c88 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:24.913243 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66ca88-ae0f-4db4-b015-f05bb6bdf0ff admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:24.915314 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92062a7d-152d-4b26-b8e9-39f76c403a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:24.916245 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92062a7d-152d-4b26-b8e9-39f76c403a41 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:24.916688 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92062a7d-152d-4b26-b8e9-39f76c403a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:24.917113 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92062a7d-152d-4b26-b8e9-39f76c403a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:24.917921 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92062a7d-152d-4b26-b8e9-39f76c403a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:24.918216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5e858-617c-403b-a7ae-f86c4c80c99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:24.918893 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5e858-617c-403b-a7ae-f86c4c80c99d admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:24.919180 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5e858-617c-403b-a7ae-f86c4c80c99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:24.919885 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5e858-617c-403b-a7ae-f86c4c80c99d admin admin] PATH_INFO: `/v3/projects/d30de384ddbc4f4a9e9ddd1fb82965ea/users/7d0bb79c7082402791ecd1cf71ea3db2/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:24.921678 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92062a7d-152d-4b26-b8e9-39f76c403a41 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:24.950275 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5e858-617c-403b-a7ae-f86c4c80c99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30de384ddbc4f4a9e9ddd1fb82965ea, user_id=7d0bb79c7082402791ecd1cf71ea3db2, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:24.961001 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5e858-617c-403b-a7ae-f86c4c80c99d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:24.994750 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 820/1637] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:24 2022] PUT /identity/v3/projects/d30de384ddbc4f4a9e9ddd1fb82965ea/users/7d0bb79c7082402791ecd1cf71ea3db2/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:24.994931 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 818/1638] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:24 2022] POST /identity/v3/projects => generated 399 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:25:24.995008 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352b7cd-3b5d-4386-97a2-16e8e282d3e8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:24.995008 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352b7cd-3b5d-4386-97a2-16e8e282d3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:24.995008 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352b7cd-3b5d-4386-97a2-16e8e282d3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:24.996516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92062a7d-152d-4b26-b8e9-39f76c403a41 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:25.061823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9352b7cd-3b5d-4386-97a2-16e8e282d3e8 None None] MFA Rules not processed for user `7d0bb79c7082402791ecd1cf71ea3db2`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:25.063087 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9352b7cd-3b5d-4386-97a2-16e8e282d3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:25.101984 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92062a7d-152d-4b26-b8e9-39f76c403a41 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:25.108123 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6b211-e9f8-4b84-8d90-e8f5a615e0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:25.108616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6b211-e9f8-4b84-8d90-e8f5a615e0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:25.109011 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6b211-e9f8-4b84-8d90-e8f5a615e0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:25.109294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6b211-e9f8-4b84-8d90-e8f5a615e0f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:25.109938 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6b211-e9f8-4b84-8d90-e8f5a615e0f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:25.113722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6b211-e9f8-4b84-8d90-e8f5a615e0f8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:25.136341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:25.145238 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 819/1639] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:24 2022] POST /identity/v3/users => generated 300 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:25:25.146271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6b211-e9f8-4b84-8d90-e8f5a615e0f8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:25.149377 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-29b6b211-e9f8-4b84-8d90-e8f5a615e0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:25.163899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 821/1640] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:25.164954 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352b7cd-3b5d-4386-97a2-16e8e282d3e8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:25.168007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6b211-e9f8-4b84-8d90-e8f5a615e0f8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:25.176741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:25.177553 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:25.177878 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352b7cd-3b5d-4386-97a2-16e8e282d3e8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:25.180025 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:25.180319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588 admin admin] PATH_INFO: `/v3/projects/d3f3b9950eed403298c91594ce4dc32f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:25.181648 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f3b9950eed403298c91594ce4dc32f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:25.184423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:25.185051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b5d3c-e716-4498-865c-50a338b1eb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:25.185924 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b5d3c-e716-4498-865c-50a338b1eb57 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:25.186275 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b5d3c-e716-4498-865c-50a338b1eb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:25.186612 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b5d3c-e716-4498-865c-50a338b1eb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:25.187357 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b5d3c-e716-4498-865c-50a338b1eb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:25.189192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b5d3c-e716-4498-865c-50a338b1eb57 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:25.205164 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:25.208445 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 822/1641] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:25.209283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b5d3c-e716-4498-865c-50a338b1eb57 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:25.220946 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b5d3c-e716-4498-865c-50a338b1eb57 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:25.226755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fd5af-5904-455f-be2b-abe26760b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:25.227633 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd5af-5904-455f-be2b-abe26760b1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:25.228384 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd5af-5904-455f-be2b-abe26760b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:25.228848 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd5af-5904-455f-be2b-abe26760b1b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:25.229669 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fd5af-5904-455f-be2b-abe26760b1b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:25.232091 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fd5af-5904-455f-be2b-abe26760b1b9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:25.268768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 823/1642] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:25 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:25.270297 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fd5af-5904-455f-be2b-abe26760b1b9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:25.281467 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f3b9950eed403298c91594ce4dc32f', 'request_id': 'req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:25.305816 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f3b9950eed403298c91594ce4dc32f', 'request_id': 'req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:25.315839 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f3b9950eed403298c91594ce4dc32f', 'request_id': 'req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:25.333495 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588 admin admin] The token cache is being invalidate because project d3f3b9950eed403298c91594ce4dc32f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:25.333790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:25.334502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:25.340044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 820/1643] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:25 2022] DELETE /identity/v3/projects/d3f3b9950eed403298c91594ce4dc32f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:25.343809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:25.348609 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:25.371448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fd5af-5904-455f-be2b-abe26760b1b9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:25.385013 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5a40d-ed87-4250-8b2b-cf6a8987cb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:25.385672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5a40d-ed87-4250-8b2b-cf6a8987cb8a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:25.385953 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5a40d-ed87-4250-8b2b-cf6a8987cb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:25.386280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5a40d-ed87-4250-8b2b-cf6a8987cb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:25.387004 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5a40d-ed87-4250-8b2b-cf6a8987cb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:25.388667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5a40d-ed87-4250-8b2b-cf6a8987cb8a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:25.402768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 824/1644] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:25.402768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5a40d-ed87-4250-8b2b-cf6a8987cb8a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:25.403023 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cca5a40d-ed87-4250-8b2b-cf6a8987cb8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:25.418623 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5a40d-ed87-4250-8b2b-cf6a8987cb8a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:25.424785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca3d3a-d5a9-4712-9e82-fbf676a8f986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:25.425463 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca3d3a-d5a9-4712-9e82-fbf676a8f986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:25.425752 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca3d3a-d5a9-4712-9e82-fbf676a8f986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:25.426030 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca3d3a-d5a9-4712-9e82-fbf676a8f986 admin admin] PATH_INFO: `/v3/users/7314d102b7cb458c9cc7540e744241a1` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:25.427211 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca3d3a-d5a9-4712-9e82-fbf676a8f986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7314d102b7cb458c9cc7540e744241a1)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:25.429487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca3d3a-d5a9-4712-9e82-fbf676a8f986 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:25.471689 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b061d60-bde5-4b3f-b40c-b1a4b1cc1588 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:25.478070 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e192f-7989-4659-a7de-b49deebeb459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:25.479158 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e192f-7989-4659-a7de-b49deebeb459 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:25.479624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e192f-7989-4659-a7de-b49deebeb459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:25.480313 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e192f-7989-4659-a7de-b49deebeb459 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:25.481141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e192f-7989-4659-a7de-b49deebeb459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:25.483122 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e192f-7989-4659-a7de-b49deebeb459 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:25.517137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 821/1645] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:25 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:25.518230 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e192f-7989-4659-a7de-b49deebeb459 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:25.521083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9a5e192f-7989-4659-a7de-b49deebeb459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:25.535025 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e192f-7989-4659-a7de-b49deebeb459 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:25.542558 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6de33-ccf8-4d5e-8aea-ec406a066c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:25.544847 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-13ca3d3a-d5a9-4712-9e82-fbf676a8f986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7314d102b7cb458c9cc7540e744241a1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:25.545250 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6de33-ccf8-4d5e-8aea-ec406a066c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:25.545539 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6de33-ccf8-4d5e-8aea-ec406a066c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:25.545820 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6de33-ccf8-4d5e-8aea-ec406a066c8c admin admin] PATH_INFO: `/v3/projects/8e62165627d54ac49955e45cc03b41ea/users/95c168fd40fb4c89ab575c8962634980/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:25.546465 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-13ca3d3a-d5a9-4712-9e82-fbf676a8f986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7314d102b7cb458c9cc7540e744241a1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:25.559767 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-13ca3d3a-d5a9-4712-9e82-fbf676a8f986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7314d102b7cb458c9cc7540e744241a1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:25.561060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-13ca3d3a-d5a9-4712-9e82-fbf676a8f986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7314d102b7cb458c9cc7540e744241a1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:25.565859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6de33-ccf8-4d5e-8aea-ec406a066c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e62165627d54ac49955e45cc03b41ea, user_id=95c168fd40fb4c89ab575c8962634980, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:25.570031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6de33-ccf8-4d5e-8aea-ec406a066c8c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:25.576805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-13ca3d3a-d5a9-4712-9e82-fbf676a8f986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7314d102b7cb458c9cc7540e744241a1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:25.587962 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 822/1646] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:25 2022] PUT /identity/v3/projects/8e62165627d54ac49955e45cc03b41ea/users/95c168fd40fb4c89ab575c8962634980/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:25.587962 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6de33-ccf8-4d5e-8aea-ec406a066c8c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:25.593499 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3ec6de33-ccf8-4d5e-8aea-ec406a066c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:25.601840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 825/1647] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:25 2022] DELETE /identity/v3/users/7314d102b7cb458c9cc7540e744241a1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:25.603174 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523c93a-4ac5-4c7f-bdce-76b0272e3a4f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:25.603556 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523c93a-4ac5-4c7f-bdce-76b0272e3a4f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:25.603803 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523c93a-4ac5-4c7f-bdce-76b0272e3a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:25.633663 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1523c93a-4ac5-4c7f-bdce-76b0272e3a4f None None] MFA Rules not processed for user `95c168fd40fb4c89ab575c8962634980`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:25.634899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1523c93a-4ac5-4c7f-bdce-76b0272e3a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:25.648234 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:25.667976 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6de33-ccf8-4d5e-8aea-ec406a066c8c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:25.679264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:25.724820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 826/1648] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:25 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:25.729050 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523c93a-4ac5-4c7f-bdce-76b0272e3a4f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:25.730160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1523c93a-4ac5-4c7f-bdce-76b0272e3a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:25.736788 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9e430-3a93-42f4-8dfd-fa8b0f2a1257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:25.737489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9e430-3a93-42f4-8dfd-fa8b0f2a1257 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:25.738146 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9e430-3a93-42f4-8dfd-fa8b0f2a1257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:25.738146 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9e430-3a93-42f4-8dfd-fa8b0f2a1257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:25.739105 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9e430-3a93-42f4-8dfd-fa8b0f2a1257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:25.740979 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9e430-3a93-42f4-8dfd-fa8b0f2a1257 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:25.757821 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 823/1649] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:25.759262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9e430-3a93-42f4-8dfd-fa8b0f2a1257 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:25.773252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9e430-3a93-42f4-8dfd-fa8b0f2a1257 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:25.788794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6227a-fc2d-4287-9639-fe71138e9f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:25.789638 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6227a-fc2d-4287-9639-fe71138e9f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:25.789921 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6227a-fc2d-4287-9639-fe71138e9f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:25.790239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6227a-fc2d-4287-9639-fe71138e9f2c admin admin] PATH_INFO: `/v3/projects/84d306b819b944a4a6bf0741dbadc461/users/3a3ff0ba7e514996b123d63b86946e47/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:25.809717 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6227a-fc2d-4287-9639-fe71138e9f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d306b819b944a4a6bf0741dbadc461, user_id=3a3ff0ba7e514996b123d63b86946e47, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:25.812596 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6227a-fc2d-4287-9639-fe71138e9f2c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:25.815230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523c93a-4ac5-4c7f-bdce-76b0272e3a4f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:25.823769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bafef-7a78-4a44-b128-23b7481ddf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:25.824856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bafef-7a78-4a44-b128-23b7481ddf2f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:25.825368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bafef-7a78-4a44-b128-23b7481ddf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:25.825684 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bafef-7a78-4a44-b128-23b7481ddf2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:25.826469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bafef-7a78-4a44-b128-23b7481ddf2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:25.828616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bafef-7a78-4a44-b128-23b7481ddf2f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:25.833488 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 824/1650] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:25 2022] PUT /identity/v3/projects/84d306b819b944a4a6bf0741dbadc461/users/3a3ff0ba7e514996b123d63b86946e47/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:25.837020 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6227a-fc2d-4287-9639-fe71138e9f2c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:25.892073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 827/1651] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:25 2022] POST /identity/v3/projects => generated 401 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:25.896068 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bafef-7a78-4a44-b128-23b7481ddf2f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:25.976889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6227a-fc2d-4287-9639-fe71138e9f2c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:26.060297 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556f683-693c-45e5-ac22-682a115fb590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:26.061087 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556f683-693c-45e5-ac22-682a115fb590 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:26.061519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556f683-693c-45e5-ac22-682a115fb590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:26.061890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556f683-693c-45e5-ac22-682a115fb590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:26.062659 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556f683-693c-45e5-ac22-682a115fb590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:26.064536 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556f683-693c-45e5-ac22-682a115fb590 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:26.076689 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 825/1652] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:26.077697 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556f683-693c-45e5-ac22-682a115fb590 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:26.079656 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b556f683-693c-45e5-ac22-682a115fb590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:26.093845 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556f683-693c-45e5-ac22-682a115fb590 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:26.099010 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f879788-53f4-4a51-b527-54a669fb0eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:26.099726 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f879788-53f4-4a51-b527-54a669fb0eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:26.100117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f879788-53f4-4a51-b527-54a669fb0eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:26.100972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f879788-53f4-4a51-b527-54a669fb0eb2 admin admin] PATH_INFO: `/v3/projects/59be0959380e4b929dae2a6b01ced2d9` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:26.101770 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f879788-53f4-4a51-b527-54a669fb0eb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59be0959380e4b929dae2a6b01ced2d9)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:26.104564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f879788-53f4-4a51-b527-54a669fb0eb2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:26.114371 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:26.123571 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bafef-7a78-4a44-b128-23b7481ddf2f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:26.128848 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1263ab-23b2-41a9-9028-8bbf2d3c2517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:26.130137 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1263ab-23b2-41a9-9028-8bbf2d3c2517 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:26.130422 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1263ab-23b2-41a9-9028-8bbf2d3c2517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:26.130695 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1263ab-23b2-41a9-9028-8bbf2d3c2517 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:26.131330 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1263ab-23b2-41a9-9028-8bbf2d3c2517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:26.133319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1263ab-23b2-41a9-9028-8bbf2d3c2517 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:26.166009 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 828/1653] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:25 2022] POST /identity/v3/users => generated 307 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:25:26.166009 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1263ab-23b2-41a9-9028-8bbf2d3c2517 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:26.167343 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3f879788-53f4-4a51-b527-54a669fb0eb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59be0959380e4b929dae2a6b01ced2d9', 'request_id': 'req-3f879788-53f4-4a51-b527-54a669fb0eb2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:26.177812 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3f879788-53f4-4a51-b527-54a669fb0eb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59be0959380e4b929dae2a6b01ced2d9', 'request_id': 'req-3f879788-53f4-4a51-b527-54a669fb0eb2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:26.179715 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1263ab-23b2-41a9-9028-8bbf2d3c2517 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:26.185230 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3f879788-53f4-4a51-b527-54a669fb0eb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59be0959380e4b929dae2a6b01ced2d9', 'request_id': 'req-3f879788-53f4-4a51-b527-54a669fb0eb2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:26.199883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3f879788-53f4-4a51-b527-54a669fb0eb2 admin admin] The token cache is being invalidate because project 59be0959380e4b929dae2a6b01ced2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:26.200845 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3f879788-53f4-4a51-b527-54a669fb0eb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:26.201580 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3f879788-53f4-4a51-b527-54a669fb0eb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:26.203771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 826/1654] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:26 2022] DELETE /identity/v3/projects/59be0959380e4b929dae2a6b01ced2d9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:26.204758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f879788-53f4-4a51-b527-54a669fb0eb2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:26.208573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3f879788-53f4-4a51-b527-54a669fb0eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:26.235712 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:26.252182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b100be-a069-48f6-a5a7-46f472330227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:26.253237 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b100be-a069-48f6-a5a7-46f472330227 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:26.253518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b100be-a069-48f6-a5a7-46f472330227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:26.253796 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b100be-a069-48f6-a5a7-46f472330227 admin admin] PATH_INFO: `/v3/projects/84d306b819b944a4a6bf0741dbadc461/users/3a3ff0ba7e514996b123d63b86946e47/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:26.256541 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b100be-a069-48f6-a5a7-46f472330227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d306b819b944a4a6bf0741dbadc461, user_id=3a3ff0ba7e514996b123d63b86946e47, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:26.259217 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b100be-a069-48f6-a5a7-46f472330227 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:26.270833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 829/1655] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:26 2022] PUT /identity/v3/projects/84d306b819b944a4a6bf0741dbadc461/users/3a3ff0ba7e514996b123d63b86946e47/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:26.277597 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd325acb-a54f-440d-8e6b-c7b2e9214de3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:26.278452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd325acb-a54f-440d-8e6b-c7b2e9214de3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:26.278950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd325acb-a54f-440d-8e6b-c7b2e9214de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:26.288498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f879788-53f4-4a51-b527-54a669fb0eb2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:26.308445 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fd325acb-a54f-440d-8e6b-c7b2e9214de3 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:26.310214 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fd325acb-a54f-440d-8e6b-c7b2e9214de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:26.351159 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97876d5-5eb9-480c-9166-c9c7dfe00d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:26.352067 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97876d5-5eb9-480c-9166-c9c7dfe00d3a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:26.352367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97876d5-5eb9-480c-9166-c9c7dfe00d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:26.352628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97876d5-5eb9-480c-9166-c9c7dfe00d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:26.353274 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97876d5-5eb9-480c-9166-c9c7dfe00d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:26.354879 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97876d5-5eb9-480c-9166-c9c7dfe00d3a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:26.367102 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 827/1656] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:26.369033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd857c-71e8-41f8-9097-b1df5a8f1c81 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:26.369320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd857c-71e8-41f8-9097-b1df5a8f1c81 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:26.369995 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd857c-71e8-41f8-9097-b1df5a8f1c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:26.392759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 830/1657] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:26.392759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce162fd-8ac7-45c4-9ea9-813044f6b7b5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:26.392759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce162fd-8ac7-45c4-9ea9-813044f6b7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:26.392759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce162fd-8ac7-45c4-9ea9-813044f6b7b5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:26.392759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 831/1658] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 17 10:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:25:26.392759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce162fd-8ac7-45c4-9ea9-813044f6b7b5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:26.404491 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6fbd857c-71e8-41f8-9097-b1df5a8f1c81 None None] MFA Rules not processed for user `3a3ff0ba7e514996b123d63b86946e47`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:26.405845 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6fbd857c-71e8-41f8-9097-b1df5a8f1c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:26.413149 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce162fd-8ac7-45c4-9ea9-813044f6b7b5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:26.421901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fae572-f54f-48c3-83b7-e0bc15548c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:26.422105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fae572-f54f-48c3-83b7-e0bc15548c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:26.424455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fae572-f54f-48c3-83b7-e0bc15548c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:26.425407 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fae572-f54f-48c3-83b7-e0bc15548c65 admin admin] PATH_INFO: `/v3/projects/398ab4cfde4646cab57e9de2f6b9e796/users/5016ea5abe6d4d5dacb033c319aa9140/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:26.446331 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:26.470475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fae572-f54f-48c3-83b7-e0bc15548c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398ab4cfde4646cab57e9de2f6b9e796, user_id=5016ea5abe6d4d5dacb033c319aa9140, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:26.479214 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fae572-f54f-48c3-83b7-e0bc15548c65 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:26.522103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 828/1659] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:26.523578 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 832/1660] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:26 2022] PUT /identity/v3/projects/398ab4cfde4646cab57e9de2f6b9e796/users/5016ea5abe6d4d5dacb033c319aa9140/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:26.526333 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d453a86-b90e-4510-9e72-f1471c3ae4d5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:26.526777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d453a86-b90e-4510-9e72-f1471c3ae4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:26.527125 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfdfaf-f0bf-4699-b090-256e0c7c776d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:26.527340 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d453a86-b90e-4510-9e72-f1471c3ae4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:26.527536 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfdfaf-f0bf-4699-b090-256e0c7c776d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:26.527820 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfdfaf-f0bf-4699-b090-256e0c7c776d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:26.559234 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-46dfdfaf-f0bf-4699-b090-256e0c7c776d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:26.560546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-46dfdfaf-f0bf-4699-b090-256e0c7c776d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:26.581168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2d453a86-b90e-4510-9e72-f1471c3ae4d5 None None] MFA Rules not processed for user `a80cc7ec3d2d49f88c81403f918a6900`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:26.584839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2d453a86-b90e-4510-9e72-f1471c3ae4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:26.687611 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 829/1661] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:26.688776 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfdfaf-f0bf-4699-b090-256e0c7c776d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:26.703866 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfdfaf-f0bf-4699-b090-256e0c7c776d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:26.716778 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc638a67-ab92-473f-9a35-cb44882a45a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:26.719131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc638a67-ab92-473f-9a35-cb44882a45a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:26.719437 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc638a67-ab92-473f-9a35-cb44882a45a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:26.719906 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc638a67-ab92-473f-9a35-cb44882a45a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:26.721047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc638a67-ab92-473f-9a35-cb44882a45a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:26.725073 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc638a67-ab92-473f-9a35-cb44882a45a3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:26.740257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 833/1662] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 17 10:25:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:26.741190 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d453a86-b90e-4510-9e72-f1471c3ae4d5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:26.742429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2d453a86-b90e-4510-9e72-f1471c3ae4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:26.768253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 830/1663] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:26.768253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc638a67-ab92-473f-9a35-cb44882a45a3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:26.801346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc638a67-ab92-473f-9a35-cb44882a45a3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:26.817117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db811a7f-f2b8-4223-9a20-58e79f79b801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:26.818408 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db811a7f-f2b8-4223-9a20-58e79f79b801 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:26.821112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db811a7f-f2b8-4223-9a20-58e79f79b801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:26.821512 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db811a7f-f2b8-4223-9a20-58e79f79b801 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:26.822297 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db811a7f-f2b8-4223-9a20-58e79f79b801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:26.822703 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db811a7f-f2b8-4223-9a20-58e79f79b801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:26.825487 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db811a7f-f2b8-4223-9a20-58e79f79b801 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:26.865019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 831/1664] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:25:26.866331 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db811a7f-f2b8-4223-9a20-58e79f79b801 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:26.883709 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d453a86-b90e-4510-9e72-f1471c3ae4d5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:26.886529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db811a7f-f2b8-4223-9a20-58e79f79b801 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:26.893264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18811-8a8e-4cf6-a80a-c6cb168740c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:26.893897 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18811-8a8e-4cf6-a80a-c6cb168740c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:26.894172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18811-8a8e-4cf6-a80a-c6cb168740c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:26.894471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18811-8a8e-4cf6-a80a-c6cb168740c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:26.897668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f289c30-7967-40b1-bb05-31ee22cfd3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:26.898348 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f289c30-7967-40b1-bb05-31ee22cfd3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:26.898626 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f289c30-7967-40b1-bb05-31ee22cfd3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:26.898895 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f289c30-7967-40b1-bb05-31ee22cfd3d8 admin admin] PATH_INFO: `/v3/projects/398ab4cfde4646cab57e9de2f6b9e796/users/5016ea5abe6d4d5dacb033c319aa9140/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:26.901101 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b5f18811-8a8e-4cf6-a80a-c6cb168740c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:26.903945 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f289c30-7967-40b1-bb05-31ee22cfd3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398ab4cfde4646cab57e9de2f6b9e796, user_id=5016ea5abe6d4d5dacb033c319aa9140, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:26.906617 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f289c30-7967-40b1-bb05-31ee22cfd3d8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:26.915787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:26.932067 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 832/1665] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:26 2022] PUT /identity/v3/projects/398ab4cfde4646cab57e9de2f6b9e796/users/5016ea5abe6d4d5dacb033c319aa9140/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:26.932154 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f289c30-7967-40b1-bb05-31ee22cfd3d8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:26.939478 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4f289c30-7967-40b1-bb05-31ee22cfd3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:27.045206 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f18811-8a8e-4cf6-a80a-c6cb168740c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:27.047489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f18811-8a8e-4cf6-a80a-c6cb168740c6 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:27.080122 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 834/1666] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:27.086156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18811-8a8e-4cf6-a80a-c6cb168740c6 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:27.100104 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f289c30-7967-40b1-bb05-31ee22cfd3d8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:27.106753 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12422e5-f04a-46b5-bd18-b18ae18a7648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:27.107474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12422e5-f04a-46b5-bd18-b18ae18a7648 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:27.107760 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12422e5-f04a-46b5-bd18-b18ae18a7648 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:27.108093 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12422e5-f04a-46b5-bd18-b18ae18a7648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:27.122602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12422e5-f04a-46b5-bd18-b18ae18a7648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:27.124950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12422e5-f04a-46b5-bd18-b18ae18a7648 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:27.126100 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18811-8a8e-4cf6-a80a-c6cb168740c6 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:27.147200 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 833/1667] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:27.162222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc774b-aef5-4425-b404-3670854ec866 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:27.162515 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc774b-aef5-4425-b404-3670854ec866 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:27.163037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc774b-aef5-4425-b404-3670854ec866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:27.224323 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:27.234988 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9ebc774b-aef5-4425-b404-3670854ec866 None None] MFA Rules not processed for user `5016ea5abe6d4d5dacb033c319aa9140`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:27.236719 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9ebc774b-aef5-4425-b404-3670854ec866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:27.268060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e4e92-ab90-4fca-b7ba-d4d4c1608367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:27.268963 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4e92-ab90-4fca-b7ba-d4d4c1608367 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:27.269295 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4e92-ab90-4fca-b7ba-d4d4c1608367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:27.271321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4e92-ab90-4fca-b7ba-d4d4c1608367 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:27.272437 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e4e92-ab90-4fca-b7ba-d4d4c1608367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:27.276066 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e4e92-ab90-4fca-b7ba-d4d4c1608367 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:27.344605 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 835/1668] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:27 2022] POST /identity/v3/projects => generated 383 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:27.345772 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e4e92-ab90-4fca-b7ba-d4d4c1608367 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:27.355817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 834/1669] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:27 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:27.369578 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc774b-aef5-4425-b404-3670854ec866 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:27.371358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9ebc774b-aef5-4425-b404-3670854ec866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:27.448511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc774b-aef5-4425-b404-3670854ec866 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:27.485801 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e4e92-ab90-4fca-b7ba-d4d4c1608367 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:27.492353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a731ad7-fa3a-4c47-81fb-3ca1dcb499ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:27.493158 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a731ad7-fa3a-4c47-81fb-3ca1dcb499ab admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:27.493755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a731ad7-fa3a-4c47-81fb-3ca1dcb499ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:27.494187 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a731ad7-fa3a-4c47-81fb-3ca1dcb499ab admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:27.495705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a731ad7-fa3a-4c47-81fb-3ca1dcb499ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:27.497891 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a731ad7-fa3a-4c47-81fb-3ca1dcb499ab admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:27.510927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8e58b-cf0e-49ec-8df2-de97f51370d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:27.511558 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8e58b-cf0e-49ec-8df2-de97f51370d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:27.511843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8e58b-cf0e-49ec-8df2-de97f51370d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:27.512269 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8e58b-cf0e-49ec-8df2-de97f51370d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:27.525754 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 836/1670] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:27 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:27.530769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a731ad7-fa3a-4c47-81fb-3ca1dcb499ab admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:27.543494 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a731ad7-fa3a-4c47-81fb-3ca1dcb499ab admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:27.551371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31be66-beec-4456-93fb-a7c394223e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:27.552482 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31be66-beec-4456-93fb-a7c394223e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:27.552921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31be66-beec-4456-93fb-a7c394223e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:27.553327 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31be66-beec-4456-93fb-a7c394223e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:27.554820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31be66-beec-4456-93fb-a7c394223e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:27.556724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31be66-beec-4456-93fb-a7c394223e35 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:27.574092 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 837/1671] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:27.575469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31be66-beec-4456-93fb-a7c394223e35 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:27.591405 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31be66-beec-4456-93fb-a7c394223e35 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:27.597875 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8e58b-cf0e-49ec-8df2-de97f51370d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:27.598869 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba991ac-3a1b-4d32-a9e0-7e1b87af10f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:27.599661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba991ac-3a1b-4d32-a9e0-7e1b87af10f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:27.599770 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8e58b-cf0e-49ec-8df2-de97f51370d3 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:27.600203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba991ac-3a1b-4d32-a9e0-7e1b87af10f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:27.600608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba991ac-3a1b-4d32-a9e0-7e1b87af10f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:27.601734 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba991ac-3a1b-4d32-a9e0-7e1b87af10f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:27.603590 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba991ac-3a1b-4d32-a9e0-7e1b87af10f8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:27.607012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:27.635504 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 835/1672] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:27 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:27.638546 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 838/1673] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:27.643061 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8e58b-cf0e-49ec-8df2-de97f51370d3 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:27.650004 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:27.671864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8e58b-cf0e-49ec-8df2-de97f51370d3 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:27.684090 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c665538-5fc5-4987-9b87-c79cba217c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:27.685816 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665538-5fc5-4987-9b87-c79cba217c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:27.686110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665538-5fc5-4987-9b87-c79cba217c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:27.686381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665538-5fc5-4987-9b87-c79cba217c13 admin admin] PATH_INFO: `/v3/projects/9ea7175756d4446494dd1c006b19870a/users/1d580235321041e1990ae301a4093b01/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:27.710534 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c665538-5fc5-4987-9b87-c79cba217c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea7175756d4446494dd1c006b19870a, user_id=1d580235321041e1990ae301a4093b01, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:27.713898 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c665538-5fc5-4987-9b87-c79cba217c13 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:27.741744 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 836/1674] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:27 2022] PUT /identity/v3/projects/9ea7175756d4446494dd1c006b19870a/users/1d580235321041e1990ae301a4093b01/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:27.743456 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba991ac-3a1b-4d32-a9e0-7e1b87af10f8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:27.753654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570e02e-08bf-4902-919d-b8028051147c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:27.754693 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570e02e-08bf-4902-919d-b8028051147c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:27.755195 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570e02e-08bf-4902-919d-b8028051147c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:27.756473 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba991ac-3a1b-4d32-a9e0-7e1b87af10f8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:27.830044 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c78767-628d-4acf-b2c4-3c977bf5bf86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:27.830893 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c78767-628d-4acf-b2c4-3c977bf5bf86 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:27.831309 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c78767-628d-4acf-b2c4-3c977bf5bf86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:27.831728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c78767-628d-4acf-b2c4-3c977bf5bf86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:27.834336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3570e02e-08bf-4902-919d-b8028051147c None None] MFA Rules not processed for user `1d580235321041e1990ae301a4093b01`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:27.834495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c6c78767-628d-4acf-b2c4-3c977bf5bf86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:27.836315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3570e02e-08bf-4902-919d-b8028051147c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:27.990203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c78767-628d-4acf-b2c4-3c977bf5bf86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:27.992337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c78767-628d-4acf-b2c4-3c977bf5bf86 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:27.994635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 837/1675] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:27.995684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570e02e-08bf-4902-919d-b8028051147c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:28.017374 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 839/1676] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:27 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:28.165145 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570e02e-08bf-4902-919d-b8028051147c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:28.179623 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59583e6b-9330-4017-bd69-a5928663729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:28.180330 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59583e6b-9330-4017-bd69-a5928663729e admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:28.180574 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59583e6b-9330-4017-bd69-a5928663729e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:28.180844 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59583e6b-9330-4017-bd69-a5928663729e admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:28.181726 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59583e6b-9330-4017-bd69-a5928663729e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:28.187441 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59583e6b-9330-4017-bd69-a5928663729e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:28.248422 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 838/1677] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:27 2022] POST /identity/v3/projects => generated 387 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:28.249378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c78767-628d-4acf-b2c4-3c977bf5bf86 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:28.276323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c78767-628d-4acf-b2c4-3c977bf5bf86 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:28.424076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be2a0e-98f5-4856-b8ec-496f8802d529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:28.425998 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be2a0e-98f5-4856-b8ec-496f8802d529 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:28.427040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be2a0e-98f5-4856-b8ec-496f8802d529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:28.429519 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be2a0e-98f5-4856-b8ec-496f8802d529 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:28.431328 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be2a0e-98f5-4856-b8ec-496f8802d529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:28.437304 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be2a0e-98f5-4856-b8ec-496f8802d529 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:28.507596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 840/1678] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:28 2022] POST /identity/v3/users => generated 294 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:28.509469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59583e6b-9330-4017-bd69-a5928663729e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:28.522248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59583e6b-9330-4017-bd69-a5928663729e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:28.547350 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f486f-cfc3-469b-9061-5248ed0f617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:28.548167 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f486f-cfc3-469b-9061-5248ed0f617b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:28.548360 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f486f-cfc3-469b-9061-5248ed0f617b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:28.548644 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f486f-cfc3-469b-9061-5248ed0f617b admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:28.549308 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f486f-cfc3-469b-9061-5248ed0f617b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:28.551303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f486f-cfc3-469b-9061-5248ed0f617b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:28.572538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 839/1679] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:28.574139 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be2a0e-98f5-4856-b8ec-496f8802d529 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:28.587705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be2a0e-98f5-4856-b8ec-496f8802d529 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:28.607481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b98a6-4db0-4dc5-bc1f-e26110a51a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:28.608142 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b98a6-4db0-4dc5-bc1f-e26110a51a3d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:28.608423 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b98a6-4db0-4dc5-bc1f-e26110a51a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:28.608727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b98a6-4db0-4dc5-bc1f-e26110a51a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:28.609391 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b98a6-4db0-4dc5-bc1f-e26110a51a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:28.611240 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b98a6-4db0-4dc5-bc1f-e26110a51a3d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:28.626847 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 841/1680] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:28.630878 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f486f-cfc3-469b-9061-5248ed0f617b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:28.661056 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f486f-cfc3-469b-9061-5248ed0f617b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:28.671466 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e910b90-1396-4e74-aebd-6b8a115da11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:28.674300 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910b90-1396-4e74-aebd-6b8a115da11b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:28.674664 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910b90-1396-4e74-aebd-6b8a115da11b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:28.675090 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910b90-1396-4e74-aebd-6b8a115da11b admin admin] PATH_INFO: `/v3/projects/e798d302c97b4835818e74087b56fb98/users/88a04f1286a1467cac246fc0c3e4a7e0/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:28.705469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e910b90-1396-4e74-aebd-6b8a115da11b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e798d302c97b4835818e74087b56fb98, user_id=88a04f1286a1467cac246fc0c3e4a7e0, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:28.709161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e910b90-1396-4e74-aebd-6b8a115da11b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:28.725827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 840/1681] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:28 2022] PUT /identity/v3/projects/e798d302c97b4835818e74087b56fb98/users/88a04f1286a1467cac246fc0c3e4a7e0/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:28.737668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d0060-e443-46eb-ab80-3453420e8131 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:28.737955 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d0060-e443-46eb-ab80-3453420e8131 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:28.738293 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d0060-e443-46eb-ab80-3453420e8131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:28.769121 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-550d0060-e443-46eb-ab80-3453420e8131 None None] MFA Rules not processed for user `88a04f1286a1467cac246fc0c3e4a7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:28.771229 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-550d0060-e443-46eb-ab80-3453420e8131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:28.791117 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:28.841933 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 842/1682] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:28.846441 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e910b90-1396-4e74-aebd-6b8a115da11b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:28.869654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:28.901262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d0060-e443-46eb-ab80-3453420e8131 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:28.934229 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e910b90-1396-4e74-aebd-6b8a115da11b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:28.938920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30680f19-67fb-42b3-93a6-f43993929af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:28.939439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30680f19-67fb-42b3-93a6-f43993929af2 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:28.939716 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30680f19-67fb-42b3-93a6-f43993929af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:28.940008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30680f19-67fb-42b3-93a6-f43993929af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:28.940638 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30680f19-67fb-42b3-93a6-f43993929af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:28.942555 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30680f19-67fb-42b3-93a6-f43993929af2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:28.965072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d0060-e443-46eb-ab80-3453420e8131 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:28.968841 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f66f50-a3e8-4516-8528-28e2a30ba9cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:28.969458 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f66f50-a3e8-4516-8528-28e2a30ba9cb service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:28.969737 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f66f50-a3e8-4516-8528-28e2a30ba9cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:28.970208 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f66f50-a3e8-4516-8528-28e2a30ba9cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:28.970330 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 841/1683] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:28 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:28.971802 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f9f66f50-a3e8-4516-8528-28e2a30ba9cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:28.974830 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30680f19-67fb-42b3-93a6-f43993929af2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:29.034104 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f66f50-a3e8-4516-8528-28e2a30ba9cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:29.035643 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f66f50-a3e8-4516-8528-28e2a30ba9cb service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:29.039524 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30680f19-67fb-42b3-93a6-f43993929af2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:29.044463 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9f93b-371d-464d-a5dc-8bee7d52a5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:29.045150 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9f93b-371d-464d-a5dc-8bee7d52a5de admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:29.045439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9f93b-371d-464d-a5dc-8bee7d52a5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:29.045718 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9f93b-371d-464d-a5dc-8bee7d52a5de admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:29.046360 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9f93b-371d-464d-a5dc-8bee7d52a5de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:29.048256 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 843/1684] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:29.048461 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9f93b-371d-464d-a5dc-8bee7d52a5de admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:29.076930 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 842/1685] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:28 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:25:29.081065 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f66f50-a3e8-4516-8528-28e2a30ba9cb service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:29.093351 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f66f50-a3e8-4516-8528-28e2a30ba9cb service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:29.100330 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624bf59-4191-4b7c-a5dc-65e4af2be64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:29.100330 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624bf59-4191-4b7c-a5dc-65e4af2be64c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:29.100785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624bf59-4191-4b7c-a5dc-65e4af2be64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:29.100894 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624bf59-4191-4b7c-a5dc-65e4af2be64c admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:29.101594 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624bf59-4191-4b7c-a5dc-65e4af2be64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:29.103204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624bf59-4191-4b7c-a5dc-65e4af2be64c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:29.118626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 844/1686] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:29.120047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9f93b-371d-464d-a5dc-8bee7d52a5de admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:29.136059 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9f93b-371d-464d-a5dc-8bee7d52a5de admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:29.142191 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a48c8-7f5e-4346-a8a8-4a6c09665e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:29.143562 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a48c8-7f5e-4346-a8a8-4a6c09665e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:29.148408 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a48c8-7f5e-4346-a8a8-4a6c09665e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:29.148856 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a48c8-7f5e-4346-a8a8-4a6c09665e1b admin admin] PATH_INFO: `/v3/projects/b6773d83b8114dfa80394cb17609bdd8/users/35428512cc75470094ad377f06cf44c3/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:29.169173 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a48c8-7f5e-4346-a8a8-4a6c09665e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6773d83b8114dfa80394cb17609bdd8, user_id=35428512cc75470094ad377f06cf44c3, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:29.172373 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a48c8-7f5e-4346-a8a8-4a6c09665e1b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:29.187192 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 843/1687] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:29 2022] PUT /identity/v3/projects/b6773d83b8114dfa80394cb17609bdd8/users/35428512cc75470094ad377f06cf44c3/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:29.191054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624bf59-4191-4b7c-a5dc-65e4af2be64c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:29.201663 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624bf59-4191-4b7c-a5dc-65e4af2be64c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:29.265409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75223874-7e20-4ae0-9412-cab547054733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:29.266177 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75223874-7e20-4ae0-9412-cab547054733 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:29.266461 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75223874-7e20-4ae0-9412-cab547054733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:29.266861 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75223874-7e20-4ae0-9412-cab547054733 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:29.267514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75223874-7e20-4ae0-9412-cab547054733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:29.269183 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75223874-7e20-4ae0-9412-cab547054733 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:29.275361 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:29.284039 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 845/1688] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:29.285175 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a48c8-7f5e-4346-a8a8-4a6c09665e1b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:29.299738 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a48c8-7f5e-4346-a8a8-4a6c09665e1b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:29.305593 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ac946-387d-4140-ba9c-2b7e49a248c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:29.306379 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ac946-387d-4140-ba9c-2b7e49a248c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:29.306723 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ac946-387d-4140-ba9c-2b7e49a248c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:29.307109 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ac946-387d-4140-ba9c-2b7e49a248c0 admin admin] PATH_INFO: `/v3/projects/b6773d83b8114dfa80394cb17609bdd8/users/35428512cc75470094ad377f06cf44c3/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:29.309430 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ac946-387d-4140-ba9c-2b7e49a248c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6773d83b8114dfa80394cb17609bdd8, user_id=35428512cc75470094ad377f06cf44c3, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:29.312520 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ac946-387d-4140-ba9c-2b7e49a248c0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:29.326073 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 844/1689] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:29 2022] PUT /identity/v3/projects/b6773d83b8114dfa80394cb17609bdd8/users/35428512cc75470094ad377f06cf44c3/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:29.338344 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280831b-7be1-4637-b011-c575081a1838 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:29.338628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280831b-7be1-4637-b011-c575081a1838 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:29.338902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280831b-7be1-4637-b011-c575081a1838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:29.372541 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f280831b-7be1-4637-b011-c575081a1838 None None] MFA Rules not processed for user `35428512cc75470094ad377f06cf44c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:29.374171 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f280831b-7be1-4637-b011-c575081a1838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:29.483346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 846/1690] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:29.489454 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ac946-387d-4140-ba9c-2b7e49a248c0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:29.559049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ac946-387d-4140-ba9c-2b7e49a248c0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:29.563074 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face29c7-0dd7-417c-800a-860c5427fe51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:29.563747 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face29c7-0dd7-417c-800a-860c5427fe51 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:29.564119 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face29c7-0dd7-417c-800a-860c5427fe51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:29.564836 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face29c7-0dd7-417c-800a-860c5427fe51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:29.574618 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face29c7-0dd7-417c-800a-860c5427fe51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:29.576145 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face29c7-0dd7-417c-800a-860c5427fe51 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:29.580220 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:29.588112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 845/1691] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:29.824903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280831b-7be1-4637-b011-c575081a1838 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:29.849141 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280831b-7be1-4637-b011-c575081a1838 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:29.856271 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc087a75-e535-4e32-9023-5708cf69a11c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:29.857176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc087a75-e535-4e32-9023-5708cf69a11c service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:29.857596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc087a75-e535-4e32-9023-5708cf69a11c service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:29.858043 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc087a75-e535-4e32-9023-5708cf69a11c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:29.963506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc087a75-e535-4e32-9023-5708cf69a11c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:29.965361 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc087a75-e535-4e32-9023-5708cf69a11c service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:29.978637 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 847/1692] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:30.186377 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face29c7-0dd7-417c-800a-860c5427fe51 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:30.188137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-face29c7-0dd7-417c-800a-860c5427fe51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:30.258155 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face29c7-0dd7-417c-800a-860c5427fe51 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:30.264557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7845228-36af-425a-bcd5-f643a6821b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:30.265207 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7845228-36af-425a-bcd5-f643a6821b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:30.265490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7845228-36af-425a-bcd5-f643a6821b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:30.265764 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7845228-36af-425a-bcd5-f643a6821b58 admin admin] PATH_INFO: `/v3/users/1dc69d811ab04281a9ad783fa87c5270` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:30.267035 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7845228-36af-425a-bcd5-f643a6821b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dc69d811ab04281a9ad783fa87c5270)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:30.269021 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7845228-36af-425a-bcd5-f643a6821b58 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:30.321419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f7845228-36af-425a-bcd5-f643a6821b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dc69d811ab04281a9ad783fa87c5270'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:30.322223 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f7845228-36af-425a-bcd5-f643a6821b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dc69d811ab04281a9ad783fa87c5270'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:30.329983 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f7845228-36af-425a-bcd5-f643a6821b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dc69d811ab04281a9ad783fa87c5270'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:30.330763 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f7845228-36af-425a-bcd5-f643a6821b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dc69d811ab04281a9ad783fa87c5270'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:30.338490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f7845228-36af-425a-bcd5-f643a6821b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dc69d811ab04281a9ad783fa87c5270'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:30.362014 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 846/1693] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:30 2022] DELETE /identity/v3/users/1dc69d811ab04281a9ad783fa87c5270 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:30.367657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227fe0-cba4-4990-be30-3bd6e2db362e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:30.367953 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227fe0-cba4-4990-be30-3bd6e2db362e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:30.368228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227fe0-cba4-4990-be30-3bd6e2db362e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:30.388641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-89227fe0-cba4-4990-be30-3bd6e2db362e None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:30.389832 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-89227fe0-cba4-4990-be30-3bd6e2db362e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:30.441598 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7845228-36af-425a-bcd5-f643a6821b58 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:30.443112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f7845228-36af-425a-bcd5-f643a6821b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:30.451297 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 848/1694] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:30.461866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89227fe0-cba4-4990-be30-3bd6e2db362e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:30.463255 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-89227fe0-cba4-4990-be30-3bd6e2db362e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:30.485039 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:30.508678 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7845228-36af-425a-bcd5-f643a6821b58 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:30.512605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b98f0-d3bf-4778-a81b-2d13b0ee0af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:30.513328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b98f0-d3bf-4778-a81b-2d13b0ee0af6 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:30.513704 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b98f0-d3bf-4778-a81b-2d13b0ee0af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:30.514074 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b98f0-d3bf-4778-a81b-2d13b0ee0af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:30.516156 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-978b98f0-d3bf-4778-a81b-2d13b0ee0af6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:30.523485 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89227fe0-cba4-4990-be30-3bd6e2db362e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:30.527313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ed1e1-870a-49e5-a446-74b7767cfb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:30.527946 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ed1e1-870a-49e5-a446-74b7767cfb54 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:30.528235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ed1e1-870a-49e5-a446-74b7767cfb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:30.528511 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ed1e1-870a-49e5-a446-74b7767cfb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:30.539838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ed1e1-870a-49e5-a446-74b7767cfb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:30.541582 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ed1e1-870a-49e5-a446-74b7767cfb54 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:30.552133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 849/1695] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:25:30.552634 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:30.604374 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b98f0-d3bf-4778-a81b-2d13b0ee0af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:30.606155 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b98f0-d3bf-4778-a81b-2d13b0ee0af6 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:30.617214 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 847/1696] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:30.994059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ed1e1-870a-49e5-a446-74b7767cfb54 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:30.995401 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fd2ed1e1-870a-49e5-a446-74b7767cfb54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:31.014354 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ed1e1-870a-49e5-a446-74b7767cfb54 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:31.033776 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab90f0-2bf1-494f-8e24-7ab2cd2e7cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:31.035074 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab90f0-2bf1-494f-8e24-7ab2cd2e7cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:31.035408 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab90f0-2bf1-494f-8e24-7ab2cd2e7cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:31.035606 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab90f0-2bf1-494f-8e24-7ab2cd2e7cd1 admin admin] PATH_INFO: `/v3/projects/c660dc049c654952bb35d516a9fb4d33` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:31.036933 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab90f0-2bf1-494f-8e24-7ab2cd2e7cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c660dc049c654952bb35d516a9fb4d33)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:31.038956 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab90f0-2bf1-494f-8e24-7ab2cd2e7cd1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:31.109794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3dab90f0-2bf1-494f-8e24-7ab2cd2e7cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c660dc049c654952bb35d516a9fb4d33', 'request_id': 'req-3dab90f0-2bf1-494f-8e24-7ab2cd2e7cd1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:31.121892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3dab90f0-2bf1-494f-8e24-7ab2cd2e7cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c660dc049c654952bb35d516a9fb4d33', 'request_id': 'req-3dab90f0-2bf1-494f-8e24-7ab2cd2e7cd1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:31.132251 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3dab90f0-2bf1-494f-8e24-7ab2cd2e7cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c660dc049c654952bb35d516a9fb4d33', 'request_id': 'req-3dab90f0-2bf1-494f-8e24-7ab2cd2e7cd1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:31.152617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3dab90f0-2bf1-494f-8e24-7ab2cd2e7cd1 admin admin] The token cache is being invalidate because project c660dc049c654952bb35d516a9fb4d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:31.152617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3dab90f0-2bf1-494f-8e24-7ab2cd2e7cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:31.152617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3dab90f0-2bf1-494f-8e24-7ab2cd2e7cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:31.152617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 850/1697] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:30 2022] DELETE /identity/v3/projects/c660dc049c654952bb35d516a9fb4d33 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:31.154999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17993ae6-a606-4c65-b272-6c440130b5cd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:31.155837 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17993ae6-a606-4c65-b272-6c440130b5cd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:31.156149 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17993ae6-a606-4c65-b272-6c440130b5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:31.191961 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-17993ae6-a606-4c65-b272-6c440130b5cd None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:31.193315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-17993ae6-a606-4c65-b272-6c440130b5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:31.295202 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 848/1698] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:25:31.303260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc1802-56d3-4e02-8ac9-8449d7d4f805 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:31.303557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc1802-56d3-4e02-8ac9-8449d7d4f805 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:31.303839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc1802-56d3-4e02-8ac9-8449d7d4f805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:31.325755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-18dc1802-56d3-4e02-8ac9-8449d7d4f805 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:31.326899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-18dc1802-56d3-4e02-8ac9-8449d7d4f805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:31.335833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 851/1699] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:31.340622 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17993ae6-a606-4c65-b272-6c440130b5cd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:31.353528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17993ae6-a606-4c65-b272-6c440130b5cd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:31.359089 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b4727-3d37-449a-a83f-82e9a4636af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:31.359708 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b4727-3d37-449a-a83f-82e9a4636af2 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:31.360018 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b4727-3d37-449a-a83f-82e9a4636af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:31.360312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b4727-3d37-449a-a83f-82e9a4636af2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:31.361034 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b4727-3d37-449a-a83f-82e9a4636af2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:31.361434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b4727-3d37-449a-a83f-82e9a4636af2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:31.362983 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b4727-3d37-449a-a83f-82e9a4636af2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:31.379321 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 849/1700] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:25:31.380568 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc1802-56d3-4e02-8ac9-8449d7d4f805 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:31.390766 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc1802-56d3-4e02-8ac9-8449d7d4f805 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:31.396727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e6c39-de84-4007-aacc-3754f2bbde3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:31.397509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e6c39-de84-4007-aacc-3754f2bbde3c admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:31.397786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e6c39-de84-4007-aacc-3754f2bbde3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:31.398057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e6c39-de84-4007-aacc-3754f2bbde3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:31.398756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e6c39-de84-4007-aacc-3754f2bbde3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:31.400747 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e6c39-de84-4007-aacc-3754f2bbde3c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:31.434373 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 852/1701] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:31 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:25:31.438766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b4727-3d37-449a-a83f-82e9a4636af2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:31.453927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b4727-3d37-449a-a83f-82e9a4636af2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:31.535764 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53548646-230e-4876-ab45-7f8e1e989550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:31.536440 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53548646-230e-4876-ab45-7f8e1e989550 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:31.536718 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53548646-230e-4876-ab45-7f8e1e989550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:31.536986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53548646-230e-4876-ab45-7f8e1e989550 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:31.537686 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53548646-230e-4876-ab45-7f8e1e989550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:31.539829 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53548646-230e-4876-ab45-7f8e1e989550 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:31.563353 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 850/1702] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:31 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:31.567717 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e6c39-de84-4007-aacc-3754f2bbde3c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:31.578570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e6c39-de84-4007-aacc-3754f2bbde3c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:31.583942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4564c-bab8-4c71-af11-a7bfa9105e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:31.584551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4564c-bab8-4c71-af11-a7bfa9105e9a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:31.584831 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4564c-bab8-4c71-af11-a7bfa9105e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:31.585104 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4564c-bab8-4c71-af11-a7bfa9105e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:31.585747 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4564c-bab8-4c71-af11-a7bfa9105e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:31.587340 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4564c-bab8-4c71-af11-a7bfa9105e9a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:31.597210 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 853/1703] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:31.601178 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53548646-230e-4876-ab45-7f8e1e989550 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:31.611033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53548646-230e-4876-ab45-7f8e1e989550 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:31.615977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82951a2b-7af4-4457-8a30-9fc5b91a6ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:31.616576 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82951a2b-7af4-4457-8a30-9fc5b91a6ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:31.616856 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82951a2b-7af4-4457-8a30-9fc5b91a6ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:31.617128 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82951a2b-7af4-4457-8a30-9fc5b91a6ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:31.617832 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82951a2b-7af4-4457-8a30-9fc5b91a6ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:31.619398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82951a2b-7af4-4457-8a30-9fc5b91a6ee8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:31.630525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 851/1704] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:31.634367 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4564c-bab8-4c71-af11-a7bfa9105e9a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:31.643951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4564c-bab8-4c71-af11-a7bfa9105e9a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:31.649157 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9d878-d884-403b-8317-0a0b8fb68f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:31.649792 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9d878-d884-403b-8317-0a0b8fb68f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:31.650072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9d878-d884-403b-8317-0a0b8fb68f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:31.650349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9d878-d884-403b-8317-0a0b8fb68f5a admin admin] PATH_INFO: `/v3/projects/337270e51c034e00ac753932b959e721/users/c44adb0be9e044f7958a8c0ed6cfe535/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:31.664456 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9d878-d884-403b-8317-0a0b8fb68f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=337270e51c034e00ac753932b959e721, user_id=c44adb0be9e044f7958a8c0ed6cfe535, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:31.667096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9d878-d884-403b-8317-0a0b8fb68f5a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:31.680036 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 854/1705] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:31 2022] PUT /identity/v3/projects/337270e51c034e00ac753932b959e721/users/c44adb0be9e044f7958a8c0ed6cfe535/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:31.685067 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef515592-0fe8-470e-a4ed-fc5375500d97 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:31.685353 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef515592-0fe8-470e-a4ed-fc5375500d97 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:31.685622 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef515592-0fe8-470e-a4ed-fc5375500d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:31.704825 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ef515592-0fe8-470e-a4ed-fc5375500d97 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:31.706045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ef515592-0fe8-470e-a4ed-fc5375500d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:31.743030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:31.773741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 852/1706] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:31.783613 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9d878-d884-403b-8317-0a0b8fb68f5a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:31.785590 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d4b9d878-d884-403b-8317-0a0b8fb68f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:31.835080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:31.850130 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9d878-d884-403b-8317-0a0b8fb68f5a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:31.853953 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f59a8-9888-475b-8862-a82b1e285dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:31.854782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f59a8-9888-475b-8862-a82b1e285dfb service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:31.854893 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f59a8-9888-475b-8862-a82b1e285dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:31.855114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f59a8-9888-475b-8862-a82b1e285dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:31.867106 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f59a8-9888-475b-8862-a82b1e285dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:31.868783 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f59a8-9888-475b-8862-a82b1e285dfb service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:31.879541 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 855/1707] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:32.689315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef515592-0fe8-470e-a4ed-fc5375500d97 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:32.691122 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ef515592-0fe8-470e-a4ed-fc5375500d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:32.703649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef515592-0fe8-470e-a4ed-fc5375500d97 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:32.711247 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036d1b0-1c7d-4834-9184-ee03fe5d5280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:32.712152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036d1b0-1c7d-4834-9184-ee03fe5d5280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:32.712434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036d1b0-1c7d-4834-9184-ee03fe5d5280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:32.712705 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036d1b0-1c7d-4834-9184-ee03fe5d5280 admin admin] PATH_INFO: `/v3/users/95c168fd40fb4c89ab575c8962634980` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:32.714362 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036d1b0-1c7d-4834-9184-ee03fe5d5280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95c168fd40fb4c89ab575c8962634980)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:32.716362 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036d1b0-1c7d-4834-9184-ee03fe5d5280 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:32.778469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9036d1b0-1c7d-4834-9184-ee03fe5d5280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95c168fd40fb4c89ab575c8962634980'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:32.779052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9036d1b0-1c7d-4834-9184-ee03fe5d5280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95c168fd40fb4c89ab575c8962634980'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:32.790218 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9036d1b0-1c7d-4834-9184-ee03fe5d5280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95c168fd40fb4c89ab575c8962634980'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:32.791310 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9036d1b0-1c7d-4834-9184-ee03fe5d5280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95c168fd40fb4c89ab575c8962634980'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:32.802682 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9036d1b0-1c7d-4834-9184-ee03fe5d5280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95c168fd40fb4c89ab575c8962634980'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:32.803589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fb4df-0b81-42f1-8bd1-872f0ab8d805 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:32.804105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fb4df-0b81-42f1-8bd1-872f0ab8d805 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:32.804368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fb4df-0b81-42f1-8bd1-872f0ab8d805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:32.826355 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 853/1708] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:32 2022] DELETE /identity/v3/users/95c168fd40fb4c89ab575c8962634980 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:32.827885 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757c59e-1e29-4333-92c5-844f5184ac7d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:32.828194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757c59e-1e29-4333-92c5-844f5184ac7d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:32.828462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757c59e-1e29-4333-92c5-844f5184ac7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:32.840920 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6c2fb4df-0b81-42f1-8bd1-872f0ab8d805 None None] MFA Rules not processed for user `c44adb0be9e044f7958a8c0ed6cfe535`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:32.842381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6c2fb4df-0b81-42f1-8bd1-872f0ab8d805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:32.862544 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0757c59e-1e29-4333-92c5-844f5184ac7d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:32.863775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0757c59e-1e29-4333-92c5-844f5184ac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:32.936127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 856/1709] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:32.947050 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fb4df-0b81-42f1-8bd1-872f0ab8d805 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:32.948818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6c2fb4df-0b81-42f1-8bd1-872f0ab8d805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:32.955970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 854/1710] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:25:32.966290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757c59e-1e29-4333-92c5-844f5184ac7d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:32.968009 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0757c59e-1e29-4333-92c5-844f5184ac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:33.072107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fb4df-0b81-42f1-8bd1-872f0ab8d805 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:33.085049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0eae14-969f-4d10-ad70-7f6610acbd95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:33.085691 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0eae14-969f-4d10-ad70-7f6610acbd95 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:33.086027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0eae14-969f-4d10-ad70-7f6610acbd95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:33.086300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0eae14-969f-4d10-ad70-7f6610acbd95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:33.087591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757c59e-1e29-4333-92c5-844f5184ac7d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:33.091563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9112c3-a8ef-4c2a-8c66-7e005f289c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:33.092288 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9112c3-a8ef-4c2a-8c66-7e005f289c85 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:33.092622 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9112c3-a8ef-4c2a-8c66-7e005f289c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:33.092971 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9112c3-a8ef-4c2a-8c66-7e005f289c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:33.096567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0eae14-969f-4d10-ad70-7f6610acbd95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:33.098056 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0eae14-969f-4d10-ad70-7f6610acbd95 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:33.102777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:33.105917 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9112c3-a8ef-4c2a-8c66-7e005f289c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:33.108714 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9112c3-a8ef-4c2a-8c66-7e005f289c85 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:33.109145 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 857/1711] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:33.123852 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 855/1712] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:25:33.826040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0eae14-969f-4d10-ad70-7f6610acbd95 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:33.827603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8b0eae14-969f-4d10-ad70-7f6610acbd95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:33.845011 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0eae14-969f-4d10-ad70-7f6610acbd95 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:33.850109 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661d189-6857-471f-9782-8dd7937eed94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:33.850759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661d189-6857-471f-9782-8dd7937eed94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:33.851058 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661d189-6857-471f-9782-8dd7937eed94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:33.851296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661d189-6857-471f-9782-8dd7937eed94 admin admin] PATH_INFO: `/v3/projects/8e62165627d54ac49955e45cc03b41ea` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:33.852494 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661d189-6857-471f-9782-8dd7937eed94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e62165627d54ac49955e45cc03b41ea)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:33.854655 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661d189-6857-471f-9782-8dd7937eed94 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:33.906148 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3661d189-6857-471f-9782-8dd7937eed94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e62165627d54ac49955e45cc03b41ea', 'request_id': 'req-3661d189-6857-471f-9782-8dd7937eed94'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:33.917070 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3661d189-6857-471f-9782-8dd7937eed94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e62165627d54ac49955e45cc03b41ea', 'request_id': 'req-3661d189-6857-471f-9782-8dd7937eed94'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:33.923799 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3661d189-6857-471f-9782-8dd7937eed94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e62165627d54ac49955e45cc03b41ea', 'request_id': 'req-3661d189-6857-471f-9782-8dd7937eed94'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:33.931514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:33.936802 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3661d189-6857-471f-9782-8dd7937eed94 admin admin] The token cache is being invalidate because project 8e62165627d54ac49955e45cc03b41ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:33.937170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3661d189-6857-471f-9782-8dd7937eed94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:33.938154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3661d189-6857-471f-9782-8dd7937eed94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:33.940394 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 858/1713] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:33 2022] DELETE /identity/v3/projects/8e62165627d54ac49955e45cc03b41ea => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:33.944827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9112c3-a8ef-4c2a-8c66-7e005f289c85 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:33.954302 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9112c3-a8ef-4c2a-8c66-7e005f289c85 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:34.012690 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1544f-61dc-42ff-bb3a-7fa96367186d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:34.013319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1544f-61dc-42ff-bb3a-7fa96367186d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:34.013676 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1544f-61dc-42ff-bb3a-7fa96367186d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:34.013844 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1544f-61dc-42ff-bb3a-7fa96367186d admin admin] PATH_INFO: `/v3/users/5016ea5abe6d4d5dacb033c319aa9140` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:34.014960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1544f-61dc-42ff-bb3a-7fa96367186d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5016ea5abe6d4d5dacb033c319aa9140)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:34.016910 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1544f-61dc-42ff-bb3a-7fa96367186d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:34.083116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-75e1544f-61dc-42ff-bb3a-7fa96367186d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5016ea5abe6d4d5dacb033c319aa9140'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:34.084946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-75e1544f-61dc-42ff-bb3a-7fa96367186d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5016ea5abe6d4d5dacb033c319aa9140'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:34.096566 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-75e1544f-61dc-42ff-bb3a-7fa96367186d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5016ea5abe6d4d5dacb033c319aa9140'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:34.097706 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-75e1544f-61dc-42ff-bb3a-7fa96367186d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5016ea5abe6d4d5dacb033c319aa9140'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:34.106811 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-75e1544f-61dc-42ff-bb3a-7fa96367186d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5016ea5abe6d4d5dacb033c319aa9140'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:34.130839 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 856/1714] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:33 2022] DELETE /identity/v3/users/5016ea5abe6d4d5dacb033c319aa9140 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:34.196294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661d189-6857-471f-9782-8dd7937eed94 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:34.198128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3661d189-6857-471f-9782-8dd7937eed94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:34.213464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661d189-6857-471f-9782-8dd7937eed94 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:34.286641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefed9f-3b4d-49cc-bddf-4395ddb4d270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:34.287288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefed9f-3b4d-49cc-bddf-4395ddb4d270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:34.287568 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefed9f-3b4d-49cc-bddf-4395ddb4d270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:34.287840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefed9f-3b4d-49cc-bddf-4395ddb4d270 admin admin] PATH_INFO: `/v3/users/bd699ba19c614f4fa2b6b78c860fe1e8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:34.289074 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefed9f-3b4d-49cc-bddf-4395ddb4d270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd699ba19c614f4fa2b6b78c860fe1e8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:34.291015 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefed9f-3b4d-49cc-bddf-4395ddb4d270 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:34.343244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3cefed9f-3b4d-49cc-bddf-4395ddb4d270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd699ba19c614f4fa2b6b78c860fe1e8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:34.343908 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3cefed9f-3b4d-49cc-bddf-4395ddb4d270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd699ba19c614f4fa2b6b78c860fe1e8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:34.352213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3cefed9f-3b4d-49cc-bddf-4395ddb4d270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd699ba19c614f4fa2b6b78c860fe1e8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:34.352965 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3cefed9f-3b4d-49cc-bddf-4395ddb4d270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd699ba19c614f4fa2b6b78c860fe1e8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:34.360319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3cefed9f-3b4d-49cc-bddf-4395ddb4d270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd699ba19c614f4fa2b6b78c860fe1e8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:34.378085 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 859/1715] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:34 2022] DELETE /identity/v3/users/bd699ba19c614f4fa2b6b78c860fe1e8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:34.382701 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b2e85-041d-46c8-b4a7-4dba472d2e0e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:34.383007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b2e85-041d-46c8-b4a7-4dba472d2e0e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:34.383257 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b2e85-041d-46c8-b4a7-4dba472d2e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:34.403093 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5e1b2e85-041d-46c8-b4a7-4dba472d2e0e None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:34.404480 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5e1b2e85-041d-46c8-b4a7-4dba472d2e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:34.515049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 857/1716] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:34.554916 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefed9f-3b4d-49cc-bddf-4395ddb4d270 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:34.562462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3cefed9f-3b4d-49cc-bddf-4395ddb4d270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:34.567463 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a30fb-6086-442c-9b3a-2ef539f36ec6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:34.567760 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a30fb-6086-442c-9b3a-2ef539f36ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:34.568075 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a30fb-6086-442c-9b3a-2ef539f36ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:34.617009 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6b0a30fb-6086-442c-9b3a-2ef539f36ec6 None None] MFA Rules not processed for user `c44adb0be9e044f7958a8c0ed6cfe535`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:34.619044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6b0a30fb-6086-442c-9b3a-2ef539f36ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:34.695108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:34.706232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefed9f-3b4d-49cc-bddf-4395ddb4d270 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:34.714986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de8b70-084b-4637-ac23-93835e18f0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:34.715877 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de8b70-084b-4637-ac23-93835e18f0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:34.716400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de8b70-084b-4637-ac23-93835e18f0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:34.716871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de8b70-084b-4637-ac23-93835e18f0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:34.729359 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de8b70-084b-4637-ac23-93835e18f0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:34.731877 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de8b70-084b-4637-ac23-93835e18f0f2 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:34.749556 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 860/1717] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:34.750289 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de8b70-084b-4637-ac23-93835e18f0f2 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:34.753134 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-34de8b70-084b-4637-ac23-93835e18f0f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:34.782428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de8b70-084b-4637-ac23-93835e18f0f2 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:34.794686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08590e1f-5acc-4bd9-9277-a5fc9e014983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:34.805652 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08590e1f-5acc-4bd9-9277-a5fc9e014983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:34.806035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08590e1f-5acc-4bd9-9277-a5fc9e014983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:34.806259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08590e1f-5acc-4bd9-9277-a5fc9e014983 admin admin] PATH_INFO: `/v3/projects/398ab4cfde4646cab57e9de2f6b9e796` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:34.811686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08590e1f-5acc-4bd9-9277-a5fc9e014983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=398ab4cfde4646cab57e9de2f6b9e796)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:34.813439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 858/1718] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:34.818299 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08590e1f-5acc-4bd9-9277-a5fc9e014983 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:34.853442 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:34.894073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-08590e1f-5acc-4bd9-9277-a5fc9e014983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398ab4cfde4646cab57e9de2f6b9e796', 'request_id': 'req-08590e1f-5acc-4bd9-9277-a5fc9e014983'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:34.908135 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-08590e1f-5acc-4bd9-9277-a5fc9e014983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398ab4cfde4646cab57e9de2f6b9e796', 'request_id': 'req-08590e1f-5acc-4bd9-9277-a5fc9e014983'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:34.921782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-08590e1f-5acc-4bd9-9277-a5fc9e014983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398ab4cfde4646cab57e9de2f6b9e796', 'request_id': 'req-08590e1f-5acc-4bd9-9277-a5fc9e014983'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:34.950157 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-08590e1f-5acc-4bd9-9277-a5fc9e014983 admin admin] The token cache is being invalidate because project 398ab4cfde4646cab57e9de2f6b9e796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:34.950467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-08590e1f-5acc-4bd9-9277-a5fc9e014983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:34.951448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-08590e1f-5acc-4bd9-9277-a5fc9e014983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:34.954569 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 861/1719] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:34 2022] DELETE /identity/v3/projects/398ab4cfde4646cab57e9de2f6b9e796 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:34.961102 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dd3db-f201-4bc6-8353-fce9995a8fe4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:34.961612 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dd3db-f201-4bc6-8353-fce9995a8fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:34.961708 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dd3db-f201-4bc6-8353-fce9995a8fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:34.988958 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bb3dd3db-f201-4bc6-8353-fce9995a8fe4 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:34.990710 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bb3dd3db-f201-4bc6-8353-fce9995a8fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:35.106109 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 859/1720] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:35.113944 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b2032-6afb-4389-84b8-53ec1b2a1cf5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:35.114232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b2032-6afb-4389-84b8-53ec1b2a1cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:35.114511 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b2032-6afb-4389-84b8-53ec1b2a1cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:35.137931 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8f6b2032-6afb-4389-84b8-53ec1b2a1cf5 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:35.138505 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dd3db-f201-4bc6-8353-fce9995a8fe4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:35.139405 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8f6b2032-6afb-4389-84b8-53ec1b2a1cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:35.140078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bb3dd3db-f201-4bc6-8353-fce9995a8fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:35.148486 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 862/1721] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:35.153159 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b2032-6afb-4389-84b8-53ec1b2a1cf5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:35.162942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b2032-6afb-4389-84b8-53ec1b2a1cf5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:35.167865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52915971-cbd1-41bb-835a-27d956c808f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:35.168635 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52915971-cbd1-41bb-835a-27d956c808f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:35.168921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52915971-cbd1-41bb-835a-27d956c808f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:35.169243 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52915971-cbd1-41bb-835a-27d956c808f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:35.169902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52915971-cbd1-41bb-835a-27d956c808f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:35.170856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52915971-cbd1-41bb-835a-27d956c808f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:35.172484 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52915971-cbd1-41bb-835a-27d956c808f7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:35.187975 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 863/1722] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:25:35.192233 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52915971-cbd1-41bb-835a-27d956c808f7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:35.205725 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52915971-cbd1-41bb-835a-27d956c808f7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:35.213506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151ca91-0f5f-4530-832e-355a4276b174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:35.214119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151ca91-0f5f-4530-832e-355a4276b174 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:35.214398 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151ca91-0f5f-4530-832e-355a4276b174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:35.214655 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151ca91-0f5f-4530-832e-355a4276b174 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:35.215295 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151ca91-0f5f-4530-832e-355a4276b174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:35.217246 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151ca91-0f5f-4530-832e-355a4276b174 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:35.227563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dd3db-f201-4bc6-8353-fce9995a8fe4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:35.233536 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10318944-5d15-4ba4-9343-0ba56710f5be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:35.234498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10318944-5d15-4ba4-9343-0ba56710f5be service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:35.235031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10318944-5d15-4ba4-9343-0ba56710f5be service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:35.235511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10318944-5d15-4ba4-9343-0ba56710f5be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:35.237897 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-10318944-5d15-4ba4-9343-0ba56710f5be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:35.260805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 864/1723] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:35 2022] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:35.265286 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151ca91-0f5f-4530-832e-355a4276b174 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:35.340627 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10318944-5d15-4ba4-9343-0ba56710f5be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:35.343065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10318944-5d15-4ba4-9343-0ba56710f5be service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:35.356661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 860/1724] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:25:35.368741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151ca91-0f5f-4530-832e-355a4276b174 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:35.374140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51019f-bb86-413d-bed7-e537fbc2d49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:35.374760 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51019f-bb86-413d-bed7-e537fbc2d49b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:35.375708 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51019f-bb86-413d-bed7-e537fbc2d49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:35.376077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51019f-bb86-413d-bed7-e537fbc2d49b admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:35.377455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51019f-bb86-413d-bed7-e537fbc2d49b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:35.380610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51019f-bb86-413d-bed7-e537fbc2d49b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:35.411433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 865/1725] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:35 2022] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:25:35.415977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10318944-5d15-4ba4-9343-0ba56710f5be service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:35.435106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10318944-5d15-4ba4-9343-0ba56710f5be service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:35.443998 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0a1e9-1df4-4963-a55f-ec1991a50841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:35.444775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0a1e9-1df4-4963-a55f-ec1991a50841 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:35.445158 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0a1e9-1df4-4963-a55f-ec1991a50841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:35.445534 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0a1e9-1df4-4963-a55f-ec1991a50841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:35.446424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0a1e9-1df4-4963-a55f-ec1991a50841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:35.448336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0a1e9-1df4-4963-a55f-ec1991a50841 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:35.472847 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 861/1726] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:35.477504 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51019f-bb86-413d-bed7-e537fbc2d49b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:35.499056 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51019f-bb86-413d-bed7-e537fbc2d49b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:35.504899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da00d88-bbac-45c2-ac60-e65f3a1761ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:35.505638 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da00d88-bbac-45c2-ac60-e65f3a1761ab admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:35.506109 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da00d88-bbac-45c2-ac60-e65f3a1761ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:35.506638 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da00d88-bbac-45c2-ac60-e65f3a1761ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:35.507430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da00d88-bbac-45c2-ac60-e65f3a1761ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:35.509351 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da00d88-bbac-45c2-ac60-e65f3a1761ab admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:35.521810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0a1e9-1df4-4963-a55f-ec1991a50841 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:35.524128 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-03a0a1e9-1df4-4963-a55f-ec1991a50841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:35.524984 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 866/1727] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:35.529632 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da00d88-bbac-45c2-ac60-e65f3a1761ab admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:35.540785 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:35.541448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da00d88-bbac-45c2-ac60-e65f3a1761ab admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:35.549193 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207aa32b-5f22-41c1-b5cc-d2b72f279a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:35.550516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207aa32b-5f22-41c1-b5cc-d2b72f279a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:35.551615 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207aa32b-5f22-41c1-b5cc-d2b72f279a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:35.552147 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207aa32b-5f22-41c1-b5cc-d2b72f279a14 admin admin] PATH_INFO: `/v3/projects/272d5ac586284b40966f8b74f527b930/users/9bab0149a27249e69c5da26f8154963f/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:35.569403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0a1e9-1df4-4963-a55f-ec1991a50841 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:35.572146 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207aa32b-5f22-41c1-b5cc-d2b72f279a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=272d5ac586284b40966f8b74f527b930, user_id=9bab0149a27249e69c5da26f8154963f, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:35.575348 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207aa32b-5f22-41c1-b5cc-d2b72f279a14 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:35.582189 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:35.584289 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:35.584890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:35.585181 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c admin admin] PATH_INFO: `/v3/projects/77b1ec2d9c6b45a991a3388413806941` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:35.589972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b1ec2d9c6b45a991a3388413806941)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:35.595799 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:35.605364 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 867/1728] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:35 2022] PUT /identity/v3/projects/272d5ac586284b40966f8b74f527b930/users/9bab0149a27249e69c5da26f8154963f/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:35.617666 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc520d98-274d-45e5-92a6-5d52d5698064 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:35.618067 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc520d98-274d-45e5-92a6-5d52d5698064 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:35.618240 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc520d98-274d-45e5-92a6-5d52d5698064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:35.673976 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cc520d98-274d-45e5-92a6-5d52d5698064 None None] MFA Rules not processed for user `9bab0149a27249e69c5da26f8154963f`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:35.676080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cc520d98-274d-45e5-92a6-5d52d5698064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:35.683769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:35.693757 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b1ec2d9c6b45a991a3388413806941', 'request_id': 'req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:35.706447 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b1ec2d9c6b45a991a3388413806941', 'request_id': 'req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:35.720901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b1ec2d9c6b45a991a3388413806941', 'request_id': 'req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:35.739595 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c admin admin] The token cache is being invalidate because project 77b1ec2d9c6b45a991a3388413806941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:35.740795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:35.741999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:35.745842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 862/1729] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:35 2022] DELETE /identity/v3/projects/77b1ec2d9c6b45a991a3388413806941 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:35.749886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:35.751914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:35.796127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 868/1730] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:25:35.801640 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc520d98-274d-45e5-92a6-5d52d5698064 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:35.803520 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cc520d98-274d-45e5-92a6-5d52d5698064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:35.899182 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae73a4-c7b1-4b8a-afca-f7475e5bcb5c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:35.915158 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530d1f7-7568-44bd-b0fb-07e2d6f2f694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:35.915831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530d1f7-7568-44bd-b0fb-07e2d6f2f694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:35.916164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530d1f7-7568-44bd-b0fb-07e2d6f2f694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:35.916448 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530d1f7-7568-44bd-b0fb-07e2d6f2f694 admin admin] PATH_INFO: `/v3/users/7d0bb79c7082402791ecd1cf71ea3db2` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:35.919477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530d1f7-7568-44bd-b0fb-07e2d6f2f694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d0bb79c7082402791ecd1cf71ea3db2)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:35.923327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530d1f7-7568-44bd-b0fb-07e2d6f2f694 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:35.923773 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc520d98-274d-45e5-92a6-5d52d5698064 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:35.932849 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb31618-05d5-4958-a766-26dd893aa831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:35.933704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31618-05d5-4958-a766-26dd893aa831 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:35.934219 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31618-05d5-4958-a766-26dd893aa831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:35.934640 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31618-05d5-4958-a766-26dd893aa831 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:35.935481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb31618-05d5-4958-a766-26dd893aa831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:35.940423 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb31618-05d5-4958-a766-26dd893aa831 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:36.004524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 869/1731] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:35 2022] POST /identity/v3/projects => generated 387 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:36.004921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb31618-05d5-4958-a766-26dd893aa831 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:36.025166 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7530d1f7-7568-44bd-b0fb-07e2d6f2f694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d0bb79c7082402791ecd1cf71ea3db2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:36.026939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7530d1f7-7568-44bd-b0fb-07e2d6f2f694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d0bb79c7082402791ecd1cf71ea3db2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:36.040942 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7530d1f7-7568-44bd-b0fb-07e2d6f2f694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d0bb79c7082402791ecd1cf71ea3db2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:36.042128 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7530d1f7-7568-44bd-b0fb-07e2d6f2f694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d0bb79c7082402791ecd1cf71ea3db2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:36.057409 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7530d1f7-7568-44bd-b0fb-07e2d6f2f694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d0bb79c7082402791ecd1cf71ea3db2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:36.094779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 863/1732] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:35 2022] DELETE /identity/v3/users/7d0bb79c7082402791ecd1cf71ea3db2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:36.251111 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb31618-05d5-4958-a766-26dd893aa831 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:36.303154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:36.346959 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7fb4b-aaca-4a58-b1ca-09aeb447a693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:36.347890 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7fb4b-aaca-4a58-b1ca-09aeb447a693 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:36.348486 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7fb4b-aaca-4a58-b1ca-09aeb447a693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:36.348905 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7fb4b-aaca-4a58-b1ca-09aeb447a693 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:36.350257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7fb4b-aaca-4a58-b1ca-09aeb447a693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:36.352724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7fb4b-aaca-4a58-b1ca-09aeb447a693 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:36.422258 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 870/1733] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:36 2022] POST /identity/v3/users => generated 300 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:25:36.426543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530d1f7-7568-44bd-b0fb-07e2d6f2f694 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:36.428026 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7530d1f7-7568-44bd-b0fb-07e2d6f2f694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:36.446393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:36.451125 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530d1f7-7568-44bd-b0fb-07e2d6f2f694 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:36.460403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa7526-ddbb-4905-a638-b0a30848c5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:36.461611 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa7526-ddbb-4905-a638-b0a30848c5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:36.462212 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa7526-ddbb-4905-a638-b0a30848c5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:36.463257 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa7526-ddbb-4905-a638-b0a30848c5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:36.466590 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa7526-ddbb-4905-a638-b0a30848c5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:36.469637 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa7526-ddbb-4905-a638-b0a30848c5e4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:36.484186 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 864/1734] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:36.488042 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7fb4b-aaca-4a58-b1ca-09aeb447a693 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:36.502058 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7fb4b-aaca-4a58-b1ca-09aeb447a693 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:36.510277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79ad34-35b6-44be-a9f0-13598ca99b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:36.511139 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79ad34-35b6-44be-a9f0-13598ca99b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:36.511494 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79ad34-35b6-44be-a9f0-13598ca99b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:36.511858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79ad34-35b6-44be-a9f0-13598ca99b7d admin admin] PATH_INFO: `/v3/projects/d6df0ba77bbb4e62a4e6a3525ed58518/users/b5baa058b3654368a82cf52bdfcb8d41/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:36.547382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79ad34-35b6-44be-a9f0-13598ca99b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6df0ba77bbb4e62a4e6a3525ed58518, user_id=b5baa058b3654368a82cf52bdfcb8d41, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:36.558961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79ad34-35b6-44be-a9f0-13598ca99b7d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:36.599302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 871/1735] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:36 2022] PUT /identity/v3/projects/d6df0ba77bbb4e62a4e6a3525ed58518/users/b5baa058b3654368a82cf52bdfcb8d41/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:36.603196 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa7526-ddbb-4905-a638-b0a30848c5e4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:36.616281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa7526-ddbb-4905-a638-b0a30848c5e4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:36.731778 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a77a8-9c26-4037-a22c-28847c5011b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:36.732616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a77a8-9c26-4037-a22c-28847c5011b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:36.733047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a77a8-9c26-4037-a22c-28847c5011b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:36.734012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a77a8-9c26-4037-a22c-28847c5011b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:36.734904 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a77a8-9c26-4037-a22c-28847c5011b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:36.736704 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a77a8-9c26-4037-a22c-28847c5011b3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:36.751968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 865/1736] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:36.755505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79ad34-35b6-44be-a9f0-13598ca99b7d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:36.770534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79ad34-35b6-44be-a9f0-13598ca99b7d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:36.777251 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acfe00-0698-47fc-ac9c-e128b70c8bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:36.778448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acfe00-0698-47fc-ac9c-e128b70c8bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:36.779046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acfe00-0698-47fc-ac9c-e128b70c8bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:36.779546 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acfe00-0698-47fc-ac9c-e128b70c8bcb admin admin] PATH_INFO: `/v3/projects/d6df0ba77bbb4e62a4e6a3525ed58518/users/b5baa058b3654368a82cf52bdfcb8d41/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:36.782055 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acfe00-0698-47fc-ac9c-e128b70c8bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6df0ba77bbb4e62a4e6a3525ed58518, user_id=b5baa058b3654368a82cf52bdfcb8d41, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:36.786333 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acfe00-0698-47fc-ac9c-e128b70c8bcb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:36.802960 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 872/1737] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:36 2022] PUT /identity/v3/projects/d6df0ba77bbb4e62a4e6a3525ed58518/users/b5baa058b3654368a82cf52bdfcb8d41/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:36.814514 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4ae82-02c8-43a8-afd2-ccd30566b28e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:36.814870 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4ae82-02c8-43a8-afd2-ccd30566b28e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:36.815155 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4ae82-02c8-43a8-afd2-ccd30566b28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:36.859215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0fa4ae82-02c8-43a8-afd2-ccd30566b28e None None] MFA Rules not processed for user `b5baa058b3654368a82cf52bdfcb8d41`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:36.859215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0fa4ae82-02c8-43a8-afd2-ccd30566b28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:36.860686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acfe00-0698-47fc-ac9c-e128b70c8bcb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:36.862743 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-76acfe00-0698-47fc-ac9c-e128b70c8bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:36.962824 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acfe00-0698-47fc-ac9c-e128b70c8bcb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:36.968789 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:36.969535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:36.969821 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:36.970144 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2 admin admin] PATH_INFO: `/v3/projects/d30de384ddbc4f4a9e9ddd1fb82965ea` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:36.971480 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30de384ddbc4f4a9e9ddd1fb82965ea)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:36.974662 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:36.982595 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 866/1738] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:25:36.998616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4ae82-02c8-43a8-afd2-ccd30566b28e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:37.000624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0fa4ae82-02c8-43a8-afd2-ccd30566b28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:37.099866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30de384ddbc4f4a9e9ddd1fb82965ea', 'request_id': 'req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.106359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4ae82-02c8-43a8-afd2-ccd30566b28e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:37.113224 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30de384ddbc4f4a9e9ddd1fb82965ea', 'request_id': 'req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.125350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30de384ddbc4f4a9e9ddd1fb82965ea', 'request_id': 'req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.150252 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2 admin admin] The token cache is being invalidate because project d30de384ddbc4f4a9e9ddd1fb82965ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:37.150671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.151366 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.154683 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 873/1739] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:36 2022] DELETE /identity/v3/projects/d30de384ddbc4f4a9e9ddd1fb82965ea => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:37.159379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:37.165222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:37.188735 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:37.208689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:37.223851 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8eb09-e7ca-4f41-b379-5b311adf753a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:37.224738 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8eb09-e7ca-4f41-b379-5b311adf753a service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:37.225120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8eb09-e7ca-4f41-b379-5b311adf753a service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:37.225497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8eb09-e7ca-4f41-b379-5b311adf753a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:37.227408 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-88b8eb09-e7ca-4f41-b379-5b311adf753a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:37.260549 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d46d7-e5ae-4046-938f-ce37c3f2b2f2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:37.265519 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b3599-4b9a-493a-a001-5f43fabac511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:37.266192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b3599-4b9a-493a-a001-5f43fabac511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:37.266468 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b3599-4b9a-493a-a001-5f43fabac511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:37.266740 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b3599-4b9a-493a-a001-5f43fabac511 admin admin] PATH_INFO: `/v3/users/3a3ff0ba7e514996b123d63b86946e47` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:37.267954 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b3599-4b9a-493a-a001-5f43fabac511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a3ff0ba7e514996b123d63b86946e47)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:37.270436 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b3599-4b9a-493a-a001-5f43fabac511 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:37.300871 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8eb09-e7ca-4f41-b379-5b311adf753a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:37.302702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8eb09-e7ca-4f41-b379-5b311adf753a service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:37.320958 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ff6b3599-4b9a-493a-a001-5f43fabac511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a3ff0ba7e514996b123d63b86946e47'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.321768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ff6b3599-4b9a-493a-a001-5f43fabac511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a3ff0ba7e514996b123d63b86946e47'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.326961 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 867/1740] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:37.329949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ff6b3599-4b9a-493a-a001-5f43fabac511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a3ff0ba7e514996b123d63b86946e47'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.330697 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ff6b3599-4b9a-493a-a001-5f43fabac511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a3ff0ba7e514996b123d63b86946e47'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.340118 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ff6b3599-4b9a-493a-a001-5f43fabac511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a3ff0ba7e514996b123d63b86946e47'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.369099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 874/1741] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:37 2022] DELETE /identity/v3/users/3a3ff0ba7e514996b123d63b86946e47 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:37.472268 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8eb09-e7ca-4f41-b379-5b311adf753a service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:37.474307 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-88b8eb09-e7ca-4f41-b379-5b311adf753a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:37.494137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8eb09-e7ca-4f41-b379-5b311adf753a service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:37.560973 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c62f9-e7de-4081-9a3e-15a5d85fcb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:37.561567 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c62f9-e7de-4081-9a3e-15a5d85fcb84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:37.561850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c62f9-e7de-4081-9a3e-15a5d85fcb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:37.562123 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c62f9-e7de-4081-9a3e-15a5d85fcb84 admin admin] PATH_INFO: `/v3/users/9bab0149a27249e69c5da26f8154963f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:37.568997 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c62f9-e7de-4081-9a3e-15a5d85fcb84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bab0149a27249e69c5da26f8154963f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:37.568997 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c62f9-e7de-4081-9a3e-15a5d85fcb84 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:37.628332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-542c62f9-e7de-4081-9a3e-15a5d85fcb84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bab0149a27249e69c5da26f8154963f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.629715 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-542c62f9-e7de-4081-9a3e-15a5d85fcb84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bab0149a27249e69c5da26f8154963f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.649455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-542c62f9-e7de-4081-9a3e-15a5d85fcb84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bab0149a27249e69c5da26f8154963f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.651641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-542c62f9-e7de-4081-9a3e-15a5d85fcb84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bab0149a27249e69c5da26f8154963f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.674432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-542c62f9-e7de-4081-9a3e-15a5d85fcb84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bab0149a27249e69c5da26f8154963f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.694062 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:37.703111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 868/1742] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:37 2022] DELETE /identity/v3/users/9bab0149a27249e69c5da26f8154963f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:37.704950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ea47a-43ad-4019-baaf-9d9467e0238c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:37.705248 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ea47a-43ad-4019-baaf-9d9467e0238c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:37.705885 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ea47a-43ad-4019-baaf-9d9467e0238c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:37.735708 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-483ea47a-43ad-4019-baaf-9d9467e0238c None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:37.737631 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-483ea47a-43ad-4019-baaf-9d9467e0238c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:37.778829 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c62f9-e7de-4081-9a3e-15a5d85fcb84 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:37.780688 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-542c62f9-e7de-4081-9a3e-15a5d85fcb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:37.828728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 875/1743] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:37.839224 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ea47a-43ad-4019-baaf-9d9467e0238c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:37.840641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-483ea47a-43ad-4019-baaf-9d9467e0238c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:37.873222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c62f9-e7de-4081-9a3e-15a5d85fcb84 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:37.878259 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:37.879082 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:37.879427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:37.879796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e admin admin] PATH_INFO: `/v3/projects/84d306b819b944a4a6bf0741dbadc461` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:37.881012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=84d306b819b944a4a6bf0741dbadc461)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:37.883054 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:37.890801 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:37.914650 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ea47a-43ad-4019-baaf-9d9467e0238c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:37.920843 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38509a7c-8700-4f84-8e7f-1baf127c1117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:37.922435 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38509a7c-8700-4f84-8e7f-1baf127c1117 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:37.922435 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38509a7c-8700-4f84-8e7f-1baf127c1117 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:37.922435 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38509a7c-8700-4f84-8e7f-1baf127c1117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:37.940241 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38509a7c-8700-4f84-8e7f-1baf127c1117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:37.942387 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38509a7c-8700-4f84-8e7f-1baf127c1117 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:37.947549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84d306b819b944a4a6bf0741dbadc461', 'request_id': 'req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.956641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84d306b819b944a4a6bf0741dbadc461', 'request_id': 'req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.957712 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 876/1744] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:25:37.974814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84d306b819b944a4a6bf0741dbadc461', 'request_id': 'req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.994598 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e admin admin] The token cache is being invalidate because project 84d306b819b944a4a6bf0741dbadc461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:37.994987 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.995671 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:37.997352 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 869/1745] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:37 2022] DELETE /identity/v3/projects/84d306b819b944a4a6bf0741dbadc461 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:38.003069 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e94e0-8588-4312-83b0-30e9415e7eef None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:38.003572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e94e0-8588-4312-83b0-30e9415e7eef None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:38.004029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e94e0-8588-4312-83b0-30e9415e7eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:38.028777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d70e94e0-8588-4312-83b0-30e9415e7eef None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:38.030234 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d70e94e0-8588-4312-83b0-30e9415e7eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:38.095550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:38.097332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:38.141600 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 877/1746] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:38.150098 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c25ed6-c8b1-43d7-9772-ee62e812651c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:38.150521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c25ed6-c8b1-43d7-9772-ee62e812651c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:38.150844 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c25ed6-c8b1-43d7-9772-ee62e812651c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:38.179189 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d3c25ed6-c8b1-43d7-9772-ee62e812651c None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:38.181804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d3c25ed6-c8b1-43d7-9772-ee62e812651c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:38.200733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 878/1747] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:25:38.207505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c25ed6-c8b1-43d7-9772-ee62e812651c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:38.221496 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c25ed6-c8b1-43d7-9772-ee62e812651c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:38.232793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e828417-05fe-4a34-9825-eaddf3ddba75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:38.233395 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e828417-05fe-4a34-9825-eaddf3ddba75 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:38.233621 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e828417-05fe-4a34-9825-eaddf3ddba75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:38.235874 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e828417-05fe-4a34-9825-eaddf3ddba75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:38.236533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e828417-05fe-4a34-9825-eaddf3ddba75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:38.239694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e828417-05fe-4a34-9825-eaddf3ddba75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:38.247868 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e828417-05fe-4a34-9825-eaddf3ddba75 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:38.260178 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965da79-bcac-45f5-bf73-ad4bd8a9db8e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:38.273769 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9658df-cccd-4d5e-8e10-c023d2a0dfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:38.274682 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9658df-cccd-4d5e-8e10-c023d2a0dfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:38.274965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9658df-cccd-4d5e-8e10-c023d2a0dfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:38.275356 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9658df-cccd-4d5e-8e10-c023d2a0dfc9 admin admin] PATH_INFO: `/v3/users/1d580235321041e1990ae301a4093b01` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:38.277737 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9658df-cccd-4d5e-8e10-c023d2a0dfc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d580235321041e1990ae301a4093b01)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:38.280113 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9658df-cccd-4d5e-8e10-c023d2a0dfc9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:38.289861 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 879/1748] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:25:38.291459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e828417-05fe-4a34-9825-eaddf3ddba75 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:38.306692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e828417-05fe-4a34-9825-eaddf3ddba75 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:38.327450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385e4d3-4ad4-428b-8bec-289ca43c9dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:38.328433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385e4d3-4ad4-428b-8bec-289ca43c9dbe admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:38.328725 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385e4d3-4ad4-428b-8bec-289ca43c9dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:38.328999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385e4d3-4ad4-428b-8bec-289ca43c9dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:38.329738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385e4d3-4ad4-428b-8bec-289ca43c9dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:38.331732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385e4d3-4ad4-428b-8bec-289ca43c9dbe admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:38.397035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 880/1749] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:38 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:38.398196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385e4d3-4ad4-428b-8bec-289ca43c9dbe admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:38.404572 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:38.444419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b9658df-cccd-4d5e-8e10-c023d2a0dfc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d580235321041e1990ae301a4093b01'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:38.445150 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b9658df-cccd-4d5e-8e10-c023d2a0dfc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d580235321041e1990ae301a4093b01'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:38.456263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b9658df-cccd-4d5e-8e10-c023d2a0dfc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d580235321041e1990ae301a4093b01'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:38.457056 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b9658df-cccd-4d5e-8e10-c023d2a0dfc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d580235321041e1990ae301a4093b01'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:38.468354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8b9658df-cccd-4d5e-8e10-c023d2a0dfc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d580235321041e1990ae301a4093b01'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:38.504035 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 870/1750] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:38 2022] DELETE /identity/v3/users/1d580235321041e1990ae301a4093b01 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:38.510177 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec13eb-7f0f-4701-bf67-ba2d3b894e56 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:38.510459 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec13eb-7f0f-4701-bf67-ba2d3b894e56 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:38.514438 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec13eb-7f0f-4701-bf67-ba2d3b894e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:38.547442 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385e4d3-4ad4-428b-8bec-289ca43c9dbe admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:38.574370 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e6ec13eb-7f0f-4701-bf67-ba2d3b894e56 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:38.575607 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e6ec13eb-7f0f-4701-bf67-ba2d3b894e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:38.620387 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:38.636434 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc5cba-7ba0-4144-8c77-b3531c2ddf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:38.637074 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc5cba-7ba0-4144-8c77-b3531c2ddf2c admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:38.637385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc5cba-7ba0-4144-8c77-b3531c2ddf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:38.637735 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc5cba-7ba0-4144-8c77-b3531c2ddf2c admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:38.638378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc5cba-7ba0-4144-8c77-b3531c2ddf2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:38.640527 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc5cba-7ba0-4144-8c77-b3531c2ddf2c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:38.683920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 871/1751] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:38.683920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec13eb-7f0f-4701-bf67-ba2d3b894e56 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:38.683920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e6ec13eb-7f0f-4701-bf67-ba2d3b894e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:38.694167 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 881/1752] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:38 2022] POST /identity/v3/users => generated 291 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:38.696949 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec13eb-7f0f-4701-bf67-ba2d3b894e56 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:38.701704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc5cba-7ba0-4144-8c77-b3531c2ddf2c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:38.702122 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f86c5-eb5b-43df-ae8c-28353d71cbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:38.702757 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f86c5-eb5b-43df-ae8c-28353d71cbd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:38.703381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f86c5-eb5b-43df-ae8c-28353d71cbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:38.703381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f86c5-eb5b-43df-ae8c-28353d71cbd5 admin admin] PATH_INFO: `/v3/projects/272d5ac586284b40966f8b74f527b930` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:38.704470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f86c5-eb5b-43df-ae8c-28353d71cbd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=272d5ac586284b40966f8b74f527b930)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:38.706881 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f86c5-eb5b-43df-ae8c-28353d71cbd5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:38.707972 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-aebc5cba-7ba0-4144-8c77-b3531c2ddf2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:38.785777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-649f86c5-eb5b-43df-ae8c-28353d71cbd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '272d5ac586284b40966f8b74f527b930', 'request_id': 'req-649f86c5-eb5b-43df-ae8c-28353d71cbd5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:38.786864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc5cba-7ba0-4144-8c77-b3531c2ddf2c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:38.795196 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-649f86c5-eb5b-43df-ae8c-28353d71cbd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '272d5ac586284b40966f8b74f527b930', 'request_id': 'req-649f86c5-eb5b-43df-ae8c-28353d71cbd5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:38.805181 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-649f86c5-eb5b-43df-ae8c-28353d71cbd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '272d5ac586284b40966f8b74f527b930', 'request_id': 'req-649f86c5-eb5b-43df-ae8c-28353d71cbd5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:38.818986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-649f86c5-eb5b-43df-ae8c-28353d71cbd5 admin admin] The token cache is being invalidate because project 272d5ac586284b40966f8b74f527b930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:38.819281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-649f86c5-eb5b-43df-ae8c-28353d71cbd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:38.820385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-649f86c5-eb5b-43df-ae8c-28353d71cbd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:38.824555 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 872/1753] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:38 2022] DELETE /identity/v3/projects/272d5ac586284b40966f8b74f527b930 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:38.825344 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f86c5-eb5b-43df-ae8c-28353d71cbd5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:38.828380 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-649f86c5-eb5b-43df-ae8c-28353d71cbd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:38.849925 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d379f38-9326-4d16-900b-86b90aa69054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:38.850457 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d379f38-9326-4d16-900b-86b90aa69054 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:38.852026 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d379f38-9326-4d16-900b-86b90aa69054 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:38.852026 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d379f38-9326-4d16-900b-86b90aa69054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:38.853753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0d379f38-9326-4d16-900b-86b90aa69054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:38.867666 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:38.917391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f86c5-eb5b-43df-ae8c-28353d71cbd5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:38.923040 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e764da-0ceb-4c01-97d4-714969e3797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:38.923709 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e764da-0ceb-4c01-97d4-714969e3797d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:38.924044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e764da-0ceb-4c01-97d4-714969e3797d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:38.924469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e764da-0ceb-4c01-97d4-714969e3797d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:38.924969 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e764da-0ceb-4c01-97d4-714969e3797d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:38.926622 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e764da-0ceb-4c01-97d4-714969e3797d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:38.937235 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 873/1754] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:38.938108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e764da-0ceb-4c01-97d4-714969e3797d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:38.940763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d379f38-9326-4d16-900b-86b90aa69054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:38.941821 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c1e764da-0ceb-4c01-97d4-714969e3797d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:38.942851 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d379f38-9326-4d16-900b-86b90aa69054 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:38.953530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 882/1755] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:38.954195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d379f38-9326-4d16-900b-86b90aa69054 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:38.961726 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e764da-0ceb-4c01-97d4-714969e3797d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:38.966096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d379f38-9326-4d16-900b-86b90aa69054 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:38.968641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdca55-a535-412e-b1e1-2bfa4dfbd7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:38.969432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdca55-a535-412e-b1e1-2bfa4dfbd7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:38.969715 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdca55-a535-412e-b1e1-2bfa4dfbd7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:38.970033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdca55-a535-412e-b1e1-2bfa4dfbd7ee admin admin] PATH_INFO: `/v3/users/b5baa058b3654368a82cf52bdfcb8d41` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:38.971685 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdca55-a535-412e-b1e1-2bfa4dfbd7ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5baa058b3654368a82cf52bdfcb8d41)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:38.974350 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdca55-a535-412e-b1e1-2bfa4dfbd7ee admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:38.980354 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8809bce-2c0f-4008-b718-5e16b0346da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:38.981276 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8809bce-2c0f-4008-b718-5e16b0346da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:38.981563 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8809bce-2c0f-4008-b718-5e16b0346da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:38.981833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8809bce-2c0f-4008-b718-5e16b0346da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:38.982495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8809bce-2c0f-4008-b718-5e16b0346da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:38.984119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8809bce-2c0f-4008-b718-5e16b0346da6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:39.004860 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 883/1756] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:39.010325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8809bce-2c0f-4008-b718-5e16b0346da6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:39.024881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8809bce-2c0f-4008-b718-5e16b0346da6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:39.030978 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84a172-f1d9-4a36-b4e0-5dfc6a4e1f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:39.031972 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84a172-f1d9-4a36-b4e0-5dfc6a4e1f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:39.032264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84a172-f1d9-4a36-b4e0-5dfc6a4e1f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:39.032945 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84a172-f1d9-4a36-b4e0-5dfc6a4e1f2d admin admin] PATH_INFO: `/v3/projects/d4fdec44e7a1432c8bf9a0bb17f82abc/users/f5988b8fdd714ac0aa76be7340bce7d3/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:39.051419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f6bdca55-a535-412e-b1e1-2bfa4dfbd7ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5baa058b3654368a82cf52bdfcb8d41'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:39.052670 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f6bdca55-a535-412e-b1e1-2bfa4dfbd7ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5baa058b3654368a82cf52bdfcb8d41'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:39.052943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84a172-f1d9-4a36-b4e0-5dfc6a4e1f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4fdec44e7a1432c8bf9a0bb17f82abc, user_id=f5988b8fdd714ac0aa76be7340bce7d3, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:39.060251 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84a172-f1d9-4a36-b4e0-5dfc6a4e1f2d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:39.077109 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 884/1757] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:39 2022] PUT /identity/v3/projects/d4fdec44e7a1432c8bf9a0bb17f82abc/users/f5988b8fdd714ac0aa76be7340bce7d3/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:39.079101 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f6bdca55-a535-412e-b1e1-2bfa4dfbd7ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5baa058b3654368a82cf52bdfcb8d41'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:39.080007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f6bdca55-a535-412e-b1e1-2bfa4dfbd7ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5baa058b3654368a82cf52bdfcb8d41'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:39.088335 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee515c-a7d0-4714-bc2c-303513283773 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:39.088975 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee515c-a7d0-4714-bc2c-303513283773 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:39.090612 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee515c-a7d0-4714-bc2c-303513283773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:39.091261 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f6bdca55-a535-412e-b1e1-2bfa4dfbd7ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5baa058b3654368a82cf52bdfcb8d41'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:39.116016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:39.120625 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 874/1758] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:38 2022] DELETE /identity/v3/users/b5baa058b3654368a82cf52bdfcb8d41 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:39.131775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e0ee515c-a7d0-4714-bc2c-303513283773 None None] MFA Rules not processed for user `f5988b8fdd714ac0aa76be7340bce7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:39.133536 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e0ee515c-a7d0-4714-bc2c-303513283773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:39.225770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 885/1759] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:25:39.238886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdca55-a535-412e-b1e1-2bfa4dfbd7ee admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:39.243302 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f6bdca55-a535-412e-b1e1-2bfa4dfbd7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:39.327682 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdca55-a535-412e-b1e1-2bfa4dfbd7ee admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:39.331446 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1bd21-1fbf-475d-8a0e-2412d2b37fd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:39.332271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1bd21-1fbf-475d-8a0e-2412d2b37fd9 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:39.332653 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1bd21-1fbf-475d-8a0e-2412d2b37fd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:39.333007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1bd21-1fbf-475d-8a0e-2412d2b37fd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:39.342650 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1bd21-1fbf-475d-8a0e-2412d2b37fd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:39.344194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1bd21-1fbf-475d-8a0e-2412d2b37fd9 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:39.357639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 875/1760] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:39.683386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee515c-a7d0-4714-bc2c-303513283773 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:39.684436 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e0ee515c-a7d0-4714-bc2c-303513283773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:39.744614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1bd21-1fbf-475d-8a0e-2412d2b37fd9 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:39.746465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-85d1bd21-1fbf-475d-8a0e-2412d2b37fd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:39.916299 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee515c-a7d0-4714-bc2c-303513283773 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:39.922686 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:39.930738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090fc61-048f-4ee3-8bf0-657ea1222d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:39.932149 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090fc61-048f-4ee3-8bf0-657ea1222d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:39.932732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090fc61-048f-4ee3-8bf0-657ea1222d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:39.933022 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090fc61-048f-4ee3-8bf0-657ea1222d49 admin admin] PATH_INFO: `/v3/projects/d6df0ba77bbb4e62a4e6a3525ed58518` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:39.937633 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090fc61-048f-4ee3-8bf0-657ea1222d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6df0ba77bbb4e62a4e6a3525ed58518)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:39.945939 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090fc61-048f-4ee3-8bf0-657ea1222d49 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:39.993166 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1bd21-1fbf-475d-8a0e-2412d2b37fd9 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:40.016661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7a7bb-94bd-4e05-9b29-4fafdd043646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:40.017378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7a7bb-94bd-4e05-9b29-4fafdd043646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:40.017664 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7a7bb-94bd-4e05-9b29-4fafdd043646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:40.017941 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7a7bb-94bd-4e05-9b29-4fafdd043646 admin admin] PATH_INFO: `/v3/projects/9ea7175756d4446494dd1c006b19870a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:40.020500 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7a7bb-94bd-4e05-9b29-4fafdd043646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea7175756d4446494dd1c006b19870a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:40.022455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7a7bb-94bd-4e05-9b29-4fafdd043646 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:40.095293 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b090fc61-048f-4ee3-8bf0-657ea1222d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6df0ba77bbb4e62a4e6a3525ed58518', 'request_id': 'req-b090fc61-048f-4ee3-8bf0-657ea1222d49'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:40.117262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b090fc61-048f-4ee3-8bf0-657ea1222d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6df0ba77bbb4e62a4e6a3525ed58518', 'request_id': 'req-b090fc61-048f-4ee3-8bf0-657ea1222d49'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:40.125117 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b090fc61-048f-4ee3-8bf0-657ea1222d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6df0ba77bbb4e62a4e6a3525ed58518', 'request_id': 'req-b090fc61-048f-4ee3-8bf0-657ea1222d49'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:40.148542 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b090fc61-048f-4ee3-8bf0-657ea1222d49 admin admin] The token cache is being invalidate because project d6df0ba77bbb4e62a4e6a3525ed58518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:40.148878 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b090fc61-048f-4ee3-8bf0-657ea1222d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:40.149795 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b090fc61-048f-4ee3-8bf0-657ea1222d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:40.152636 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 886/1761] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:39 2022] DELETE /identity/v3/projects/d6df0ba77bbb4e62a4e6a3525ed58518 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:40.157266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31a71e-44a7-4f0a-b18d-41c2e3b816db None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:40.157560 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31a71e-44a7-4f0a-b18d-41c2e3b816db None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:40.157836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31a71e-44a7-4f0a-b18d-41c2e3b816db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:40.192792 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-01b7a7bb-94bd-4e05-9b29-4fafdd043646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea7175756d4446494dd1c006b19870a', 'request_id': 'req-01b7a7bb-94bd-4e05-9b29-4fafdd043646'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:40.203547 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ce31a71e-44a7-4f0a-b18d-41c2e3b816db None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:40.203792 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-01b7a7bb-94bd-4e05-9b29-4fafdd043646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea7175756d4446494dd1c006b19870a', 'request_id': 'req-01b7a7bb-94bd-4e05-9b29-4fafdd043646'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:40.204865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ce31a71e-44a7-4f0a-b18d-41c2e3b816db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:40.220178 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-01b7a7bb-94bd-4e05-9b29-4fafdd043646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea7175756d4446494dd1c006b19870a', 'request_id': 'req-01b7a7bb-94bd-4e05-9b29-4fafdd043646'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:40.233229 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-01b7a7bb-94bd-4e05-9b29-4fafdd043646 admin admin] The token cache is being invalidate because project 9ea7175756d4446494dd1c006b19870a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:40.233547 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-01b7a7bb-94bd-4e05-9b29-4fafdd043646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:40.235092 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-01b7a7bb-94bd-4e05-9b29-4fafdd043646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:40.240704 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 876/1762] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:39 2022] DELETE /identity/v3/projects/9ea7175756d4446494dd1c006b19870a => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:40.246536 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7a7bb-94bd-4e05-9b29-4fafdd043646 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:40.247905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-01b7a7bb-94bd-4e05-9b29-4fafdd043646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:40.261446 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:40.328712 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 887/1763] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:25:40.333838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcb1b6-6653-4326-92d6-e01ce850beb5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:40.334275 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcb1b6-6653-4326-92d6-e01ce850beb5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:40.334662 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcb1b6-6653-4326-92d6-e01ce850beb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:40.361300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-67dcb1b6-6653-4326-92d6-e01ce850beb5 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:40.362400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7a7bb-94bd-4e05-9b29-4fafdd043646 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:40.362880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-67dcb1b6-6653-4326-92d6-e01ce850beb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:40.369193 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bd08f-b8eb-4f4a-a0a9-76cc66f0b227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:40.370105 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd08f-b8eb-4f4a-a0a9-76cc66f0b227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:40.370531 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd08f-b8eb-4f4a-a0a9-76cc66f0b227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:40.370948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd08f-b8eb-4f4a-a0a9-76cc66f0b227 admin admin] PATH_INFO: `/v3/users/88a04f1286a1467cac246fc0c3e4a7e0` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:40.372719 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bd08f-b8eb-4f4a-a0a9-76cc66f0b227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88a04f1286a1467cac246fc0c3e4a7e0)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:40.378117 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 888/1764] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:40.378319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bd08f-b8eb-4f4a-a0a9-76cc66f0b227 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:40.379968 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcb1b6-6653-4326-92d6-e01ce850beb5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:40.397488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcb1b6-6653-4326-92d6-e01ce850beb5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:40.403073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea039d-5ff5-467e-bbfd-b2fb48b87ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:40.403987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea039d-5ff5-467e-bbfd-b2fb48b87ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:40.404523 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea039d-5ff5-467e-bbfd-b2fb48b87ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:40.404896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea039d-5ff5-467e-bbfd-b2fb48b87ae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:40.406814 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea039d-5ff5-467e-bbfd-b2fb48b87ae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:40.406814 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea039d-5ff5-467e-bbfd-b2fb48b87ae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:40.408368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea039d-5ff5-467e-bbfd-b2fb48b87ae6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:40.430021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 889/1765] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:25:40.436130 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea039d-5ff5-467e-bbfd-b2fb48b87ae6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:40.451523 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea039d-5ff5-467e-bbfd-b2fb48b87ae6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:40.476737 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-966bd08f-b8eb-4f4a-a0a9-76cc66f0b227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88a04f1286a1467cac246fc0c3e4a7e0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:40.476953 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a9d30-76fa-47ce-98c4-85555003991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:40.477842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a9d30-76fa-47ce-98c4-85555003991e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:40.478269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a9d30-76fa-47ce-98c4-85555003991e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:40.478437 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-966bd08f-b8eb-4f4a-a0a9-76cc66f0b227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88a04f1286a1467cac246fc0c3e4a7e0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:40.478774 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a9d30-76fa-47ce-98c4-85555003991e admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:40.479749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a9d30-76fa-47ce-98c4-85555003991e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:40.482024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a9d30-76fa-47ce-98c4-85555003991e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:40.502888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-966bd08f-b8eb-4f4a-a0a9-76cc66f0b227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88a04f1286a1467cac246fc0c3e4a7e0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:40.504646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-966bd08f-b8eb-4f4a-a0a9-76cc66f0b227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88a04f1286a1467cac246fc0c3e4a7e0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:40.522342 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-966bd08f-b8eb-4f4a-a0a9-76cc66f0b227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88a04f1286a1467cac246fc0c3e4a7e0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:40.530887 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 890/1766] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:40 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:40.535817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a9d30-76fa-47ce-98c4-85555003991e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:40.543727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-769a9d30-76fa-47ce-98c4-85555003991e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:40.545130 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:40.585647 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 877/1767] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:40 2022] DELETE /identity/v3/users/88a04f1286a1467cac246fc0c3e4a7e0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:40.712481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a9d30-76fa-47ce-98c4-85555003991e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:40.798792 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16dbe5-af13-45b3-8eaa-2251f83f76ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:40.799557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16dbe5-af13-45b3-8eaa-2251f83f76ea admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:40.799903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16dbe5-af13-45b3-8eaa-2251f83f76ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:40.800285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16dbe5-af13-45b3-8eaa-2251f83f76ea admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:40.801579 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16dbe5-af13-45b3-8eaa-2251f83f76ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:40.804124 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16dbe5-af13-45b3-8eaa-2251f83f76ea admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:40.836037 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 891/1768] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:40 2022] POST /identity/v3/users => generated 292 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:40.839050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bd08f-b8eb-4f4a-a0a9-76cc66f0b227 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:40.849929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bd08f-b8eb-4f4a-a0a9-76cc66f0b227 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:40.856361 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396ae9a-9ddd-4763-a3fd-35cf3610144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:40.856767 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396ae9a-9ddd-4763-a3fd-35cf3610144a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:40.856961 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396ae9a-9ddd-4763-a3fd-35cf3610144a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:40.857271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396ae9a-9ddd-4763-a3fd-35cf3610144a admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:40.857990 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396ae9a-9ddd-4763-a3fd-35cf3610144a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:40.859564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396ae9a-9ddd-4763-a3fd-35cf3610144a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:40.873742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 878/1769] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:40.880813 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16dbe5-af13-45b3-8eaa-2251f83f76ea admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:40.900927 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16dbe5-af13-45b3-8eaa-2251f83f76ea admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:40.907197 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6000be-84ac-4279-a017-da6d035ee602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:40.908119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6000be-84ac-4279-a017-da6d035ee602 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:40.908638 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6000be-84ac-4279-a017-da6d035ee602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:40.909254 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6000be-84ac-4279-a017-da6d035ee602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:40.909952 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6000be-84ac-4279-a017-da6d035ee602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:40.911872 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6000be-84ac-4279-a017-da6d035ee602 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:40.930710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 892/1770] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:40.934900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396ae9a-9ddd-4763-a3fd-35cf3610144a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:40.949528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396ae9a-9ddd-4763-a3fd-35cf3610144a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:40.954239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b5589-ffcf-4c29-87ea-fd2545fe2ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:40.954978 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b5589-ffcf-4c29-87ea-fd2545fe2ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:40.955329 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b5589-ffcf-4c29-87ea-fd2545fe2ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:40.955679 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b5589-ffcf-4c29-87ea-fd2545fe2ef2 admin admin] PATH_INFO: `/v3/projects/ec2873b91318480c8dfa0db25f02a8e1/users/e40d2326ee63400fb4ae845c16701636/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:40.979609 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b5589-ffcf-4c29-87ea-fd2545fe2ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2873b91318480c8dfa0db25f02a8e1, user_id=e40d2326ee63400fb4ae845c16701636, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:40.982847 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b5589-ffcf-4c29-87ea-fd2545fe2ef2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:41.008392 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 879/1771] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:40 2022] PUT /identity/v3/projects/ec2873b91318480c8dfa0db25f02a8e1/users/e40d2326ee63400fb4ae845c16701636/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:41.019916 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb8c7b-6eec-4219-8cad-448197a33f92 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:41.020467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb8c7b-6eec-4219-8cad-448197a33f92 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:41.020904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb8c7b-6eec-4219-8cad-448197a33f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:41.055287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-35bb8c7b-6eec-4219-8cad-448197a33f92 None None] MFA Rules not processed for user `e40d2326ee63400fb4ae845c16701636`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:41.062719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-35bb8c7b-6eec-4219-8cad-448197a33f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:41.064008 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:41.159374 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b5589-ffcf-4c29-87ea-fd2545fe2ef2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:41.161967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-003b5589-ffcf-4c29-87ea-fd2545fe2ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:41.280067 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 893/1772] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:41.284210 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb8c7b-6eec-4219-8cad-448197a33f92 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:41.291786 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b5589-ffcf-4c29-87ea-fd2545fe2ef2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:41.297493 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f7f97-b3bd-48e8-8843-b3877afa23c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:41.298293 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f7f97-b3bd-48e8-8843-b3877afa23c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:41.298641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f7f97-b3bd-48e8-8843-b3877afa23c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:41.299014 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f7f97-b3bd-48e8-8843-b3877afa23c6 admin admin] PATH_INFO: `/v3/projects/e798d302c97b4835818e74087b56fb98` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:41.300315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f7f97-b3bd-48e8-8843-b3877afa23c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e798d302c97b4835818e74087b56fb98)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:41.302534 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f7f97-b3bd-48e8-8843-b3877afa23c6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:41.307514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb8c7b-6eec-4219-8cad-448197a33f92 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:41.314617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b23bb-7376-43a8-a3d1-d92255475305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:41.315601 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b23bb-7376-43a8-a3d1-d92255475305 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:41.317489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b23bb-7376-43a8-a3d1-d92255475305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:41.317898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b23bb-7376-43a8-a3d1-d92255475305 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:41.318628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b23bb-7376-43a8-a3d1-d92255475305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:41.321064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b23bb-7376-43a8-a3d1-d92255475305 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:41.358060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 894/1773] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:41 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:25:41.362169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b23bb-7376-43a8-a3d1-d92255475305 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:41.382643 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df2f7f97-b3bd-48e8-8843-b3877afa23c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e798d302c97b4835818e74087b56fb98', 'request_id': 'req-df2f7f97-b3bd-48e8-8843-b3877afa23c6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:41.391358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df2f7f97-b3bd-48e8-8843-b3877afa23c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e798d302c97b4835818e74087b56fb98', 'request_id': 'req-df2f7f97-b3bd-48e8-8843-b3877afa23c6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:41.402200 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df2f7f97-b3bd-48e8-8843-b3877afa23c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e798d302c97b4835818e74087b56fb98', 'request_id': 'req-df2f7f97-b3bd-48e8-8843-b3877afa23c6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:41.414832 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df2f7f97-b3bd-48e8-8843-b3877afa23c6 admin admin] The token cache is being invalidate because project e798d302c97b4835818e74087b56fb98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:41.414832 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df2f7f97-b3bd-48e8-8843-b3877afa23c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:41.415542 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-df2f7f97-b3bd-48e8-8843-b3877afa23c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:41.417656 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 880/1774] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:41 2022] DELETE /identity/v3/projects/e798d302c97b4835818e74087b56fb98 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:41.422190 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f7f97-b3bd-48e8-8843-b3877afa23c6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:41.425565 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-df2f7f97-b3bd-48e8-8843-b3877afa23c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:41.446453 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b23bb-7376-43a8-a3d1-d92255475305 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:41.495695 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:41.515469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f7f97-b3bd-48e8-8843-b3877afa23c6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:41.516670 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac29ff-84b5-4fc2-b089-0ced53ae0576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:41.517273 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac29ff-84b5-4fc2-b089-0ced53ae0576 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:41.517551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac29ff-84b5-4fc2-b089-0ced53ae0576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:41.517821 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac29ff-84b5-4fc2-b089-0ced53ae0576 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:41.518826 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac29ff-84b5-4fc2-b089-0ced53ae0576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:41.521372 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac29ff-84b5-4fc2-b089-0ced53ae0576 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:41.526788 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585676e4-f143-48ad-8bb1-666a788038bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:41.528081 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585676e4-f143-48ad-8bb1-666a788038bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:41.528439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585676e4-f143-48ad-8bb1-666a788038bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:41.528806 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585676e4-f143-48ad-8bb1-666a788038bb admin admin] PATH_INFO: `/v3/users/35428512cc75470094ad377f06cf44c3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:41.530091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585676e4-f143-48ad-8bb1-666a788038bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=35428512cc75470094ad377f06cf44c3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:41.532489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585676e4-f143-48ad-8bb1-666a788038bb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:41.544970 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 895/1775] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:41 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:41.548514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac29ff-84b5-4fc2-b089-0ced53ae0576 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:41.550355 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f1ac29ff-84b5-4fc2-b089-0ced53ae0576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:41.563630 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac29ff-84b5-4fc2-b089-0ced53ae0576 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:41.568891 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c5ed3-b75b-439e-b8ee-bb6c32596f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:41.569610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c5ed3-b75b-439e-b8ee-bb6c32596f4b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:41.569920 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c5ed3-b75b-439e-b8ee-bb6c32596f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:41.571161 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c5ed3-b75b-439e-b8ee-bb6c32596f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:41.571161 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c5ed3-b75b-439e-b8ee-bb6c32596f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:41.572720 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c5ed3-b75b-439e-b8ee-bb6c32596f4b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:41.583956 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 896/1776] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:25:41.587557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c5ed3-b75b-439e-b8ee-bb6c32596f4b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:41.594028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-585676e4-f143-48ad-8bb1-666a788038bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35428512cc75470094ad377f06cf44c3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:41.594816 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-585676e4-f143-48ad-8bb1-666a788038bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35428512cc75470094ad377f06cf44c3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:41.599183 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c5ed3-b75b-439e-b8ee-bb6c32596f4b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:41.603866 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-585676e4-f143-48ad-8bb1-666a788038bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35428512cc75470094ad377f06cf44c3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:41.604635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-585676e4-f143-48ad-8bb1-666a788038bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35428512cc75470094ad377f06cf44c3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:41.608366 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b5456-33e8-47b6-8803-c12cfcd444aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:41.609170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b5456-33e8-47b6-8803-c12cfcd444aa admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:41.609525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b5456-33e8-47b6-8803-c12cfcd444aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:41.609872 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b5456-33e8-47b6-8803-c12cfcd444aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:41.610672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b5456-33e8-47b6-8803-c12cfcd444aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:41.612208 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-585676e4-f143-48ad-8bb1-666a788038bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35428512cc75470094ad377f06cf44c3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:41.625353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b5456-33e8-47b6-8803-c12cfcd444aa admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:41.628572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:41.633982 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 881/1777] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:41 2022] DELETE /identity/v3/users/35428512cc75470094ad377f06cf44c3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:41.646404 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585676e4-f143-48ad-8bb1-666a788038bb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:41.648078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-585676e4-f143-48ad-8bb1-666a788038bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:41.650172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 897/1778] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:25:41.740488 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585676e4-f143-48ad-8bb1-666a788038bb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:41.746452 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e73b7-46b6-4744-be56-4490ce809118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:41.747351 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e73b7-46b6-4744-be56-4490ce809118 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:41.747624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e73b7-46b6-4744-be56-4490ce809118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:41.748201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e73b7-46b6-4744-be56-4490ce809118 admin admin] PATH_INFO: `/v3/projects/5c3a8cb55f5d4712bd224b9b36cd355a/users/aa27417f5f734a3b8c88add45449473e/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:41.767742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e73b7-46b6-4744-be56-4490ce809118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3a8cb55f5d4712bd224b9b36cd355a, user_id=aa27417f5f734a3b8c88add45449473e, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:41.770536 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e73b7-46b6-4744-be56-4490ce809118 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:41.791623 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 882/1779] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:41 2022] PUT /identity/v3/projects/5c3a8cb55f5d4712bd224b9b36cd355a/users/aa27417f5f734a3b8c88add45449473e/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:41.802726 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86bc5-95df-4bc7-b0cf-eb674d96fab3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:41.803017 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86bc5-95df-4bc7-b0cf-eb674d96fab3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:41.803223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86bc5-95df-4bc7-b0cf-eb674d96fab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:41.836117 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a8c86bc5-95df-4bc7-b0cf-eb674d96fab3 None None] MFA Rules not processed for user `aa27417f5f734a3b8c88add45449473e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:41.837396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a8c86bc5-95df-4bc7-b0cf-eb674d96fab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:41.974835 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 898/1780] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:25:41.979097 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e73b7-46b6-4744-be56-4490ce809118 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:42.052335 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c86bc5-95df-4bc7-b0cf-eb674d96fab3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:42.054048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a8c86bc5-95df-4bc7-b0cf-eb674d96fab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:42.112256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:42.142296 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e73b7-46b6-4744-be56-4490ce809118 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:42.154215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51c606-ad83-4049-adf7-0d4ed55ac582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:42.156309 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51c606-ad83-4049-adf7-0d4ed55ac582 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:42.157459 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51c606-ad83-4049-adf7-0d4ed55ac582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:42.157901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51c606-ad83-4049-adf7-0d4ed55ac582 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:42.159368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51c606-ad83-4049-adf7-0d4ed55ac582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:42.161730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51c606-ad83-4049-adf7-0d4ed55ac582 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:42.199398 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c86bc5-95df-4bc7-b0cf-eb674d96fab3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:42.208917 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945dd0b6-176c-4825-9420-2d6bd0b86548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:42.210212 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dd0b6-176c-4825-9420-2d6bd0b86548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:42.210212 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dd0b6-176c-4825-9420-2d6bd0b86548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:42.210403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dd0b6-176c-4825-9420-2d6bd0b86548 admin admin] PATH_INFO: `/v3/projects/b6773d83b8114dfa80394cb17609bdd8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:42.212115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945dd0b6-176c-4825-9420-2d6bd0b86548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6773d83b8114dfa80394cb17609bdd8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:42.214703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945dd0b6-176c-4825-9420-2d6bd0b86548 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:42.219764 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 883/1781] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:41 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:42.220861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51c606-ad83-4049-adf7-0d4ed55ac582 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:42.276371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-945dd0b6-176c-4825-9420-2d6bd0b86548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6773d83b8114dfa80394cb17609bdd8', 'request_id': 'req-945dd0b6-176c-4825-9420-2d6bd0b86548'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:42.285509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-945dd0b6-176c-4825-9420-2d6bd0b86548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6773d83b8114dfa80394cb17609bdd8', 'request_id': 'req-945dd0b6-176c-4825-9420-2d6bd0b86548'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:42.293734 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-945dd0b6-176c-4825-9420-2d6bd0b86548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6773d83b8114dfa80394cb17609bdd8', 'request_id': 'req-945dd0b6-176c-4825-9420-2d6bd0b86548'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:42.297138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51c606-ad83-4049-adf7-0d4ed55ac582 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:42.305907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-945dd0b6-176c-4825-9420-2d6bd0b86548 admin admin] The token cache is being invalidate because project b6773d83b8114dfa80394cb17609bdd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:42.306162 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-945dd0b6-176c-4825-9420-2d6bd0b86548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:42.306833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-945dd0b6-176c-4825-9420-2d6bd0b86548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:42.309086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 899/1782] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:42 2022] DELETE /identity/v3/projects/b6773d83b8114dfa80394cb17609bdd8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:42.314976 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4f7d4-3a68-4275-b25b-739ba59f2066 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:42.315265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4f7d4-3a68-4275-b25b-739ba59f2066 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:42.315552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4f7d4-3a68-4275-b25b-739ba59f2066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:42.360036 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-35c4f7d4-3a68-4275-b25b-739ba59f2066 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:42.362842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-35c4f7d4-3a68-4275-b25b-739ba59f2066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:42.376158 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:42.379615 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d74d7b-c041-477a-94e2-e2c3e16b66a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:42.380432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d74d7b-c041-477a-94e2-e2c3e16b66a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:42.380813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d74d7b-c041-477a-94e2-e2c3e16b66a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:42.381186 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d74d7b-c041-477a-94e2-e2c3e16b66a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:42.381935 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d74d7b-c041-477a-94e2-e2c3e16b66a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:42.384917 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d74d7b-c041-477a-94e2-e2c3e16b66a8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:42.413674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 884/1783] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:42 2022] POST /identity/v3/users => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:42.414622 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d74d7b-c041-477a-94e2-e2c3e16b66a8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:42.418928 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-48d74d7b-c041-477a-94e2-e2c3e16b66a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:42.433475 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d74d7b-c041-477a-94e2-e2c3e16b66a8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:42.438509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a071a72-21f3-4e50-a59f-e7e5b5c7f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:42.439136 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071a72-21f3-4e50-a59f-e7e5b5c7f2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:42.439419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071a72-21f3-4e50-a59f-e7e5b5c7f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:42.439691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071a72-21f3-4e50-a59f-e7e5b5c7f2d4 admin admin] PATH_INFO: `/v3/users/f5988b8fdd714ac0aa76be7340bce7d3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:42.440850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a071a72-21f3-4e50-a59f-e7e5b5c7f2d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5988b8fdd714ac0aa76be7340bce7d3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:42.444015 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a071a72-21f3-4e50-a59f-e7e5b5c7f2d4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:42.444836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 900/1784] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:42.445274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4f7d4-3a68-4275-b25b-739ba59f2066 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:42.446570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-35c4f7d4-3a68-4275-b25b-739ba59f2066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:42.459872 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4f7d4-3a68-4275-b25b-739ba59f2066 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:42.465932 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be812f5-15de-4429-8d1c-850d9bb0897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:42.466565 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be812f5-15de-4429-8d1c-850d9bb0897e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:42.466832 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be812f5-15de-4429-8d1c-850d9bb0897e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:42.467210 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be812f5-15de-4429-8d1c-850d9bb0897e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:42.467885 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be812f5-15de-4429-8d1c-850d9bb0897e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:42.469526 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be812f5-15de-4429-8d1c-850d9bb0897e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:42.484595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 901/1785] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:42.484595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8ff38-9b16-4d9e-923e-bc5f53e4abcb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:42.484595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8ff38-9b16-4d9e-923e-bc5f53e4abcb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:42.484595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8ff38-9b16-4d9e-923e-bc5f53e4abcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:42.506109 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e8e8ff38-9b16-4d9e-923e-bc5f53e4abcb None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:42.507403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e8e8ff38-9b16-4d9e-923e-bc5f53e4abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:42.514450 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7a071a72-21f3-4e50-a59f-e7e5b5c7f2d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5988b8fdd714ac0aa76be7340bce7d3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:42.515205 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7a071a72-21f3-4e50-a59f-e7e5b5c7f2d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5988b8fdd714ac0aa76be7340bce7d3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:42.515628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 902/1786] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:42.519406 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8ff38-9b16-4d9e-923e-bc5f53e4abcb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:42.523141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7a071a72-21f3-4e50-a59f-e7e5b5c7f2d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5988b8fdd714ac0aa76be7340bce7d3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:42.523865 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7a071a72-21f3-4e50-a59f-e7e5b5c7f2d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5988b8fdd714ac0aa76be7340bce7d3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:42.530464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8ff38-9b16-4d9e-923e-bc5f53e4abcb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:42.532363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7a071a72-21f3-4e50-a59f-e7e5b5c7f2d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5988b8fdd714ac0aa76be7340bce7d3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:42.536700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4abdc-6add-486c-a284-d883f7ca72bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:42.537528 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4abdc-6add-486c-a284-d883f7ca72bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:42.537814 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4abdc-6add-486c-a284-d883f7ca72bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:42.538093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4abdc-6add-486c-a284-d883f7ca72bd admin admin] PATH_INFO: `/v3/projects/a8c549807a5c4f0e831224cc66c87ac5/users/7c83e9d9d53b40bf8f0cf428ea7aaee6/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:42.538906 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:42.557135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 885/1787] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:42 2022] DELETE /identity/v3/users/f5988b8fdd714ac0aa76be7340bce7d3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:42.557526 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4abdc-6add-486c-a284-d883f7ca72bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c549807a5c4f0e831224cc66c87ac5, user_id=7c83e9d9d53b40bf8f0cf428ea7aaee6, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:42.558306 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a071a72-21f3-4e50-a59f-e7e5b5c7f2d4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:42.560259 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7a071a72-21f3-4e50-a59f-e7e5b5c7f2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:42.560631 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4abdc-6add-486c-a284-d883f7ca72bd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:42.578001 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 903/1788] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:42 2022] PUT /identity/v3/projects/a8c549807a5c4f0e831224cc66c87ac5/users/7c83e9d9d53b40bf8f0cf428ea7aaee6/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:42.579455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d43c3-0008-4662-b940-78a21e367c74 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:42.579842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d43c3-0008-4662-b940-78a21e367c74 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:42.580644 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d43c3-0008-4662-b940-78a21e367c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:42.601071 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f37d43c3-0008-4662-b940-78a21e367c74 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:42.602981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f37d43c3-0008-4662-b940-78a21e367c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:42.636538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a071a72-21f3-4e50-a59f-e7e5b5c7f2d4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:42.676014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 904/1789] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:42.676014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d43c3-0008-4662-b940-78a21e367c74 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:42.676014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f37d43c3-0008-4662-b940-78a21e367c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:42.689807 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d43c3-0008-4662-b940-78a21e367c74 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:42.697025 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25838d9a-053d-47ae-a94c-97d4578620ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:42.697025 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25838d9a-053d-47ae-a94c-97d4578620ae admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:42.697381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25838d9a-053d-47ae-a94c-97d4578620ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:42.697563 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25838d9a-053d-47ae-a94c-97d4578620ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:42.698207 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25838d9a-053d-47ae-a94c-97d4578620ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:42.700108 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25838d9a-053d-47ae-a94c-97d4578620ae admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:42.711874 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 905/1790] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:42.712556 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25838d9a-053d-47ae-a94c-97d4578620ae admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:42.714343 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-25838d9a-053d-47ae-a94c-97d4578620ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:42.739214 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d38a8-b531-4526-b76c-bfaae29bb02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:42.741060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d38a8-b531-4526-b76c-bfaae29bb02b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:42.741555 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d38a8-b531-4526-b76c-bfaae29bb02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:42.742059 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d38a8-b531-4526-b76c-bfaae29bb02b admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:42.743298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d38a8-b531-4526-b76c-bfaae29bb02b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:42.743833 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d38a8-b531-4526-b76c-bfaae29bb02b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:42.745670 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d38a8-b531-4526-b76c-bfaae29bb02b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:42.764585 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 886/1791] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:25:42.765941 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d38a8-b531-4526-b76c-bfaae29bb02b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:42.780063 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d38a8-b531-4526-b76c-bfaae29bb02b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:42.787971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25838d9a-053d-47ae-a94c-97d4578620ae admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:42.791524 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a27dff-128f-411d-9c00-53a10448d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:42.792567 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a27dff-128f-411d-9c00-53a10448d8df admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:42.793124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a27dff-128f-411d-9c00-53a10448d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:42.793680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a27dff-128f-411d-9c00-53a10448d8df admin admin] PATH_INFO: `/v3/projects/a8c549807a5c4f0e831224cc66c87ac5/users/7c83e9d9d53b40bf8f0cf428ea7aaee6/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:42.795905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a27dff-128f-411d-9c00-53a10448d8df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c549807a5c4f0e831224cc66c87ac5, user_id=7c83e9d9d53b40bf8f0cf428ea7aaee6, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:42.797289 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d61b4e-cd98-45bb-b83e-fbe4d5d18663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:42.798212 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d61b4e-cd98-45bb-b83e-fbe4d5d18663 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:42.798509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d61b4e-cd98-45bb-b83e-fbe4d5d18663 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:42.798785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d61b4e-cd98-45bb-b83e-fbe4d5d18663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:42.800076 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a27dff-128f-411d-9c00-53a10448d8df admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:42.811093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d61b4e-cd98-45bb-b83e-fbe4d5d18663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:42.812571 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d61b4e-cd98-45bb-b83e-fbe4d5d18663 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:42.820953 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 887/1792] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:42 2022] PUT /identity/v3/projects/a8c549807a5c4f0e831224cc66c87ac5/users/7c83e9d9d53b40bf8f0cf428ea7aaee6/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:42.823292 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a27dff-128f-411d-9c00-53a10448d8df admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:42.834301 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 906/1793] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:42.835463 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57bc0d-87f5-4001-9bb0-90d70dd935cc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:42.835965 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57bc0d-87f5-4001-9bb0-90d70dd935cc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:42.836077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57bc0d-87f5-4001-9bb0-90d70dd935cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:42.864119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:42.877828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cf57bc0d-87f5-4001-9bb0-90d70dd935cc None None] MFA Rules not processed for user `7c83e9d9d53b40bf8f0cf428ea7aaee6`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:42.880448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cf57bc0d-87f5-4001-9bb0-90d70dd935cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:42.918617 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a27dff-128f-411d-9c00-53a10448d8df admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:42.927634 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160b143-735e-4862-814c-a4e1f117309c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:42.928566 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160b143-735e-4862-814c-a4e1f117309c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:42.928979 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160b143-735e-4862-814c-a4e1f117309c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:42.929392 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160b143-735e-4862-814c-a4e1f117309c admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:42.932653 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160b143-735e-4862-814c-a4e1f117309c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:42.935691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160b143-735e-4862-814c-a4e1f117309c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:42.965540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:42.979321 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 888/1794] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:42 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:42.983513 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160b143-735e-4862-814c-a4e1f117309c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:43.040321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 907/1795] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:43.061445 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57bc0d-87f5-4001-9bb0-90d70dd935cc None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:43.062893 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cf57bc0d-87f5-4001-9bb0-90d70dd935cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:43.141390 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160b143-735e-4862-814c-a4e1f117309c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:43.151571 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b1ae8-09b1-434d-80b7-acab27fd3cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:43.152404 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b1ae8-09b1-434d-80b7-acab27fd3cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:43.153024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b1ae8-09b1-434d-80b7-acab27fd3cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:43.153448 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b1ae8-09b1-434d-80b7-acab27fd3cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:43.154326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b1ae8-09b1-434d-80b7-acab27fd3cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:43.157359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b1ae8-09b1-434d-80b7-acab27fd3cb8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:43.167443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57bc0d-87f5-4001-9bb0-90d70dd935cc None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:43.207919 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 889/1796] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:42 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:43.212210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b1ae8-09b1-434d-80b7-acab27fd3cb8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:43.224182 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b1ae8-09b1-434d-80b7-acab27fd3cb8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:43.230141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6a63a-15d1-4101-a367-17cd28d80e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:43.231092 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a63a-15d1-4101-a367-17cd28d80e91 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:43.231537 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a63a-15d1-4101-a367-17cd28d80e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:43.232091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a63a-15d1-4101-a367-17cd28d80e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:43.236256 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d424b-ab2a-425e-909c-a5fbd177aa9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:43.236881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d424b-ab2a-425e-909c-a5fbd177aa9b service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:43.237159 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d424b-ab2a-425e-909c-a5fbd177aa9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:43.237433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d424b-ab2a-425e-909c-a5fbd177aa9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:43.237543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6a63a-15d1-4101-a367-17cd28d80e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:43.239784 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b87d424b-ab2a-425e-909c-a5fbd177aa9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:43.240741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6a63a-15d1-4101-a367-17cd28d80e91 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:43.257270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 890/1797] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:25:43.263179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6a63a-15d1-4101-a367-17cd28d80e91 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:43.283463 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6a63a-15d1-4101-a367-17cd28d80e91 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:43.298134 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f79bd-695c-41fb-a392-2891b2b98bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:43.298824 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f79bd-695c-41fb-a392-2891b2b98bbb admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:43.299174 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f79bd-695c-41fb-a392-2891b2b98bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:43.299538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f79bd-695c-41fb-a392-2891b2b98bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:43.300369 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f79bd-695c-41fb-a392-2891b2b98bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:43.302749 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f79bd-695c-41fb-a392-2891b2b98bbb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:43.318176 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 891/1798] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:43.319101 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f79bd-695c-41fb-a392-2891b2b98bbb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:43.320990 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-961f79bd-695c-41fb-a392-2891b2b98bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:43.334403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f79bd-695c-41fb-a392-2891b2b98bbb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:43.341950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d424b-ab2a-425e-909c-a5fbd177aa9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:43.343614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7e6ef-768c-4612-93f0-ec76c4a7efce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:43.344306 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7e6ef-768c-4612-93f0-ec76c4a7efce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:43.344589 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7e6ef-768c-4612-93f0-ec76c4a7efce admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:43.344868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7e6ef-768c-4612-93f0-ec76c4a7efce admin admin] PATH_INFO: `/v3/projects/d4fdec44e7a1432c8bf9a0bb17f82abc` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:43.345397 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d424b-ab2a-425e-909c-a5fbd177aa9b service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:43.346173 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7e6ef-768c-4612-93f0-ec76c4a7efce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4fdec44e7a1432c8bf9a0bb17f82abc)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:43.348391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7e6ef-768c-4612-93f0-ec76c4a7efce admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:43.367960 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 908/1799] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:43.369476 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d424b-ab2a-425e-909c-a5fbd177aa9b service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:43.375799 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:43.384067 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d424b-ab2a-425e-909c-a5fbd177aa9b service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:43.390284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87172bb8-316a-4a53-aa68-a46b5e66888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:43.390981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87172bb8-316a-4a53-aa68-a46b5e66888a admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:43.392245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87172bb8-316a-4a53-aa68-a46b5e66888a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:43.392678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87172bb8-316a-4a53-aa68-a46b5e66888a admin admin] PATH_INFO: `/v3/projects/d3891cbf854f4c6a99645891eabcdcb7/users/67d141fec55e4539b2aab9634551b477/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:43.422446 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87172bb8-316a-4a53-aa68-a46b5e66888a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3891cbf854f4c6a99645891eabcdcb7, user_id=67d141fec55e4539b2aab9634551b477, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:43.426482 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87172bb8-316a-4a53-aa68-a46b5e66888a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:43.447358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bde7e6ef-768c-4612-93f0-ec76c4a7efce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4fdec44e7a1432c8bf9a0bb17f82abc', 'request_id': 'req-bde7e6ef-768c-4612-93f0-ec76c4a7efce'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:43.474123 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 909/1800] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:43 2022] PUT /identity/v3/projects/d3891cbf854f4c6a99645891eabcdcb7/users/67d141fec55e4539b2aab9634551b477/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:43.475080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bde7e6ef-768c-4612-93f0-ec76c4a7efce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4fdec44e7a1432c8bf9a0bb17f82abc', 'request_id': 'req-bde7e6ef-768c-4612-93f0-ec76c4a7efce'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:43.492220 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78670e3-3d92-453d-91aa-e0bd691cce3a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:43.492520 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78670e3-3d92-453d-91aa-e0bd691cce3a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:43.492793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78670e3-3d92-453d-91aa-e0bd691cce3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:43.493799 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bde7e6ef-768c-4612-93f0-ec76c4a7efce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4fdec44e7a1432c8bf9a0bb17f82abc', 'request_id': 'req-bde7e6ef-768c-4612-93f0-ec76c4a7efce'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:43.523714 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bde7e6ef-768c-4612-93f0-ec76c4a7efce admin admin] The token cache is being invalidate because project d4fdec44e7a1432c8bf9a0bb17f82abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:43.524320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bde7e6ef-768c-4612-93f0-ec76c4a7efce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:43.527969 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bde7e6ef-768c-4612-93f0-ec76c4a7efce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:43.531443 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 892/1801] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:43 2022] DELETE /identity/v3/projects/d4fdec44e7a1432c8bf9a0bb17f82abc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:43.564102 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b78670e3-3d92-453d-91aa-e0bd691cce3a None None] MFA Rules not processed for user `67d141fec55e4539b2aab9634551b477`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:43.565484 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b78670e3-3d92-453d-91aa-e0bd691cce3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:43.779499 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 910/1802] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:43.795143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7e6ef-768c-4612-93f0-ec76c4a7efce admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:43.797820 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bde7e6ef-768c-4612-93f0-ec76c4a7efce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:43.877974 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:43.884246 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7e6ef-768c-4612-93f0-ec76c4a7efce admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:43.958594 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8513b-28ca-48a4-b4de-bb6e86881d03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:43.960079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8513b-28ca-48a4-b4de-bb6e86881d03 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:43.960079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8513b-28ca-48a4-b4de-bb6e86881d03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:43.960403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8513b-28ca-48a4-b4de-bb6e86881d03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:43.971014 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8513b-28ca-48a4-b4de-bb6e86881d03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:43.972733 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8513b-28ca-48a4-b4de-bb6e86881d03 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:43.996344 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 893/1803] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:45.248185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78670e3-3d92-453d-91aa-e0bd691cce3a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:45.258340 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78670e3-3d92-453d-91aa-e0bd691cce3a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:45.261926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9551c-5cfa-4055-98ff-c90644f67b93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:45.262526 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9551c-5cfa-4055-98ff-c90644f67b93 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:45.262806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9551c-5cfa-4055-98ff-c90644f67b93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:45.263083 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9551c-5cfa-4055-98ff-c90644f67b93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:45.264846 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1bd9551c-5cfa-4055-98ff-c90644f67b93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:45.322925 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9551c-5cfa-4055-98ff-c90644f67b93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:45.324666 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9551c-5cfa-4055-98ff-c90644f67b93 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:45.333378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 911/1804] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:46.081613 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8513b-28ca-48a4-b4de-bb6e86881d03 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:46.083341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d6c8513b-28ca-48a4-b4de-bb6e86881d03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:46.097931 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8513b-28ca-48a4-b4de-bb6e86881d03 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:46.121148 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e493b2-8c25-415f-b72e-c353136a99ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:46.121792 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e493b2-8c25-415f-b72e-c353136a99ff service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:46.122074 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e493b2-8c25-415f-b72e-c353136a99ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:46.122395 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e493b2-8c25-415f-b72e-c353136a99ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:46.125616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a8e493b2-8c25-415f-b72e-c353136a99ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:46.229832 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e493b2-8c25-415f-b72e-c353136a99ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:46.231376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e493b2-8c25-415f-b72e-c353136a99ff service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:46.247428 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 894/1805] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:50.308945 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9551c-5cfa-4055-98ff-c90644f67b93 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:50.310539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1bd9551c-5cfa-4055-98ff-c90644f67b93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:50.398908 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9551c-5cfa-4055-98ff-c90644f67b93 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:50.404736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965e81a-df4a-4305-ad60-00afa2141e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:50.405854 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965e81a-df4a-4305-ad60-00afa2141e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:50.406353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965e81a-df4a-4305-ad60-00afa2141e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:50.406797 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965e81a-df4a-4305-ad60-00afa2141e7c admin admin] PATH_INFO: `/v3/users/e40d2326ee63400fb4ae845c16701636` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:50.408527 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965e81a-df4a-4305-ad60-00afa2141e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e40d2326ee63400fb4ae845c16701636)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:50.411289 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965e81a-df4a-4305-ad60-00afa2141e7c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:50.427660 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:50.502841 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7965e81a-df4a-4305-ad60-00afa2141e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e40d2326ee63400fb4ae845c16701636'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:50.503640 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7965e81a-df4a-4305-ad60-00afa2141e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e40d2326ee63400fb4ae845c16701636'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:50.516030 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7965e81a-df4a-4305-ad60-00afa2141e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e40d2326ee63400fb4ae845c16701636'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:50.517081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7965e81a-df4a-4305-ad60-00afa2141e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e40d2326ee63400fb4ae845c16701636'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:50.556321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7965e81a-df4a-4305-ad60-00afa2141e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e40d2326ee63400fb4ae845c16701636'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:50.601634 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 912/1806] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:50 2022] DELETE /identity/v3/users/e40d2326ee63400fb4ae845c16701636 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:50.604039 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba95ec8-5fe9-4520-812c-39911d746c70 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:50.604511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba95ec8-5fe9-4520-812c-39911d746c70 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:50.604591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba95ec8-5fe9-4520-812c-39911d746c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:50.649442 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0ba95ec8-5fe9-4520-812c-39911d746c70 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:50.651372 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0ba95ec8-5fe9-4520-812c-39911d746c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:50.751873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 895/1807] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:50.764028 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965e81a-df4a-4305-ad60-00afa2141e7c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:50.765486 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7965e81a-df4a-4305-ad60-00afa2141e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:50.835514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965e81a-df4a-4305-ad60-00afa2141e7c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:50.839255 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a93109-c34e-4d05-bfdd-ba4557b43f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:50.839870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a93109-c34e-4d05-bfdd-ba4557b43f0c service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:50.840195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a93109-c34e-4d05-bfdd-ba4557b43f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:50.840496 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a93109-c34e-4d05-bfdd-ba4557b43f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:50.849938 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a93109-c34e-4d05-bfdd-ba4557b43f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:50.851393 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a93109-c34e-4d05-bfdd-ba4557b43f0c service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:50.862133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 913/1808] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:25:51.222039 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba95ec8-5fe9-4520-812c-39911d746c70 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:51.224037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0ba95ec8-5fe9-4520-812c-39911d746c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:51.236735 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba95ec8-5fe9-4520-812c-39911d746c70 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:51.242245 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7d353-710b-459a-959c-59b49872536d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:51.242812 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7d353-710b-459a-959c-59b49872536d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:51.243684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7d353-710b-459a-959c-59b49872536d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:51.243983 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7d353-710b-459a-959c-59b49872536d admin admin] PATH_INFO: `/v3/projects/ec2873b91318480c8dfa0db25f02a8e1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:51.245506 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7d353-710b-459a-959c-59b49872536d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec2873b91318480c8dfa0db25f02a8e1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:51.247336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7d353-710b-459a-959c-59b49872536d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:51.286094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:51.295848 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-94e7d353-710b-459a-959c-59b49872536d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec2873b91318480c8dfa0db25f02a8e1', 'request_id': 'req-94e7d353-710b-459a-959c-59b49872536d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:51.303153 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-94e7d353-710b-459a-959c-59b49872536d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec2873b91318480c8dfa0db25f02a8e1', 'request_id': 'req-94e7d353-710b-459a-959c-59b49872536d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:51.310956 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-94e7d353-710b-459a-959c-59b49872536d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec2873b91318480c8dfa0db25f02a8e1', 'request_id': 'req-94e7d353-710b-459a-959c-59b49872536d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:51.321541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-94e7d353-710b-459a-959c-59b49872536d admin admin] The token cache is being invalidate because project ec2873b91318480c8dfa0db25f02a8e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:51.321826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-94e7d353-710b-459a-959c-59b49872536d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:51.322452 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-94e7d353-710b-459a-959c-59b49872536d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:51.323917 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 896/1809] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:51 2022] DELETE /identity/v3/projects/ec2873b91318480c8dfa0db25f02a8e1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:51.327989 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a93109-c34e-4d05-bfdd-ba4557b43f0c service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:51.338053 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a93109-c34e-4d05-bfdd-ba4557b43f0c service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:51.394735 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6747224-1784-41c3-b1cc-e670d8ff0ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:51.395375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747224-1784-41c3-b1cc-e670d8ff0ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:51.395652 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747224-1784-41c3-b1cc-e670d8ff0ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:51.395940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747224-1784-41c3-b1cc-e670d8ff0ee3 admin admin] PATH_INFO: `/v3/users/aa27417f5f734a3b8c88add45449473e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:51.397084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6747224-1784-41c3-b1cc-e670d8ff0ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa27417f5f734a3b8c88add45449473e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:51.399009 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6747224-1784-41c3-b1cc-e670d8ff0ee3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:51.434173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:51.449186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f6747224-1784-41c3-b1cc-e670d8ff0ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa27417f5f734a3b8c88add45449473e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:51.449965 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f6747224-1784-41c3-b1cc-e670d8ff0ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa27417f5f734a3b8c88add45449473e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:51.457371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f6747224-1784-41c3-b1cc-e670d8ff0ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa27417f5f734a3b8c88add45449473e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:51.457989 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f6747224-1784-41c3-b1cc-e670d8ff0ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa27417f5f734a3b8c88add45449473e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:51.465205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f6747224-1784-41c3-b1cc-e670d8ff0ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa27417f5f734a3b8c88add45449473e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:51.482862 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 914/1810] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:51 2022] DELETE /identity/v3/users/aa27417f5f734a3b8c88add45449473e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:51.758854 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7d353-710b-459a-959c-59b49872536d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:51.760427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-94e7d353-710b-459a-959c-59b49872536d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:51.774891 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7d353-710b-459a-959c-59b49872536d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:51.840654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979df23e-3f61-4f2e-918d-473be9750a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:51.841289 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979df23e-3f61-4f2e-918d-473be9750a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:51.841762 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979df23e-3f61-4f2e-918d-473be9750a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:51.842040 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979df23e-3f61-4f2e-918d-473be9750a9a admin admin] PATH_INFO: `/v3/projects/5c3a8cb55f5d4712bd224b9b36cd355a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:51.843183 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979df23e-3f61-4f2e-918d-473be9750a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c3a8cb55f5d4712bd224b9b36cd355a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:51.845154 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979df23e-3f61-4f2e-918d-473be9750a9a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:51.909586 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-979df23e-3f61-4f2e-918d-473be9750a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c3a8cb55f5d4712bd224b9b36cd355a', 'request_id': 'req-979df23e-3f61-4f2e-918d-473be9750a9a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:51.917436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-979df23e-3f61-4f2e-918d-473be9750a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c3a8cb55f5d4712bd224b9b36cd355a', 'request_id': 'req-979df23e-3f61-4f2e-918d-473be9750a9a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:51.923873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-979df23e-3f61-4f2e-918d-473be9750a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c3a8cb55f5d4712bd224b9b36cd355a', 'request_id': 'req-979df23e-3f61-4f2e-918d-473be9750a9a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:51.937040 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-979df23e-3f61-4f2e-918d-473be9750a9a admin admin] The token cache is being invalidate because project 5c3a8cb55f5d4712bd224b9b36cd355a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:51.937327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-979df23e-3f61-4f2e-918d-473be9750a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:51.938015 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-979df23e-3f61-4f2e-918d-473be9750a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:51.939562 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 897/1811] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:51 2022] DELETE /identity/v3/projects/5c3a8cb55f5d4712bd224b9b36cd355a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:51.943611 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6747224-1784-41c3-b1cc-e670d8ff0ee3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:51.945123 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f6747224-1784-41c3-b1cc-e670d8ff0ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:51.957849 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6747224-1784-41c3-b1cc-e670d8ff0ee3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:52.018068 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6f470-f90a-4baa-a1cb-9fba90c30138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:52.018715 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6f470-f90a-4baa-a1cb-9fba90c30138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:52.019016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6f470-f90a-4baa-a1cb-9fba90c30138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:52.019849 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6f470-f90a-4baa-a1cb-9fba90c30138 admin admin] PATH_INFO: `/v3/users/7c83e9d9d53b40bf8f0cf428ea7aaee6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:52.021004 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6f470-f90a-4baa-a1cb-9fba90c30138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c83e9d9d53b40bf8f0cf428ea7aaee6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:52.022914 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6f470-f90a-4baa-a1cb-9fba90c30138 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:52.073833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d8e6f470-f90a-4baa-a1cb-9fba90c30138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c83e9d9d53b40bf8f0cf428ea7aaee6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:52.073941 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d8e6f470-f90a-4baa-a1cb-9fba90c30138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c83e9d9d53b40bf8f0cf428ea7aaee6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:52.081028 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d8e6f470-f90a-4baa-a1cb-9fba90c30138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c83e9d9d53b40bf8f0cf428ea7aaee6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:52.082643 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d8e6f470-f90a-4baa-a1cb-9fba90c30138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c83e9d9d53b40bf8f0cf428ea7aaee6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:52.094123 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d8e6f470-f90a-4baa-a1cb-9fba90c30138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c83e9d9d53b40bf8f0cf428ea7aaee6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:52.113538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 915/1812] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:51 2022] DELETE /identity/v3/users/7c83e9d9d53b40bf8f0cf428ea7aaee6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:52.412067 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979df23e-3f61-4f2e-918d-473be9750a9a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:52.413699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-979df23e-3f61-4f2e-918d-473be9750a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:52.427561 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979df23e-3f61-4f2e-918d-473be9750a9a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:52.478095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:52.485832 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63620c-b88d-40df-89dc-48207882d645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:52.486500 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63620c-b88d-40df-89dc-48207882d645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:52.487133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63620c-b88d-40df-89dc-48207882d645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:52.487523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63620c-b88d-40df-89dc-48207882d645 admin admin] PATH_INFO: `/v3/projects/a8c549807a5c4f0e831224cc66c87ac5` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:52.488975 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63620c-b88d-40df-89dc-48207882d645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c549807a5c4f0e831224cc66c87ac5)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:52.491734 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63620c-b88d-40df-89dc-48207882d645 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:52.537543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce63620c-b88d-40df-89dc-48207882d645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c549807a5c4f0e831224cc66c87ac5', 'request_id': 'req-ce63620c-b88d-40df-89dc-48207882d645'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:52.545706 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce63620c-b88d-40df-89dc-48207882d645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c549807a5c4f0e831224cc66c87ac5', 'request_id': 'req-ce63620c-b88d-40df-89dc-48207882d645'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:52.552077 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce63620c-b88d-40df-89dc-48207882d645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c549807a5c4f0e831224cc66c87ac5', 'request_id': 'req-ce63620c-b88d-40df-89dc-48207882d645'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:52.562152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce63620c-b88d-40df-89dc-48207882d645 admin admin] The token cache is being invalidate because project a8c549807a5c4f0e831224cc66c87ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:52.562432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce63620c-b88d-40df-89dc-48207882d645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:52.563057 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce63620c-b88d-40df-89dc-48207882d645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:52.564546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 898/1813] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:52 2022] DELETE /identity/v3/projects/a8c549807a5c4f0e831224cc66c87ac5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:52.569841 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466865a7-cea5-4c3c-bd1c-aa093759a16a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:52.570258 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466865a7-cea5-4c3c-bd1c-aa093759a16a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:52.570422 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466865a7-cea5-4c3c-bd1c-aa093759a16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:52.590664 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-466865a7-cea5-4c3c-bd1c-aa093759a16a None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:52.591859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-466865a7-cea5-4c3c-bd1c-aa093759a16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:52.615085 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:52.651294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 916/1814] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:52.659055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312a8b2-b9ca-4d25-a8ff-3051ee975846 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:52.659339 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312a8b2-b9ca-4d25-a8ff-3051ee975846 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:52.659614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312a8b2-b9ca-4d25-a8ff-3051ee975846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:52.679011 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a312a8b2-b9ca-4d25-a8ff-3051ee975846 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:52.680228 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a312a8b2-b9ca-4d25-a8ff-3051ee975846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:52.688269 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 899/1815] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:52.692841 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466865a7-cea5-4c3c-bd1c-aa093759a16a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:52.702413 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466865a7-cea5-4c3c-bd1c-aa093759a16a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:52.707635 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa72453-8f29-4487-a433-9f86387d951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:52.708268 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa72453-8f29-4487-a433-9f86387d951a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:52.708546 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa72453-8f29-4487-a433-9f86387d951a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:52.708825 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa72453-8f29-4487-a433-9f86387d951a admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:52.709469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa72453-8f29-4487-a433-9f86387d951a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:52.709772 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa72453-8f29-4487-a433-9f86387d951a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:52.711361 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa72453-8f29-4487-a433-9f86387d951a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:52.722547 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 917/1816] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:25:52.726672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312a8b2-b9ca-4d25-a8ff-3051ee975846 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:52.735947 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312a8b2-b9ca-4d25-a8ff-3051ee975846 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:52.740915 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442c267-514f-4eb3-badc-e308ad118052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:52.741503 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442c267-514f-4eb3-badc-e308ad118052 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:52.741779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442c267-514f-4eb3-badc-e308ad118052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:52.742048 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442c267-514f-4eb3-badc-e308ad118052 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:52.742686 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442c267-514f-4eb3-badc-e308ad118052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:52.744634 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442c267-514f-4eb3-badc-e308ad118052 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:52.771997 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 900/1817] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:52 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:25:52.776117 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa72453-8f29-4487-a433-9f86387d951a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:52.787686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa72453-8f29-4487-a433-9f86387d951a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:52.842895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dc705-9757-4a29-b8bb-7732aa586192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:52.843503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dc705-9757-4a29-b8bb-7732aa586192 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:52.843787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dc705-9757-4a29-b8bb-7732aa586192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:52.844097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dc705-9757-4a29-b8bb-7732aa586192 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:52.844737 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dc705-9757-4a29-b8bb-7732aa586192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:52.846707 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dc705-9757-4a29-b8bb-7732aa586192 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:52.868153 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 918/1818] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:52 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:52.872301 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442c267-514f-4eb3-badc-e308ad118052 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:52.883818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442c267-514f-4eb3-badc-e308ad118052 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:52.888368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1fda0-218d-4b65-9081-46ec9702b841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:52.888959 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fda0-218d-4b65-9081-46ec9702b841 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:52.889235 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fda0-218d-4b65-9081-46ec9702b841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:52.889500 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fda0-218d-4b65-9081-46ec9702b841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:52.890131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1fda0-218d-4b65-9081-46ec9702b841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:52.891727 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1fda0-218d-4b65-9081-46ec9702b841 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:52.902448 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 901/1819] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:52.906026 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dc705-9757-4a29-b8bb-7732aa586192 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:52.917193 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dc705-9757-4a29-b8bb-7732aa586192 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:52.922027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e71aef-c3a0-4740-8569-d642e8035ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:52.922639 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e71aef-c3a0-4740-8569-d642e8035ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:52.922920 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e71aef-c3a0-4740-8569-d642e8035ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:52.923196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e71aef-c3a0-4740-8569-d642e8035ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:52.923848 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e71aef-c3a0-4740-8569-d642e8035ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:52.925477 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e71aef-c3a0-4740-8569-d642e8035ab6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:52.936557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 919/1820] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:52.940677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1fda0-218d-4b65-9081-46ec9702b841 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:52.951041 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1fda0-218d-4b65-9081-46ec9702b841 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:52.955696 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0958e0-23f8-4900-a362-35b120b603ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:52.956391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0958e0-23f8-4900-a362-35b120b603ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:52.956674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0958e0-23f8-4900-a362-35b120b603ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:52.956946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0958e0-23f8-4900-a362-35b120b603ae admin admin] PATH_INFO: `/v3/projects/54c54064e31344409640c9b7abcbd056/users/bf8313585bae4bc1bf00540487b0cbea/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:52.972168 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0958e0-23f8-4900-a362-35b120b603ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c54064e31344409640c9b7abcbd056, user_id=bf8313585bae4bc1bf00540487b0cbea, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:52.975688 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0958e0-23f8-4900-a362-35b120b603ae admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:52.990630 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 902/1821] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:52 2022] PUT /identity/v3/projects/54c54064e31344409640c9b7abcbd056/users/bf8313585bae4bc1bf00540487b0cbea/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:25:53.001015 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f37ba-800f-4233-b2b0-ce73dd88f8bc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:53.001305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f37ba-800f-4233-b2b0-ce73dd88f8bc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:53.001581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f37ba-800f-4233-b2b0-ce73dd88f8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:53.030535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4f5f37ba-800f-4233-b2b0-ce73dd88f8bc None None] MFA Rules not processed for user `bf8313585bae4bc1bf00540487b0cbea`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:53.031847 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4f5f37ba-800f-4233-b2b0-ce73dd88f8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:53.114092 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 920/1822] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:53.129093 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0958e0-23f8-4900-a362-35b120b603ae admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:53.134120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ed0958e0-23f8-4900-a362-35b120b603ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:53.211765 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0958e0-23f8-4900-a362-35b120b603ae admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:53.221797 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c3995-5aac-41f3-9787-115845b03e8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:53.223407 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c3995-5aac-41f3-9787-115845b03e8e service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:53.236262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c3995-5aac-41f3-9787-115845b03e8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:53.236550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c3995-5aac-41f3-9787-115845b03e8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:53.272185 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c3995-5aac-41f3-9787-115845b03e8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:53.273928 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c3995-5aac-41f3-9787-115845b03e8e service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:53.303014 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 903/1823] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:53.338202 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f37ba-800f-4233-b2b0-ce73dd88f8bc None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:53.405253 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:53.462726 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f37ba-800f-4233-b2b0-ce73dd88f8bc None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:53.467615 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b97cd-45f1-4803-a049-907669bcd256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:53.468287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b97cd-45f1-4803-a049-907669bcd256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:53.468576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b97cd-45f1-4803-a049-907669bcd256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:53.468851 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b97cd-45f1-4803-a049-907669bcd256 admin admin] PATH_INFO: `/v3/users/bf8313585bae4bc1bf00540487b0cbea` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:53.469992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b97cd-45f1-4803-a049-907669bcd256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8313585bae4bc1bf00540487b0cbea)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:53.471922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b97cd-45f1-4803-a049-907669bcd256 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:53.533343 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5a7b97cd-45f1-4803-a049-907669bcd256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8313585bae4bc1bf00540487b0cbea'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:53.534076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5a7b97cd-45f1-4803-a049-907669bcd256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8313585bae4bc1bf00540487b0cbea'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:53.543450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5a7b97cd-45f1-4803-a049-907669bcd256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8313585bae4bc1bf00540487b0cbea'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:53.544230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5a7b97cd-45f1-4803-a049-907669bcd256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8313585bae4bc1bf00540487b0cbea'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:53.554400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5a7b97cd-45f1-4803-a049-907669bcd256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8313585bae4bc1bf00540487b0cbea'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:53.578664 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 921/1824] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:53 2022] DELETE /identity/v3/users/bf8313585bae4bc1bf00540487b0cbea => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:53.582424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e2798-9a7e-4d38-845d-ba9fa2ab123a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:53.582839 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e2798-9a7e-4d38-845d-ba9fa2ab123a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:53.583191 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e2798-9a7e-4d38-845d-ba9fa2ab123a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:53.602095 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-007e2798-9a7e-4d38-845d-ba9fa2ab123a None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:53.603306 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-007e2798-9a7e-4d38-845d-ba9fa2ab123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:53.622647 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:53.664392 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 904/1825] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:53.674178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b97cd-45f1-4803-a049-907669bcd256 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:53.675549 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5a7b97cd-45f1-4803-a049-907669bcd256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:53.731610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b97cd-45f1-4803-a049-907669bcd256 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:53.735340 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c9ba6-09b4-4f8d-9646-3797e58c871f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:53.735956 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c9ba6-09b4-4f8d-9646-3797e58c871f service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:53.736245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c9ba6-09b4-4f8d-9646-3797e58c871f service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:53.736517 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c9ba6-09b4-4f8d-9646-3797e58c871f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:53.746061 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c9ba6-09b4-4f8d-9646-3797e58c871f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:53.747488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c9ba6-09b4-4f8d-9646-3797e58c871f service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:53.757294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 922/1826] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:54.032642 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e2798-9a7e-4d38-845d-ba9fa2ab123a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:54.034293 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-007e2798-9a7e-4d38-845d-ba9fa2ab123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:54.056866 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e2798-9a7e-4d38-845d-ba9fa2ab123a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:54.061994 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505685a-c88b-456d-80d8-2cbc2ef9595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:54.062959 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505685a-c88b-456d-80d8-2cbc2ef9595a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:54.063274 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505685a-c88b-456d-80d8-2cbc2ef9595a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:54.063754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505685a-c88b-456d-80d8-2cbc2ef9595a admin admin] PATH_INFO: `/v3/projects/54c54064e31344409640c9b7abcbd056` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:54.064954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505685a-c88b-456d-80d8-2cbc2ef9595a admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c54064e31344409640c9b7abcbd056)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:54.066887 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505685a-c88b-456d-80d8-2cbc2ef9595a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:54.116713 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2505685a-c88b-456d-80d8-2cbc2ef9595a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c54064e31344409640c9b7abcbd056', 'request_id': 'req-2505685a-c88b-456d-80d8-2cbc2ef9595a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:54.124478 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2505685a-c88b-456d-80d8-2cbc2ef9595a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c54064e31344409640c9b7abcbd056', 'request_id': 'req-2505685a-c88b-456d-80d8-2cbc2ef9595a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:54.131661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2505685a-c88b-456d-80d8-2cbc2ef9595a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c54064e31344409640c9b7abcbd056', 'request_id': 'req-2505685a-c88b-456d-80d8-2cbc2ef9595a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:54.142035 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2505685a-c88b-456d-80d8-2cbc2ef9595a admin admin] The token cache is being invalidate because project 54c54064e31344409640c9b7abcbd056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:54.142314 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2505685a-c88b-456d-80d8-2cbc2ef9595a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:54.142952 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2505685a-c88b-456d-80d8-2cbc2ef9595a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:54.144481 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 905/1827] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:54 2022] DELETE /identity/v3/projects/54c54064e31344409640c9b7abcbd056 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:54.150008 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c9ed-5abc-4bdb-8ae1-a00d4c2d426f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:54.150293 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c9ed-5abc-4bdb-8ae1-a00d4c2d426f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:54.150567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c9ed-5abc-4bdb-8ae1-a00d4c2d426f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:54.169786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5f37c9ed-5abc-4bdb-8ae1-a00d4c2d426f None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:54.170971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5f37c9ed-5abc-4bdb-8ae1-a00d4c2d426f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:54.211858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:54.230063 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 923/1828] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:54.238599 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacb74c-fa70-4c13-bd96-de3de5885533 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:54.238888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacb74c-fa70-4c13-bd96-de3de5885533 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:54.239169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacb74c-fa70-4c13-bd96-de3de5885533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:54.259878 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9dacb74c-fa70-4c13-bd96-de3de5885533 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:54.261117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9dacb74c-fa70-4c13-bd96-de3de5885533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:54.268926 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 906/1829] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:54.272966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c9ed-5abc-4bdb-8ae1-a00d4c2d426f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:54.282531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c9ed-5abc-4bdb-8ae1-a00d4c2d426f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:54.287210 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bedf9-d6fc-4630-80a9-2a1c3421df15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:54.287816 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bedf9-d6fc-4630-80a9-2a1c3421df15 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:54.288119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bedf9-d6fc-4630-80a9-2a1c3421df15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:54.288390 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bedf9-d6fc-4630-80a9-2a1c3421df15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:54.289029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bedf9-d6fc-4630-80a9-2a1c3421df15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:25:54.289330 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bedf9-d6fc-4630-80a9-2a1c3421df15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:54.290909 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bedf9-d6fc-4630-80a9-2a1c3421df15 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:54.302547 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 924/1830] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:25:54.306554 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacb74c-fa70-4c13-bd96-de3de5885533 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:54.315815 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacb74c-fa70-4c13-bd96-de3de5885533 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:54.320643 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ba310-9ed3-4ea5-b6a0-6652c036a0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:54.321179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ba310-9ed3-4ea5-b6a0-6652c036a0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:54.321460 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ba310-9ed3-4ea5-b6a0-6652c036a0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:54.321733 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ba310-9ed3-4ea5-b6a0-6652c036a0f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:54.322363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ba310-9ed3-4ea5-b6a0-6652c036a0f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:54.324303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ba310-9ed3-4ea5-b6a0-6652c036a0f8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:54.351617 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 907/1831] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:25:54 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:54.355442 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bedf9-d6fc-4630-80a9-2a1c3421df15 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:54.365981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bedf9-d6fc-4630-80a9-2a1c3421df15 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:54.439336 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7dae6-a6ad-4db1-8a8d-c639c5acf4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:54.439336 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7dae6-a6ad-4db1-8a8d-c639c5acf4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:54.439336 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7dae6-a6ad-4db1-8a8d-c639c5acf4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:54.439336 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7dae6-a6ad-4db1-8a8d-c639c5acf4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:54.439773 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7dae6-a6ad-4db1-8a8d-c639c5acf4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:54.441270 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7dae6-a6ad-4db1-8a8d-c639c5acf4e2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:54.472648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 925/1832] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:25:54 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:25:54.477120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ba310-9ed3-4ea5-b6a0-6652c036a0f8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:54.491655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ba310-9ed3-4ea5-b6a0-6652c036a0f8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:54.512432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff73406-ee95-432c-980d-d2a1682ddc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:54.514152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff73406-ee95-432c-980d-d2a1682ddc72 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:54.514694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff73406-ee95-432c-980d-d2a1682ddc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:54.515487 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff73406-ee95-432c-980d-d2a1682ddc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:54.516527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff73406-ee95-432c-980d-d2a1682ddc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:54.525405 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff73406-ee95-432c-980d-d2a1682ddc72 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:54.541706 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 908/1833] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:54.545141 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7dae6-a6ad-4db1-8a8d-c639c5acf4e2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:54.581950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7dae6-a6ad-4db1-8a8d-c639c5acf4e2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:54.593503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf81596-cceb-435d-ad04-2b61ea766e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:54.594235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf81596-cceb-435d-ad04-2b61ea766e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:54.594610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf81596-cceb-435d-ad04-2b61ea766e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:54.594980 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf81596-cceb-435d-ad04-2b61ea766e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:54.595780 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf81596-cceb-435d-ad04-2b61ea766e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:54.597396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf81596-cceb-435d-ad04-2b61ea766e20 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:54.609863 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 926/1834] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:25:54.613844 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff73406-ee95-432c-980d-d2a1682ddc72 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:54.627487 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff73406-ee95-432c-980d-d2a1682ddc72 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:54.639507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8b7a5-4ed7-48b3-8bfa-dfff0ce37272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:54.640319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8b7a5-4ed7-48b3-8bfa-dfff0ce37272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:54.640572 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8b7a5-4ed7-48b3-8bfa-dfff0ce37272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:54.640842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8b7a5-4ed7-48b3-8bfa-dfff0ce37272 admin admin] PATH_INFO: `/v3/projects/f109de1f661c43e58523236dfd244c8f/users/4ba5e7fa1c674beebd0db377e25ac87f/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:54.671100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8b7a5-4ed7-48b3-8bfa-dfff0ce37272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f109de1f661c43e58523236dfd244c8f, user_id=4ba5e7fa1c674beebd0db377e25ac87f, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:54.673901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8b7a5-4ed7-48b3-8bfa-dfff0ce37272 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:54.701467 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 909/1835] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:25:54 2022] PUT /identity/v3/projects/f109de1f661c43e58523236dfd244c8f/users/4ba5e7fa1c674beebd0db377e25ac87f/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:54.711671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e19dd-ad55-49b2-83e8-925967ea9665 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:54.711991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e19dd-ad55-49b2-83e8-925967ea9665 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:54.712455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e19dd-ad55-49b2-83e8-925967ea9665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:54.750014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-314e19dd-ad55-49b2-83e8-925967ea9665 None None] MFA Rules not processed for user `4ba5e7fa1c674beebd0db377e25ac87f`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:54.751605 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-314e19dd-ad55-49b2-83e8-925967ea9665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:54.856941 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 927/1836] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:54.868384 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8b7a5-4ed7-48b3-8bfa-dfff0ce37272 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:54.870134 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-14c8b7a5-4ed7-48b3-8bfa-dfff0ce37272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:54.923167 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:54.935633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8b7a5-4ed7-48b3-8bfa-dfff0ce37272 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:54.939292 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ffd3d-ea3c-4759-ae97-bc992c03e380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:54.939898 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ffd3d-ea3c-4759-ae97-bc992c03e380 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:54.940203 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ffd3d-ea3c-4759-ae97-bc992c03e380 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:54.940473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ffd3d-ea3c-4759-ae97-bc992c03e380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:54.949187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ffd3d-ea3c-4759-ae97-bc992c03e380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:54.950614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ffd3d-ea3c-4759-ae97-bc992c03e380 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:54.959343 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 910/1837] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:58.247001 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e19dd-ad55-49b2-83e8-925967ea9665 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:58.248575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-314e19dd-ad55-49b2-83e8-925967ea9665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:58.317788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:58.357105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e19dd-ad55-49b2-83e8-925967ea9665 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:58.370344 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5467b40-d1b4-443e-8788-855f8e1acb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:58.371141 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5467b40-d1b4-443e-8788-855f8e1acb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:58.371841 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5467b40-d1b4-443e-8788-855f8e1acb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:58.373136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5467b40-d1b4-443e-8788-855f8e1acb3e admin admin] PATH_INFO: `/v3/users/67d141fec55e4539b2aab9634551b477` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:58.375920 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5467b40-d1b4-443e-8788-855f8e1acb3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d141fec55e4539b2aab9634551b477)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:58.379538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5467b40-d1b4-443e-8788-855f8e1acb3e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:58.503178 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e5467b40-d1b4-443e-8788-855f8e1acb3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d141fec55e4539b2aab9634551b477'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:58.505199 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e5467b40-d1b4-443e-8788-855f8e1acb3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d141fec55e4539b2aab9634551b477'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:58.521220 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e5467b40-d1b4-443e-8788-855f8e1acb3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d141fec55e4539b2aab9634551b477'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:58.522431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e5467b40-d1b4-443e-8788-855f8e1acb3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d141fec55e4539b2aab9634551b477'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:58.534766 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e5467b40-d1b4-443e-8788-855f8e1acb3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d141fec55e4539b2aab9634551b477'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:58.580013 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 928/1838] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:25:58 2022] DELETE /identity/v3/users/67d141fec55e4539b2aab9634551b477 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:25:58.580540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5c4c0-13e0-4d8a-9bb6-f8cb2dadda91 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:58.580948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5c4c0-13e0-4d8a-9bb6-f8cb2dadda91 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:58.581030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5c4c0-13e0-4d8a-9bb6-f8cb2dadda91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:58.621388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-38c5c4c0-13e0-4d8a-9bb6-f8cb2dadda91 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:25:58.631493 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-38c5c4c0-13e0-4d8a-9bb6-f8cb2dadda91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:58.732147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 911/1839] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:25:58.742436 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5467b40-d1b4-443e-8788-855f8e1acb3e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:58.744541 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e5467b40-d1b4-443e-8788-855f8e1acb3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:58.836552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5467b40-d1b4-443e-8788-855f8e1acb3e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:58.840441 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0d458-325b-4f4a-90ae-f7cef9f6af18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:58.841057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0d458-325b-4f4a-90ae-f7cef9f6af18 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:58.841333 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0d458-325b-4f4a-90ae-f7cef9f6af18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:58.841596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0d458-325b-4f4a-90ae-f7cef9f6af18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:58.859654 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0d458-325b-4f4a-90ae-f7cef9f6af18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:58.861316 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0d458-325b-4f4a-90ae-f7cef9f6af18 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:58.872358 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 929/1840] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:25:59.173222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5c4c0-13e0-4d8a-9bb6-f8cb2dadda91 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:25:59.174684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-38c5c4c0-13e0-4d8a-9bb6-f8cb2dadda91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:25:59.190146 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5c4c0-13e0-4d8a-9bb6-f8cb2dadda91 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:25:59.195193 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea92ed-da99-49d5-8bf4-fcfd42e2f8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:25:59.195839 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea92ed-da99-49d5-8bf4-fcfd42e2f8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:25:59.196764 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea92ed-da99-49d5-8bf4-fcfd42e2f8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:25:59.197435 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea92ed-da99-49d5-8bf4-fcfd42e2f8fa admin admin] PATH_INFO: `/v3/projects/d3891cbf854f4c6a99645891eabcdcb7` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:25:59.198618 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea92ed-da99-49d5-8bf4-fcfd42e2f8fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3891cbf854f4c6a99645891eabcdcb7)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:25:59.200605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea92ed-da99-49d5-8bf4-fcfd42e2f8fa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:25:59.249674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-abea92ed-da99-49d5-8bf4-fcfd42e2f8fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3891cbf854f4c6a99645891eabcdcb7', 'request_id': 'req-abea92ed-da99-49d5-8bf4-fcfd42e2f8fa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:59.258438 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-abea92ed-da99-49d5-8bf4-fcfd42e2f8fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3891cbf854f4c6a99645891eabcdcb7', 'request_id': 'req-abea92ed-da99-49d5-8bf4-fcfd42e2f8fa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:59.265394 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-abea92ed-da99-49d5-8bf4-fcfd42e2f8fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3891cbf854f4c6a99645891eabcdcb7', 'request_id': 'req-abea92ed-da99-49d5-8bf4-fcfd42e2f8fa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:59.278164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-abea92ed-da99-49d5-8bf4-fcfd42e2f8fa admin admin] The token cache is being invalidate because project d3891cbf854f4c6a99645891eabcdcb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:25:59.278937 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-abea92ed-da99-49d5-8bf4-fcfd42e2f8fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:59.279290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-abea92ed-da99-49d5-8bf4-fcfd42e2f8fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:25:59.281021 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 912/1841] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:25:59 2022] DELETE /identity/v3/projects/d3891cbf854f4c6a99645891eabcdcb7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:26:00.285057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b79ccb-43a6-4f56-abca-9846ce7f1f8d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:00.285525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b79ccb-43a6-4f56-abca-9846ce7f1f8d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:00.285615 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b79ccb-43a6-4f56-abca-9846ce7f1f8d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:00.287515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 930/1842] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 17 10:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:26:00.522514 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd9c96-752d-4d38-8da2-afc203bcdb9e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:00.523038 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd9c96-752d-4d38-8da2-afc203bcdb9e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:00.523038 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd9c96-752d-4d38-8da2-afc203bcdb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:00.565661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b79ccb-43a6-4f56-abca-9846ce7f1f8d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:00.569699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-82dd9c96-752d-4d38-8da2-afc203bcdb9e None None] MFA Rules not processed for user `dd52eee25ef347e1ae905cc3cba17284`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:00.569992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-76b79ccb-43a6-4f56-abca-9846ce7f1f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:00.574453 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-82dd9c96-752d-4d38-8da2-afc203bcdb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:00.665959 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 913/1843] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 17 10:26:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:26:00.672954 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b79ccb-43a6-4f56-abca-9846ce7f1f8d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:00.682249 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ca414-fc62-4e5d-bebd-a00e5bca7a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:00.683286 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ca414-fc62-4e5d-bebd-a00e5bca7a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:00.683572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ca414-fc62-4e5d-bebd-a00e5bca7a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:00.683851 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ca414-fc62-4e5d-bebd-a00e5bca7a58 admin admin] PATH_INFO: `/v3/users/df6a4914e6f0486683abf7740dd0c863` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:00.685113 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5db53-fa76-4b2c-9fe5-42e485767a95 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:00.685297 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ca414-fc62-4e5d-bebd-a00e5bca7a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6a4914e6f0486683abf7740dd0c863)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:00.685699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5db53-fa76-4b2c-9fe5-42e485767a95 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:00.686139 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5db53-fa76-4b2c-9fe5-42e485767a95 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:00.687466 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ca414-fc62-4e5d-bebd-a00e5bca7a58 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:00.693465 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:00.697697 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 914/1844] 10.222.0.13 () {54 vars in 961 bytes} [Mon Oct 17 10:26:00 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 10:26:00.699606 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec395f60-586d-4927-9a10-ccb3eeb4c54e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:00.700091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec395f60-586d-4927-9a10-ccb3eeb4c54e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:00.700680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec395f60-586d-4927-9a10-ccb3eeb4c54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:00.722822 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:00.733745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ec395f60-586d-4927-9a10-ccb3eeb4c54e None None] MFA Rules not processed for user `dd52eee25ef347e1ae905cc3cba17284`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:00.736757 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ec395f60-586d-4927-9a10-ccb3eeb4c54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:00.766760 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-813ca414-fc62-4e5d-bebd-a00e5bca7a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6a4914e6f0486683abf7740dd0c863'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:00.767508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-813ca414-fc62-4e5d-bebd-a00e5bca7a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6a4914e6f0486683abf7740dd0c863'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:00.772823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 915/1845] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Oct 17 10:26:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:26:00.777844 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec395f60-586d-4927-9a10-ccb3eeb4c54e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:00.794232 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec395f60-586d-4927-9a10-ccb3eeb4c54e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:00.797420 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-813ca414-fc62-4e5d-bebd-a00e5bca7a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6a4914e6f0486683abf7740dd0c863'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:00.798146 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-813ca414-fc62-4e5d-bebd-a00e5bca7a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6a4914e6f0486683abf7740dd0c863'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:00.805414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df165df0-0070-4a38-95f1-a7e5f825fbea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd52eee25ef347e1ae905cc3cba17284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:00.806278 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df165df0-0070-4a38-95f1-a7e5f825fbea service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:00.806818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df165df0-0070-4a38-95f1-a7e5f825fbea service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:00.807473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df165df0-0070-4a38-95f1-a7e5f825fbea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:00.809285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-813ca414-fc62-4e5d-bebd-a00e5bca7a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6a4914e6f0486683abf7740dd0c863'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:00.810777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-df165df0-0070-4a38-95f1-a7e5f825fbea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:00.834882 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 931/1846] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:26:00 2022] DELETE /identity/v3/users/df6a4914e6f0486683abf7740dd0c863 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:26:00.836559 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df165df0-0070-4a38-95f1-a7e5f825fbea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:00.839818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df165df0-0070-4a38-95f1-a7e5f825fbea service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:00.862703 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 916/1847] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:26:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:26:01.017746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ca414-fc62-4e5d-bebd-a00e5bca7a58 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:01.019389 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-813ca414-fc62-4e5d-bebd-a00e5bca7a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:01.104699 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ca414-fc62-4e5d-bebd-a00e5bca7a58 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:01.109766 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06953f-43ae-46e1-b16c-1b64d121171b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:01.110472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06953f-43ae-46e1-b16c-1b64d121171b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:01.110862 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06953f-43ae-46e1-b16c-1b64d121171b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:01.111201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06953f-43ae-46e1-b16c-1b64d121171b admin admin] PATH_INFO: `/v3/projects/e8ec43a3c32c445c82865708ec55ec34` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:01.112435 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06953f-43ae-46e1-b16c-1b64d121171b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ec43a3c32c445c82865708ec55ec34)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:01.115981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06953f-43ae-46e1-b16c-1b64d121171b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:01.165077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea06953f-43ae-46e1-b16c-1b64d121171b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ec43a3c32c445c82865708ec55ec34', 'request_id': 'req-ea06953f-43ae-46e1-b16c-1b64d121171b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:01.173520 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea06953f-43ae-46e1-b16c-1b64d121171b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ec43a3c32c445c82865708ec55ec34', 'request_id': 'req-ea06953f-43ae-46e1-b16c-1b64d121171b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:01.182184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea06953f-43ae-46e1-b16c-1b64d121171b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ec43a3c32c445c82865708ec55ec34', 'request_id': 'req-ea06953f-43ae-46e1-b16c-1b64d121171b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:01.193625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea06953f-43ae-46e1-b16c-1b64d121171b admin admin] The token cache is being invalidate because project e8ec43a3c32c445c82865708ec55ec34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:26:01.193911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea06953f-43ae-46e1-b16c-1b64d121171b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:01.194577 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea06953f-43ae-46e1-b16c-1b64d121171b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:01.196120 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 932/1848] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:26:01 2022] DELETE /identity/v3/projects/e8ec43a3c32c445c82865708ec55ec34 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:26:01.201032 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3cd9e-642b-4b10-a685-9e56d8deaa94 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:01.201328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3cd9e-642b-4b10-a685-9e56d8deaa94 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:01.201580 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3cd9e-642b-4b10-a685-9e56d8deaa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:01.220393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-83e3cd9e-642b-4b10-a685-9e56d8deaa94 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:01.221574 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-83e3cd9e-642b-4b10-a685-9e56d8deaa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:01.282846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 917/1849] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:26:01.290524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee0e58-372c-4394-a296-666f19b1b2fa None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:01.290992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee0e58-372c-4394-a296-666f19b1b2fa None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:01.291127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee0e58-372c-4394-a296-666f19b1b2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:01.310847 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-63ee0e58-372c-4394-a296-666f19b1b2fa None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:01.312072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-63ee0e58-372c-4394-a296-666f19b1b2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:01.321216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 933/1850] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:26:01.325442 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3cd9e-642b-4b10-a685-9e56d8deaa94 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:01.335276 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3cd9e-642b-4b10-a685-9e56d8deaa94 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:01.339851 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b046c-475f-4391-b2d5-c07f9167f4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:01.340487 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b046c-475f-4391-b2d5-c07f9167f4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:01.340792 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b046c-475f-4391-b2d5-c07f9167f4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:01.341061 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b046c-475f-4391-b2d5-c07f9167f4a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:01.341701 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b046c-475f-4391-b2d5-c07f9167f4a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:26:01.342048 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b046c-475f-4391-b2d5-c07f9167f4a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:01.343567 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b046c-475f-4391-b2d5-c07f9167f4a4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:01.355371 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 918/1851] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:26:01.359904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee0e58-372c-4394-a296-666f19b1b2fa None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:01.370067 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee0e58-372c-4394-a296-666f19b1b2fa None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:01.374882 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d61fdd-e55e-4143-a5a5-49c79ef44d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:01.375608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61fdd-e55e-4143-a5a5-49c79ef44d2e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:01.375896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61fdd-e55e-4143-a5a5-49c79ef44d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:01.376207 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61fdd-e55e-4143-a5a5-49c79ef44d2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:01.376851 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d61fdd-e55e-4143-a5a5-49c79ef44d2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:01.378773 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d61fdd-e55e-4143-a5a5-49c79ef44d2e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:01.383888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:01.412237 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 934/1852] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:26:01 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:26:01.416285 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b046c-475f-4391-b2d5-c07f9167f4a4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:01.426170 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b046c-475f-4391-b2d5-c07f9167f4a4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:01.485484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84386ba7-66dc-48ee-ab5b-862ed8224e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:01.486096 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84386ba7-66dc-48ee-ab5b-862ed8224e3c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:01.486373 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84386ba7-66dc-48ee-ab5b-862ed8224e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:01.486643 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84386ba7-66dc-48ee-ab5b-862ed8224e3c admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:01.487286 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84386ba7-66dc-48ee-ab5b-862ed8224e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:01.489220 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84386ba7-66dc-48ee-ab5b-862ed8224e3c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:01.510684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 919/1853] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:26:01 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:26:01.514906 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d61fdd-e55e-4143-a5a5-49c79ef44d2e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:01.525774 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d61fdd-e55e-4143-a5a5-49c79ef44d2e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:01.530728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf6f81-a79b-4252-8120-3fed4859a5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:01.531378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf6f81-a79b-4252-8120-3fed4859a5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:01.531690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf6f81-a79b-4252-8120-3fed4859a5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:01.531999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf6f81-a79b-4252-8120-3fed4859a5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:01.532754 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf6f81-a79b-4252-8120-3fed4859a5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:01.534409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf6f81-a79b-4252-8120-3fed4859a5a1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:01.546111 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 935/1854] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:26:01.550018 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84386ba7-66dc-48ee-ab5b-862ed8224e3c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:01.562501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84386ba7-66dc-48ee-ab5b-862ed8224e3c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:01.567304 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34608e-e81d-45d8-883c-5e29b68efec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:01.568001 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34608e-e81d-45d8-883c-5e29b68efec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:01.568353 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34608e-e81d-45d8-883c-5e29b68efec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:01.568815 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34608e-e81d-45d8-883c-5e29b68efec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:01.569535 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34608e-e81d-45d8-883c-5e29b68efec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:01.571181 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34608e-e81d-45d8-883c-5e29b68efec6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:01.585823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 920/1855] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:26:01.587086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf6f81-a79b-4252-8120-3fed4859a5a1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:01.597525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf6f81-a79b-4252-8120-3fed4859a5a1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:01.603015 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c70c5f-eb21-4790-8da2-9deff2606769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:01.603747 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c70c5f-eb21-4790-8da2-9deff2606769 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:01.604124 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c70c5f-eb21-4790-8da2-9deff2606769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:01.604401 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c70c5f-eb21-4790-8da2-9deff2606769 admin admin] PATH_INFO: `/v3/projects/d299c5b2aa8d43a684db07feb0f5fd8e/users/e0a58360f5f7435b91c3d5be02adc3cb/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:01.619323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c70c5f-eb21-4790-8da2-9deff2606769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d299c5b2aa8d43a684db07feb0f5fd8e, user_id=e0a58360f5f7435b91c3d5be02adc3cb, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:01.622056 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c70c5f-eb21-4790-8da2-9deff2606769 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:01.637112 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 936/1856] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:26:01 2022] PUT /identity/v3/projects/d299c5b2aa8d43a684db07feb0f5fd8e/users/e0a58360f5f7435b91c3d5be02adc3cb/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:26:01.642117 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047203c-46e0-469e-9771-dbf0294168d8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:01.642494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047203c-46e0-469e-9771-dbf0294168d8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:01.642835 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047203c-46e0-469e-9771-dbf0294168d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:01.662616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0047203c-46e0-469e-9771-dbf0294168d8 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:01.663806 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0047203c-46e0-469e-9771-dbf0294168d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:01.710300 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:01.724469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 921/1857] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:26:01.734232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c70c5f-eb21-4790-8da2-9deff2606769 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:01.736037 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-72c70c5f-eb21-4790-8da2-9deff2606769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:01.796476 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c70c5f-eb21-4790-8da2-9deff2606769 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:01.800127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7a3ce-030b-43dc-b8de-1e5458e7d40e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:01.800739 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7a3ce-030b-43dc-b8de-1e5458e7d40e service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:01.801019 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7a3ce-030b-43dc-b8de-1e5458e7d40e service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:01.801298 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7a3ce-030b-43dc-b8de-1e5458e7d40e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:01.814993 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7a3ce-030b-43dc-b8de-1e5458e7d40e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:01.816678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7a3ce-030b-43dc-b8de-1e5458e7d40e service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:01.827414 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 937/1858] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:26:05.377198 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ac193-fdce-440f-bb9c-9bcc7d01264f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:05.377729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ac193-fdce-440f-bb9c-9bcc7d01264f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:05.377729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ac193-fdce-440f-bb9c-9bcc7d01264f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:05.397936 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-182ac193-fdce-440f-bb9c-9bcc7d01264f None None] MFA Rules not processed for user `c44adb0be9e044f7958a8c0ed6cfe535`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:05.399280 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-182ac193-fdce-440f-bb9c-9bcc7d01264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:05.463843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 922/1859] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:26:05.962211 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7a3ce-030b-43dc-b8de-1e5458e7d40e service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:05.965443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-40e7a3ce-030b-43dc-b8de-1e5458e7d40e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:05.978482 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7a3ce-030b-43dc-b8de-1e5458e7d40e service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:05.984485 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7c58f-2778-4461-95e2-cd74aceaa8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:05.985160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7c58f-2778-4461-95e2-cd74aceaa8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:05.985821 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7c58f-2778-4461-95e2-cd74aceaa8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:05.985821 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7c58f-2778-4461-95e2-cd74aceaa8c3 admin admin] PATH_INFO: `/v3/users/4ba5e7fa1c674beebd0db377e25ac87f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:05.987834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7c58f-2778-4461-95e2-cd74aceaa8c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba5e7fa1c674beebd0db377e25ac87f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:05.990438 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7c58f-2778-4461-95e2-cd74aceaa8c3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:06.050450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-62d7c58f-2778-4461-95e2-cd74aceaa8c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba5e7fa1c674beebd0db377e25ac87f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:06.051841 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-62d7c58f-2778-4461-95e2-cd74aceaa8c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba5e7fa1c674beebd0db377e25ac87f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:06.076838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-62d7c58f-2778-4461-95e2-cd74aceaa8c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba5e7fa1c674beebd0db377e25ac87f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:06.077578 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-62d7c58f-2778-4461-95e2-cd74aceaa8c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba5e7fa1c674beebd0db377e25ac87f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:06.087324 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-62d7c58f-2778-4461-95e2-cd74aceaa8c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba5e7fa1c674beebd0db377e25ac87f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:06.111516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 938/1860] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:26:05 2022] DELETE /identity/v3/users/4ba5e7fa1c674beebd0db377e25ac87f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:26:06.113272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03bd10-0f4c-46ba-a08b-c7447b35cc6a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:06.113571 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03bd10-0f4c-46ba-a08b-c7447b35cc6a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:06.113989 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03bd10-0f4c-46ba-a08b-c7447b35cc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:06.147357 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-cb03bd10-0f4c-46ba-a08b-c7447b35cc6a None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:06.148919 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cb03bd10-0f4c-46ba-a08b-c7447b35cc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:06.224353 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 923/1861] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:26:06.238266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7c58f-2778-4461-95e2-cd74aceaa8c3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:06.244341 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-62d7c58f-2778-4461-95e2-cd74aceaa8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:06.288572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:06.360986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7c58f-2778-4461-95e2-cd74aceaa8c3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:06.377369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c67bbf-837d-4494-8212-804cfe8fd86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:06.377369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c67bbf-837d-4494-8212-804cfe8fd86d service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:06.378131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c67bbf-837d-4494-8212-804cfe8fd86d service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:06.389117 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c67bbf-837d-4494-8212-804cfe8fd86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:06.420463 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c67bbf-837d-4494-8212-804cfe8fd86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:06.422197 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c67bbf-837d-4494-8212-804cfe8fd86d service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:06.443103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 939/1862] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:26:06.810487 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1c8e6-6178-4856-b44e-cc4b1101d1d4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:06.812395 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1c8e6-6178-4856-b44e-cc4b1101d1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:06.812683 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1c8e6-6178-4856-b44e-cc4b1101d1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:06.886874 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e5c1c8e6-6178-4856-b44e-cc4b1101d1d4 None None] MFA Rules not processed for user `e0a58360f5f7435b91c3d5be02adc3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:06.888672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e5c1c8e6-6178-4856-b44e-cc4b1101d1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:06.921122 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c67bbf-837d-4494-8212-804cfe8fd86d service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:06.922566 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-26c67bbf-837d-4494-8212-804cfe8fd86d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:06.948179 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c67bbf-837d-4494-8212-804cfe8fd86d service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:06.965689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c776b6-2141-4072-92db-a9cac2f98b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:06.966344 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c776b6-2141-4072-92db-a9cac2f98b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:06.966625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c776b6-2141-4072-92db-a9cac2f98b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:06.966898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c776b6-2141-4072-92db-a9cac2f98b28 admin admin] PATH_INFO: `/v3/projects/f109de1f661c43e58523236dfd244c8f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:06.968208 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c776b6-2141-4072-92db-a9cac2f98b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f109de1f661c43e58523236dfd244c8f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:06.970416 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c776b6-2141-4072-92db-a9cac2f98b28 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:07.006289 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 924/1863] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:26:07.022390 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1c8e6-6178-4856-b44e-cc4b1101d1d4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:07.024439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e5c1c8e6-6178-4856-b44e-cc4b1101d1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:07.034209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a0c776b6-2141-4072-92db-a9cac2f98b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f109de1f661c43e58523236dfd244c8f', 'request_id': 'req-a0c776b6-2141-4072-92db-a9cac2f98b28'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:07.045664 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a0c776b6-2141-4072-92db-a9cac2f98b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f109de1f661c43e58523236dfd244c8f', 'request_id': 'req-a0c776b6-2141-4072-92db-a9cac2f98b28'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:07.054751 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a0c776b6-2141-4072-92db-a9cac2f98b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f109de1f661c43e58523236dfd244c8f', 'request_id': 'req-a0c776b6-2141-4072-92db-a9cac2f98b28'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:07.077320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:07.090788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a0c776b6-2141-4072-92db-a9cac2f98b28 admin admin] The token cache is being invalidate because project f109de1f661c43e58523236dfd244c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:26:07.091086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a0c776b6-2141-4072-92db-a9cac2f98b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:07.092185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a0c776b6-2141-4072-92db-a9cac2f98b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:07.097073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 940/1864] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:26:06 2022] DELETE /identity/v3/projects/f109de1f661c43e58523236dfd244c8f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:26:07.099629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbbf57-4e28-4daa-a1bb-d0802b204199 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:07.100140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbbf57-4e28-4daa-a1bb-d0802b204199 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:07.100649 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbbf57-4e28-4daa-a1bb-d0802b204199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:07.124672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-92dbbf57-4e28-4daa-a1bb-d0802b204199 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:07.126336 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-92dbbf57-4e28-4daa-a1bb-d0802b204199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:07.143238 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1c8e6-6178-4856-b44e-cc4b1101d1d4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:07.224902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a8515-53c3-456b-aaf9-2f02a6b86288 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:07.225623 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a8515-53c3-456b-aaf9-2f02a6b86288 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:07.226105 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a8515-53c3-456b-aaf9-2f02a6b86288 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:07.226522 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a8515-53c3-456b-aaf9-2f02a6b86288 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:07.228814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-597a8515-53c3-456b-aaf9-2f02a6b86288 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:07.242674 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 941/1865] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:26:07.251033 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a076982-e9c1-4a62-9363-ad88aec86500 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:07.251325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a076982-e9c1-4a62-9363-ad88aec86500 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:07.251596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a076982-e9c1-4a62-9363-ad88aec86500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:07.275438 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4a076982-e9c1-4a62-9363-ad88aec86500 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:07.276704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4a076982-e9c1-4a62-9363-ad88aec86500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:07.288780 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 942/1866] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:26:07.289885 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a076982-e9c1-4a62-9363-ad88aec86500 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:07.298373 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a8515-53c3-456b-aaf9-2f02a6b86288 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:07.299230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a076982-e9c1-4a62-9363-ad88aec86500 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:07.300045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a8515-53c3-456b-aaf9-2f02a6b86288 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:07.304514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5068a7-b1c9-4642-93ab-0f90ad446fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:07.305217 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5068a7-b1c9-4642-93ab-0f90ad446fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:07.305560 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5068a7-b1c9-4642-93ab-0f90ad446fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:07.305896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5068a7-b1c9-4642-93ab-0f90ad446fd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:07.306616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5068a7-b1c9-4642-93ab-0f90ad446fd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:26:07.306984 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5068a7-b1c9-4642-93ab-0f90ad446fd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:07.308686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5068a7-b1c9-4642-93ab-0f90ad446fd0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:07.312430 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 925/1867] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:26:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:26:07.324062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 943/1868] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:26:07.325599 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a8515-53c3-456b-aaf9-2f02a6b86288 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:07.336673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a8515-53c3-456b-aaf9-2f02a6b86288 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:07.342722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a69c40-69ab-4412-b77c-7d36f7b5946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:07.343346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a69c40-69ab-4412-b77c-7d36f7b5946a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:07.343694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a69c40-69ab-4412-b77c-7d36f7b5946a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:07.344221 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a69c40-69ab-4412-b77c-7d36f7b5946a admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:07.345069 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a69c40-69ab-4412-b77c-7d36f7b5946a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:07.346966 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a69c40-69ab-4412-b77c-7d36f7b5946a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:07.380382 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 926/1869] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:26:07 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:26:07.383251 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5068a7-b1c9-4642-93ab-0f90ad446fd0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:07.396489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5068a7-b1c9-4642-93ab-0f90ad446fd0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:07.431435 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:07.479321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803845d-595b-4a13-81d3-9e80b515a5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:07.480275 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803845d-595b-4a13-81d3-9e80b515a5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:07.480767 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803845d-595b-4a13-81d3-9e80b515a5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:07.481295 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803845d-595b-4a13-81d3-9e80b515a5a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:07.481918 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803845d-595b-4a13-81d3-9e80b515a5a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:07.483869 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803845d-595b-4a13-81d3-9e80b515a5a7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:07.511977 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 944/1870] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:26:07 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:26:07.517405 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a69c40-69ab-4412-b77c-7d36f7b5946a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:07.529054 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a69c40-69ab-4412-b77c-7d36f7b5946a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:07.536416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603626b-e4a0-4b45-ba2b-bd7aa745a532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:07.537308 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603626b-e4a0-4b45-ba2b-bd7aa745a532 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:07.537815 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603626b-e4a0-4b45-ba2b-bd7aa745a532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:07.538159 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603626b-e4a0-4b45-ba2b-bd7aa745a532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:07.538882 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603626b-e4a0-4b45-ba2b-bd7aa745a532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:07.549223 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603626b-e4a0-4b45-ba2b-bd7aa745a532 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:07.573639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 927/1871] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:26:07.577459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803845d-595b-4a13-81d3-9e80b515a5a7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:07.590864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803845d-595b-4a13-81d3-9e80b515a5a7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:07.596867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c4fb9-b458-47c6-8549-625ee3d950b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:07.597947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4fb9-b458-47c6-8549-625ee3d950b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:07.599703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4fb9-b458-47c6-8549-625ee3d950b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:07.600678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4fb9-b458-47c6-8549-625ee3d950b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:07.601462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c4fb9-b458-47c6-8549-625ee3d950b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:07.604280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c4fb9-b458-47c6-8549-625ee3d950b4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:07.624252 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 945/1872] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:26:07.625932 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603626b-e4a0-4b45-ba2b-bd7aa745a532 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:07.637447 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603626b-e4a0-4b45-ba2b-bd7aa745a532 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:07.644437 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756c5eb-0bf6-4d0a-840b-e9d4df43b81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:07.645142 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756c5eb-0bf6-4d0a-840b-e9d4df43b81e admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:07.645430 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756c5eb-0bf6-4d0a-840b-e9d4df43b81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:07.645835 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756c5eb-0bf6-4d0a-840b-e9d4df43b81e admin admin] PATH_INFO: `/v3/projects/92254065467744f68cf34bd6d8550526/users/d0a554db24c541f48ea49015c9cd2dc1/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:07.663846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756c5eb-0bf6-4d0a-840b-e9d4df43b81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=92254065467744f68cf34bd6d8550526, user_id=d0a554db24c541f48ea49015c9cd2dc1, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:07.666647 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756c5eb-0bf6-4d0a-840b-e9d4df43b81e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:07.697568 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 928/1873] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:26:07 2022] PUT /identity/v3/projects/92254065467744f68cf34bd6d8550526/users/d0a554db24c541f48ea49015c9cd2dc1/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:26:07.710159 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b26c-ba70-4e25-9f0c-5b6c4ac79709 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:07.710159 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b26c-ba70-4e25-9f0c-5b6c4ac79709 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:07.710448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b26c-ba70-4e25-9f0c-5b6c4ac79709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:07.737991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cef5b26c-ba70-4e25-9f0c-5b6c4ac79709 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:07.739786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cef5b26c-ba70-4e25-9f0c-5b6c4ac79709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:07.856012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 946/1874] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:26:07.866007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756c5eb-0bf6-4d0a-840b-e9d4df43b81e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:07.868705 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2756c5eb-0bf6-4d0a-840b-e9d4df43b81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:07.881763 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:07.960741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756c5eb-0bf6-4d0a-840b-e9d4df43b81e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:07.967288 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd792f-7fe5-4e28-9f1f-3708e6f3153b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:07.968131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd792f-7fe5-4e28-9f1f-3708e6f3153b service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:07.968515 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd792f-7fe5-4e28-9f1f-3708e6f3153b service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:07.968930 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd792f-7fe5-4e28-9f1f-3708e6f3153b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:07.984558 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd792f-7fe5-4e28-9f1f-3708e6f3153b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:07.986325 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd792f-7fe5-4e28-9f1f-3708e6f3153b service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:08.002308 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 929/1875] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:26:09.266473 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1249d9-acee-400e-a8f0-aa04594326e8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:09.266984 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1249d9-acee-400e-a8f0-aa04594326e8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:09.267095 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1249d9-acee-400e-a8f0-aa04594326e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:09.289368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cf1249d9-acee-400e-a8f0-aa04594326e8 None None] MFA Rules not processed for user `e0a58360f5f7435b91c3d5be02adc3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:09.290910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cf1249d9-acee-400e-a8f0-aa04594326e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:09.362185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 947/1876] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:26:14.643985 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2761f77-4b9e-40be-a3f1-47836dd6c3b6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:14.644490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2761f77-4b9e-40be-a3f1-47836dd6c3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:14.644607 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2761f77-4b9e-40be-a3f1-47836dd6c3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:14.676457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f2761f77-4b9e-40be-a3f1-47836dd6c3b6 None None] MFA Rules not processed for user `d0a554db24c541f48ea49015c9cd2dc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:14.678386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f2761f77-4b9e-40be-a3f1-47836dd6c3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:14.786378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 930/1877] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:26:14.788048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1249d9-acee-400e-a8f0-aa04594326e8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:14.800270 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1249d9-acee-400e-a8f0-aa04594326e8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:14.805525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25f701-b0f4-4cb4-87aa-d60fdc2460fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:14.806203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25f701-b0f4-4cb4-87aa-d60fdc2460fc admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:14.806550 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25f701-b0f4-4cb4-87aa-d60fdc2460fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:14.806885 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25f701-b0f4-4cb4-87aa-d60fdc2460fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:14.807677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25f701-b0f4-4cb4-87aa-d60fdc2460fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:14.809847 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25f701-b0f4-4cb4-87aa-d60fdc2460fc admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:14.842337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 948/1878] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:26:14 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:26:14.846362 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2761f77-4b9e-40be-a3f1-47836dd6c3b6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:14.857887 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2761f77-4b9e-40be-a3f1-47836dd6c3b6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:14.930206 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6514bf-e241-4967-b376-1d6eeb906f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:14.930825 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6514bf-e241-4967-b376-1d6eeb906f70 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:14.931100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6514bf-e241-4967-b376-1d6eeb906f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:14.931369 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6514bf-e241-4967-b376-1d6eeb906f70 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:14.932126 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6514bf-e241-4967-b376-1d6eeb906f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:14.934292 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6514bf-e241-4967-b376-1d6eeb906f70 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:14.958719 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 931/1879] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:26:14 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:26:14.962774 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25f701-b0f4-4cb4-87aa-d60fdc2460fc admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:14.979541 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25f701-b0f4-4cb4-87aa-d60fdc2460fc admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:14.985984 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae876ae8-ce4f-4ef4-8cc4-06c9e3bd4fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:14.986711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae876ae8-ce4f-4ef4-8cc4-06c9e3bd4fda admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:14.987077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae876ae8-ce4f-4ef4-8cc4-06c9e3bd4fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:14.987419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae876ae8-ce4f-4ef4-8cc4-06c9e3bd4fda admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:14.988195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae876ae8-ce4f-4ef4-8cc4-06c9e3bd4fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:14.994214 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae876ae8-ce4f-4ef4-8cc4-06c9e3bd4fda admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:15.016035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 949/1880] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:26:15.018999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6514bf-e241-4967-b376-1d6eeb906f70 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:15.030368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6514bf-e241-4967-b376-1d6eeb906f70 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:15.035823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933039a-2e6a-40ba-a040-c8ffb4ee8f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:15.037212 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933039a-2e6a-40ba-a040-c8ffb4ee8f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:15.037575 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933039a-2e6a-40ba-a040-c8ffb4ee8f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:15.038106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933039a-2e6a-40ba-a040-c8ffb4ee8f25 admin admin] PATH_INFO: `/v3/projects/1530d89e5a8c4ac897d873b190a62634/users/56c8e72952e249328f6f2048a17d0910/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:15.095714 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933039a-2e6a-40ba-a040-c8ffb4ee8f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1530d89e5a8c4ac897d873b190a62634, user_id=56c8e72952e249328f6f2048a17d0910, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:15.099476 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933039a-2e6a-40ba-a040-c8ffb4ee8f25 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:15.113814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 932/1881] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:26:15 2022] PUT /identity/v3/projects/1530d89e5a8c4ac897d873b190a62634/users/56c8e72952e249328f6f2048a17d0910/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:26:15.118698 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae876ae8-ce4f-4ef4-8cc4-06c9e3bd4fda admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:15.139351 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae876ae8-ce4f-4ef4-8cc4-06c9e3bd4fda admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:15.159851 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:15.207251 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26167691-ab1c-4aa8-a598-2d962795b134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:15.207892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26167691-ab1c-4aa8-a598-2d962795b134 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:15.208275 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26167691-ab1c-4aa8-a598-2d962795b134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:15.208549 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26167691-ab1c-4aa8-a598-2d962795b134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:15.209194 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26167691-ab1c-4aa8-a598-2d962795b134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:15.210828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26167691-ab1c-4aa8-a598-2d962795b134 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:15.224741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 950/1882] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:26:15.229159 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933039a-2e6a-40ba-a040-c8ffb4ee8f25 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:15.237534 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:15.243793 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933039a-2e6a-40ba-a040-c8ffb4ee8f25 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:15.251025 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fb6a3-6636-49c5-9c3b-eaf4d61c0044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:15.251704 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fb6a3-6636-49c5-9c3b-eaf4d61c0044 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:15.252013 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fb6a3-6636-49c5-9c3b-eaf4d61c0044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:15.252284 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fb6a3-6636-49c5-9c3b-eaf4d61c0044 admin admin] PATH_INFO: `/v3/projects/1530d89e5a8c4ac897d873b190a62634/users/56c8e72952e249328f6f2048a17d0910/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:15.254580 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fb6a3-6636-49c5-9c3b-eaf4d61c0044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1530d89e5a8c4ac897d873b190a62634, user_id=56c8e72952e249328f6f2048a17d0910, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:15.257425 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fb6a3-6636-49c5-9c3b-eaf4d61c0044 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:15.273629 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 933/1883] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:26:15 2022] PUT /identity/v3/projects/1530d89e5a8c4ac897d873b190a62634/users/56c8e72952e249328f6f2048a17d0910/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:26:20.856438 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6e7a6-68a4-4899-9a8c-dd1791db273b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:20.858136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6e7a6-68a4-4899-9a8c-dd1791db273b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:20.858413 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6e7a6-68a4-4899-9a8c-dd1791db273b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:20.888534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-58a6e7a6-68a4-4899-9a8c-dd1791db273b None None] MFA Rules not processed for user `56c8e72952e249328f6f2048a17d0910`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:20.889741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-58a6e7a6-68a4-4899-9a8c-dd1791db273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:20.961325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 951/1884] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:26:20.977770 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fb6a3-6636-49c5-9c3b-eaf4d61c0044 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:20.979664 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-788fb6a3-6636-49c5-9c3b-eaf4d61c0044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:21.054189 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fb6a3-6636-49c5-9c3b-eaf4d61c0044 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:21.059627 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad467f8-6119-467b-a446-adf00ca30c99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:21.060335 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad467f8-6119-467b-a446-adf00ca30c99 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:21.060617 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad467f8-6119-467b-a446-adf00ca30c99 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:21.060887 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad467f8-6119-467b-a446-adf00ca30c99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:21.118671 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad467f8-6119-467b-a446-adf00ca30c99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:21.120286 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad467f8-6119-467b-a446-adf00ca30c99 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:21.128941 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 934/1885] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:26:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:26:22.737145 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637bb0b-e04f-47e1-85b9-63addc8542d1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:22.737667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637bb0b-e04f-47e1-85b9-63addc8542d1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:22.737760 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637bb0b-e04f-47e1-85b9-63addc8542d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:22.757309 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8637bb0b-e04f-47e1-85b9-63addc8542d1 None None] MFA Rules not processed for user `d0a554db24c541f48ea49015c9cd2dc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:22.758511 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8637bb0b-e04f-47e1-85b9-63addc8542d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:22.765493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 952/1886] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:26:31.125015 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=59,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:32.752216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=56 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:33.476448 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb1c93-d854-4505-b1f3-46fe8fdedb4f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:33.476929 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb1c93-d854-4505-b1f3-46fe8fdedb4f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:33.477023 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb1c93-d854-4505-b1f3-46fe8fdedb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:33.497497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5beb1c93-d854-4505-b1f3-46fe8fdedb4f None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:33.498937 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5beb1c93-d854-4505-b1f3-46fe8fdedb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:33.560800 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 935/1887] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 17 10:26:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:26:33.606756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637bb0b-e04f-47e1-85b9-63addc8542d1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:33.608229 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8637bb0b-e04f-47e1-85b9-63addc8542d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:33.678005 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637bb0b-e04f-47e1-85b9-63addc8542d1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:33.683021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5253f-ae2a-4591-a686-32821b887474 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:33.683628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5253f-ae2a-4591-a686-32821b887474 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:33.683906 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5253f-ae2a-4591-a686-32821b887474 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:33.684208 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5253f-ae2a-4591-a686-32821b887474 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:33.692120 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5253f-ae2a-4591-a686-32821b887474 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:33.694195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5253f-ae2a-4591-a686-32821b887474 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:33.702175 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 953/1888] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:26:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 10:26:43.553824 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=25 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:43.698909 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=32 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:52.642253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8d32b-31ab-480d-9478-40c23e9a2ec8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:52.643471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8d32b-31ab-480d-9478-40c23e9a2ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:52.643744 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8d32b-31ab-480d-9478-40c23e9a2ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:52.663657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6bd8d32b-31ab-480d-9478-40c23e9a2ec8 None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:52.664908 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6bd8d32b-31ab-480d-9478-40c23e9a2ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:52.672382 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 936/1889] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 17 10:26:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:26:52.686594 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5253f-ae2a-4591-a686-32821b887474 service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:52.698693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5253f-ae2a-4591-a686-32821b887474 service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:52.704006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59797bfe-9cbe-447e-9bd9-f496ede1edce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:52.704706 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59797bfe-9cbe-447e-9bd9-f496ede1edce service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:52.704889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59797bfe-9cbe-447e-9bd9-f496ede1edce service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:52.705287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59797bfe-9cbe-447e-9bd9-f496ede1edce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:52.715886 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59797bfe-9cbe-447e-9bd9-f496ede1edce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:52.718112 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59797bfe-9cbe-447e-9bd9-f496ede1edce service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:52.728563 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 954/1890] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:26:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 17 10:26:53.567721 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d8a8a-8421-400a-8f88-351bc8f0ba7a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:53.568034 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d8a8a-8421-400a-8f88-351bc8f0ba7a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:53.568309 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d8a8a-8421-400a-8f88-351bc8f0ba7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:53.587201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-631d8a8a-8421-400a-8f88-351bc8f0ba7a None None] MFA Rules not processed for user `b8532a4cfb224d75aab98dddf1dcd0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:53.588351 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-631d8a8a-8421-400a-8f88-351bc8f0ba7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:53.640734 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 937/1891] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:26:54.736050 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59797bfe-9cbe-447e-9bd9-f496ede1edce service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:54.737480 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-59797bfe-9cbe-447e-9bd9-f496ede1edce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:54.803482 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59797bfe-9cbe-447e-9bd9-f496ede1edce service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:54.808080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc66122-8f06-4efa-be12-0f0b1d4250e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:54.808711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc66122-8f06-4efa-be12-0f0b1d4250e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:54.808990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc66122-8f06-4efa-be12-0f0b1d4250e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:54.809264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc66122-8f06-4efa-be12-0f0b1d4250e0 admin admin] PATH_INFO: `/v3/users/c44adb0be9e044f7958a8c0ed6cfe535` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:54.810384 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc66122-8f06-4efa-be12-0f0b1d4250e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44adb0be9e044f7958a8c0ed6cfe535)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:54.812353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc66122-8f06-4efa-be12-0f0b1d4250e0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:54.857950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3bc66122-8f06-4efa-be12-0f0b1d4250e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44adb0be9e044f7958a8c0ed6cfe535'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:54.858604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3bc66122-8f06-4efa-be12-0f0b1d4250e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44adb0be9e044f7958a8c0ed6cfe535'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:54.865645 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3bc66122-8f06-4efa-be12-0f0b1d4250e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44adb0be9e044f7958a8c0ed6cfe535'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:54.866382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3bc66122-8f06-4efa-be12-0f0b1d4250e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44adb0be9e044f7958a8c0ed6cfe535'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:54.874113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3bc66122-8f06-4efa-be12-0f0b1d4250e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44adb0be9e044f7958a8c0ed6cfe535'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:54.891794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 955/1892] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:26:54 2022] DELETE /identity/v3/users/c44adb0be9e044f7958a8c0ed6cfe535 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:26:55.065402 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d8a8a-8421-400a-8f88-351bc8f0ba7a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:55.076618 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d8a8a-8421-400a-8f88-351bc8f0ba7a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:55.141340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744175ea-0cae-488c-a2d6-7c05f8dcb76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:55.141896 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744175ea-0cae-488c-a2d6-7c05f8dcb76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:55.142175 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744175ea-0cae-488c-a2d6-7c05f8dcb76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:55.142443 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744175ea-0cae-488c-a2d6-7c05f8dcb76b admin admin] PATH_INFO: `/v3/projects/337270e51c034e00ac753932b959e721` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:55.143672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744175ea-0cae-488c-a2d6-7c05f8dcb76b admin admin] RBAC: Authorizing `identity:delete_project(project_id=337270e51c034e00ac753932b959e721)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:55.145923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744175ea-0cae-488c-a2d6-7c05f8dcb76b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:55.190904 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-744175ea-0cae-488c-a2d6-7c05f8dcb76b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337270e51c034e00ac753932b959e721', 'request_id': 'req-744175ea-0cae-488c-a2d6-7c05f8dcb76b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:55.198112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-744175ea-0cae-488c-a2d6-7c05f8dcb76b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337270e51c034e00ac753932b959e721', 'request_id': 'req-744175ea-0cae-488c-a2d6-7c05f8dcb76b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:55.204466 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-744175ea-0cae-488c-a2d6-7c05f8dcb76b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337270e51c034e00ac753932b959e721', 'request_id': 'req-744175ea-0cae-488c-a2d6-7c05f8dcb76b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:55.215064 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-744175ea-0cae-488c-a2d6-7c05f8dcb76b admin admin] The token cache is being invalidate because project 337270e51c034e00ac753932b959e721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:26:55.215353 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-744175ea-0cae-488c-a2d6-7c05f8dcb76b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:55.216005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-744175ea-0cae-488c-a2d6-7c05f8dcb76b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:26:55.217576 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 938/1893] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:26:55 2022] DELETE /identity/v3/projects/337270e51c034e00ac753932b959e721 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:26:55.224111 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af03295-ac1b-48c6-85b8-e5dda4344a26 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:55.224518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af03295-ac1b-48c6-85b8-e5dda4344a26 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:55.225940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af03295-ac1b-48c6-85b8-e5dda4344a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:55.250840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3af03295-ac1b-48c6-85b8-e5dda4344a26 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:55.252171 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3af03295-ac1b-48c6-85b8-e5dda4344a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:55.324457 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 956/1894] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:26:55.331477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723aad3d-8115-4753-97d7-a4b3fd7169e1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:55.331790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723aad3d-8115-4753-97d7-a4b3fd7169e1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:55.332225 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723aad3d-8115-4753-97d7-a4b3fd7169e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:55.356687 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-723aad3d-8115-4753-97d7-a4b3fd7169e1 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:55.358024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-723aad3d-8115-4753-97d7-a4b3fd7169e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:55.372159 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 939/1895] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:26:55.373635 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af03295-ac1b-48c6-85b8-e5dda4344a26 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:55.387470 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af03295-ac1b-48c6-85b8-e5dda4344a26 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:55.392809 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b523883-cdfd-4bfc-ba51-07099b2d7fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:55.393371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b523883-cdfd-4bfc-ba51-07099b2d7fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:55.393676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b523883-cdfd-4bfc-ba51-07099b2d7fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:55.393949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b523883-cdfd-4bfc-ba51-07099b2d7fe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:55.394602 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b523883-cdfd-4bfc-ba51-07099b2d7fe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:26:55.394962 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b523883-cdfd-4bfc-ba51-07099b2d7fe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:55.396658 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b523883-cdfd-4bfc-ba51-07099b2d7fe5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:55.398365 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:55.415430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 957/1896] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:26:55.416441 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723aad3d-8115-4753-97d7-a4b3fd7169e1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:55.441627 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723aad3d-8115-4753-97d7-a4b3fd7169e1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:55.447564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813905d-b1c5-4570-8bec-0c7e3d19e130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:55.448399 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813905d-b1c5-4570-8bec-0c7e3d19e130 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:55.448996 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813905d-b1c5-4570-8bec-0c7e3d19e130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:55.449447 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813905d-b1c5-4570-8bec-0c7e3d19e130 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:55.451559 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813905d-b1c5-4570-8bec-0c7e3d19e130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:55.453565 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813905d-b1c5-4570-8bec-0c7e3d19e130 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:55.481393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:55.488876 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 940/1897] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:26:55 2022] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:26:55.494403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b523883-cdfd-4bfc-ba51-07099b2d7fe5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:55.507793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b523883-cdfd-4bfc-ba51-07099b2d7fe5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:55.582524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e1964-2012-4896-a0b6-91db79bbc3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:55.584151 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e1964-2012-4896-a0b6-91db79bbc3af admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:55.584588 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e1964-2012-4896-a0b6-91db79bbc3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:55.585025 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e1964-2012-4896-a0b6-91db79bbc3af admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:55.585716 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e1964-2012-4896-a0b6-91db79bbc3af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:55.587662 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e1964-2012-4896-a0b6-91db79bbc3af admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:55.613635 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 958/1898] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:26:55 2022] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:26:55.617983 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813905d-b1c5-4570-8bec-0c7e3d19e130 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:55.628986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813905d-b1c5-4570-8bec-0c7e3d19e130 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:55.634381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caacba-88a8-430e-bd8e-cc7335680fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:55.634993 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caacba-88a8-430e-bd8e-cc7335680fff admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:55.635275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caacba-88a8-430e-bd8e-cc7335680fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:55.635549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caacba-88a8-430e-bd8e-cc7335680fff admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:55.636230 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23caacba-88a8-430e-bd8e-cc7335680fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:55.637867 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23caacba-88a8-430e-bd8e-cc7335680fff admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:55.651832 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 941/1899] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:26:55.653194 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e1964-2012-4896-a0b6-91db79bbc3af admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:55.665292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e1964-2012-4896-a0b6-91db79bbc3af admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:55.671654 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5d85c-a2fd-44f0-b6ae-7a8ec61ab318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:55.672304 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5d85c-a2fd-44f0-b6ae-7a8ec61ab318 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:55.672583 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5d85c-a2fd-44f0-b6ae-7a8ec61ab318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:55.672857 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5d85c-a2fd-44f0-b6ae-7a8ec61ab318 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:55.673501 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5d85c-a2fd-44f0-b6ae-7a8ec61ab318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:55.675092 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5d85c-a2fd-44f0-b6ae-7a8ec61ab318 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:55.689846 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 959/1900] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:26:55.691584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caacba-88a8-430e-bd8e-cc7335680fff admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:55.703375 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caacba-88a8-430e-bd8e-cc7335680fff admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:55.708207 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7588f3a-a1ac-4e90-aaf2-024b9114ec51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:55.708878 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7588f3a-a1ac-4e90-aaf2-024b9114ec51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:55.709216 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7588f3a-a1ac-4e90-aaf2-024b9114ec51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:55.709427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7588f3a-a1ac-4e90-aaf2-024b9114ec51 admin admin] PATH_INFO: `/v3/projects/dafd5ed4d23a405ca0b27dd66aa4efc4/users/47a82f1357d0435ebb9b99c339e2e4f6/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:55.726703 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7588f3a-a1ac-4e90-aaf2-024b9114ec51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dafd5ed4d23a405ca0b27dd66aa4efc4, user_id=47a82f1357d0435ebb9b99c339e2e4f6, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:55.729382 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7588f3a-a1ac-4e90-aaf2-024b9114ec51 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:55.749708 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 942/1901] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:26:55 2022] PUT /identity/v3/projects/dafd5ed4d23a405ca0b27dd66aa4efc4/users/47a82f1357d0435ebb9b99c339e2e4f6/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:26:55.759669 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4fb9e-6268-4283-b3bf-fca5218e961f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:55.760256 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4fb9e-6268-4283-b3bf-fca5218e961f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:55.760256 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4fb9e-6268-4283-b3bf-fca5218e961f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:55.792620 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3ca4fb9e-6268-4283-b3bf-fca5218e961f None None] MFA Rules not processed for user `47a82f1357d0435ebb9b99c339e2e4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:26:55.794031 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3ca4fb9e-6268-4283-b3bf-fca5218e961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:55.861876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 960/1902] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:26:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:26:55.874335 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7588f3a-a1ac-4e90-aaf2-024b9114ec51 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:26:55.876224 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d7588f3a-a1ac-4e90-aaf2-024b9114ec51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:26:55.955904 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7588f3a-a1ac-4e90-aaf2-024b9114ec51 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:26:55.960269 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bc5d0-c788-4d0b-b7e7-7b8e0f07d14b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd5d41f6a16403f990a4cd5922a2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:26:55.960904 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bc5d0-c788-4d0b-b7e7-7b8e0f07d14b service glance] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:26:55.961214 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bc5d0-c788-4d0b-b7e7-7b8e0f07d14b service glance] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:26:55.961483 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bc5d0-c788-4d0b-b7e7-7b8e0f07d14b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:26:55.970073 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bc5d0-c788-4d0b-b7e7-7b8e0f07d14b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:26:55.971506 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bc5d0-c788-4d0b-b7e7-7b8e0f07d14b service glance] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:26:55.981319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 943/1903] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:26:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:27:04.765544 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4fb9e-6268-4283-b3bf-fca5218e961f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:27:04.767068 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3ca4fb9e-6268-4283-b3bf-fca5218e961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:27:04.829546 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4fb9e-6268-4283-b3bf-fca5218e961f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:27:04.833375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0442ea6-91ee-400d-8272-3348cb757d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:27:04.833988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0442ea6-91ee-400d-8272-3348cb757d53 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:04.834263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0442ea6-91ee-400d-8272-3348cb757d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:04.834530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0442ea6-91ee-400d-8272-3348cb757d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:04.836308 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d0442ea6-91ee-400d-8272-3348cb757d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:27:04.850884 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:04.901811 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0442ea6-91ee-400d-8272-3348cb757d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:27:04.903264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0442ea6-91ee-400d-8272-3348cb757d53 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:27:04.913104 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 961/1904] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:27:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:27:05.977510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=50,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:14.908668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=22 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:17.442762 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d4de8-913e-4022-b021-97e1c5a40af7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:17.443206 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d4de8-913e-4022-b021-97e1c5a40af7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:17.443315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d4de8-913e-4022-b021-97e1c5a40af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:17.463121 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d73d4de8-913e-4022-b021-97e1c5a40af7 None None] MFA Rules not processed for user `38b48da35205469abf5aa714dacfe6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:27:17.464393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d73d4de8-913e-4022-b021-97e1c5a40af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:27:17.517883 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 944/1905] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:27:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:27:26.423315 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0442ea6-91ee-400d-8272-3348cb757d53 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:27:26.488663 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0442ea6-91ee-400d-8272-3348cb757d53 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:27:26.494172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba494c-2d81-4a06-8dec-4f59d529eb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:27:26.494810 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba494c-2d81-4a06-8dec-4f59d529eb08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:26.495090 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba494c-2d81-4a06-8dec-4f59d529eb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:26.495368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba494c-2d81-4a06-8dec-4f59d529eb08 admin admin] PATH_INFO: `/v3/users/47a82f1357d0435ebb9b99c339e2e4f6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:26.496527 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba494c-2d81-4a06-8dec-4f59d529eb08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a82f1357d0435ebb9b99c339e2e4f6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:27:26.498463 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba494c-2d81-4a06-8dec-4f59d529eb08 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:27:26.545423 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-23ba494c-2d81-4a06-8dec-4f59d529eb08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a82f1357d0435ebb9b99c339e2e4f6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:26.546088 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-23ba494c-2d81-4a06-8dec-4f59d529eb08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a82f1357d0435ebb9b99c339e2e4f6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:26.553839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-23ba494c-2d81-4a06-8dec-4f59d529eb08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a82f1357d0435ebb9b99c339e2e4f6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:26.554653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-23ba494c-2d81-4a06-8dec-4f59d529eb08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a82f1357d0435ebb9b99c339e2e4f6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:26.561884 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-23ba494c-2d81-4a06-8dec-4f59d529eb08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a82f1357d0435ebb9b99c339e2e4f6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:26.579539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 962/1906] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:27:26 2022] DELETE /identity/v3/users/47a82f1357d0435ebb9b99c339e2e4f6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:27:26.584272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f87e3b-525d-4665-bdd9-19eb48a7a020 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:26.584753 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f87e3b-525d-4665-bdd9-19eb48a7a020 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:26.584855 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f87e3b-525d-4665-bdd9-19eb48a7a020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:26.603687 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-22f87e3b-525d-4665-bdd9-19eb48a7a020 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:27:26.604866 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-22f87e3b-525d-4665-bdd9-19eb48a7a020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:27:26.666179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 945/1907] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:27:26.676069 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba494c-2d81-4a06-8dec-4f59d529eb08 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:27:26.678042 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-23ba494c-2d81-4a06-8dec-4f59d529eb08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:27:26.733498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba494c-2d81-4a06-8dec-4f59d529eb08 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:27:26.737158 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748e072-e6ed-42b0-9fc7-505199cfa834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:27:26.737759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748e072-e6ed-42b0-9fc7-505199cfa834 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:26.738039 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748e072-e6ed-42b0-9fc7-505199cfa834 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:26.738316 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748e072-e6ed-42b0-9fc7-505199cfa834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:26.748132 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748e072-e6ed-42b0-9fc7-505199cfa834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:27:26.749566 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748e072-e6ed-42b0-9fc7-505199cfa834 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:27:26.759374 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 963/1908] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:27:27.030216 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f87e3b-525d-4665-bdd9-19eb48a7a020 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:27:27.031662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-22f87e3b-525d-4665-bdd9-19eb48a7a020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:27:27.045592 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f87e3b-525d-4665-bdd9-19eb48a7a020 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:27:27.050300 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83463eb3-633a-43d4-8be6-89fa65f53b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:27:27.051049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83463eb3-633a-43d4-8be6-89fa65f53b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:27.051331 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83463eb3-633a-43d4-8be6-89fa65f53b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:27.051604 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83463eb3-633a-43d4-8be6-89fa65f53b59 admin admin] PATH_INFO: `/v3/projects/dafd5ed4d23a405ca0b27dd66aa4efc4` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:27.054305 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83463eb3-633a-43d4-8be6-89fa65f53b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dafd5ed4d23a405ca0b27dd66aa4efc4)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:27:27.056689 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83463eb3-633a-43d4-8be6-89fa65f53b59 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:27:27.102902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-83463eb3-633a-43d4-8be6-89fa65f53b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dafd5ed4d23a405ca0b27dd66aa4efc4', 'request_id': 'req-83463eb3-633a-43d4-8be6-89fa65f53b59'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:27.110379 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-83463eb3-633a-43d4-8be6-89fa65f53b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dafd5ed4d23a405ca0b27dd66aa4efc4', 'request_id': 'req-83463eb3-633a-43d4-8be6-89fa65f53b59'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:27.117674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-83463eb3-633a-43d4-8be6-89fa65f53b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dafd5ed4d23a405ca0b27dd66aa4efc4', 'request_id': 'req-83463eb3-633a-43d4-8be6-89fa65f53b59'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:27.127884 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-83463eb3-633a-43d4-8be6-89fa65f53b59 admin admin] The token cache is being invalidate because project dafd5ed4d23a405ca0b27dd66aa4efc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:27:27.128199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-83463eb3-633a-43d4-8be6-89fa65f53b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:27.128829 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-83463eb3-633a-43d4-8be6-89fa65f53b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:27.130332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 946/1909] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:27:27 2022] DELETE /identity/v3/projects/dafd5ed4d23a405ca0b27dd66aa4efc4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:27:27.135254 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabde1c6-e4fb-44d8-840a-f63efb539750 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:27.135564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabde1c6-e4fb-44d8-840a-f63efb539750 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:27.135842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabde1c6-e4fb-44d8-840a-f63efb539750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:27.155182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-eabde1c6-e4fb-44d8-840a-f63efb539750 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:27:27.156331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-eabde1c6-e4fb-44d8-840a-f63efb539750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:27:27.173460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:27.216002 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 964/1910] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:27:27.225693 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a5a6c-ecc3-4900-86e3-7c125de31d59 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:27.225983 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a5a6c-ecc3-4900-86e3-7c125de31d59 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:27.226262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a5a6c-ecc3-4900-86e3-7c125de31d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:27.245737 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-795a5a6c-ecc3-4900-86e3-7c125de31d59 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:27:27.246934 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-795a5a6c-ecc3-4900-86e3-7c125de31d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:27:27.254850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 947/1911] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:27:27.259078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabde1c6-e4fb-44d8-840a-f63efb539750 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:27:27.269298 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabde1c6-e4fb-44d8-840a-f63efb539750 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:27:27.274730 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9699df8-e0c1-431f-bc82-1b2b0e4e4451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:27:27.275341 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9699df8-e0c1-431f-bc82-1b2b0e4e4451 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:27.275645 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9699df8-e0c1-431f-bc82-1b2b0e4e4451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:27.275916 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9699df8-e0c1-431f-bc82-1b2b0e4e4451 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:27.276597 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9699df8-e0c1-431f-bc82-1b2b0e4e4451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:27:27.276896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9699df8-e0c1-431f-bc82-1b2b0e4e4451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:27:27.278627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9699df8-e0c1-431f-bc82-1b2b0e4e4451 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:27:27.294563 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 965/1912] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:27:27.296097 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a5a6c-ecc3-4900-86e3-7c125de31d59 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:27:27.305526 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a5a6c-ecc3-4900-86e3-7c125de31d59 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:27:27.310219 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144e7e6-0a8a-4914-be1b-b0010c658e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:27:27.310927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144e7e6-0a8a-4914-be1b-b0010c658e5a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:27.311208 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144e7e6-0a8a-4914-be1b-b0010c658e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:27.311473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144e7e6-0a8a-4914-be1b-b0010c658e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:27.312207 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144e7e6-0a8a-4914-be1b-b0010c658e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:27:27.314092 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144e7e6-0a8a-4914-be1b-b0010c658e5a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:27:27.338410 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:27.348461 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 948/1913] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:27:27 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:27:27.353167 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9699df8-e0c1-431f-bc82-1b2b0e4e4451 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:27:27.364144 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9699df8-e0c1-431f-bc82-1b2b0e4e4451 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:27:27.420168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858685b5-b35f-4108-af42-101acab6a286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:27:27.420695 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858685b5-b35f-4108-af42-101acab6a286 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:27.420971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858685b5-b35f-4108-af42-101acab6a286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:27.421245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858685b5-b35f-4108-af42-101acab6a286 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:27.421873 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858685b5-b35f-4108-af42-101acab6a286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:27:27.423816 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858685b5-b35f-4108-af42-101acab6a286 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:27:27.446314 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 966/1914] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:27:27 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:27:27.450794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144e7e6-0a8a-4914-be1b-b0010c658e5a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:27:27.462362 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144e7e6-0a8a-4914-be1b-b0010c658e5a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:27:27.467336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78141e8-ee2b-46fe-8ad5-ddfd7c976c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:27:27.468029 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78141e8-ee2b-46fe-8ad5-ddfd7c976c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:27.468378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78141e8-ee2b-46fe-8ad5-ddfd7c976c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:27.468729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78141e8-ee2b-46fe-8ad5-ddfd7c976c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:27.469422 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78141e8-ee2b-46fe-8ad5-ddfd7c976c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:27:27.471196 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78141e8-ee2b-46fe-8ad5-ddfd7c976c8f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:27:27.482464 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 949/1915] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:27:27.486495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858685b5-b35f-4108-af42-101acab6a286 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:27:27.496938 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858685b5-b35f-4108-af42-101acab6a286 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:27:27.501769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bd3cf-739c-4e1e-8e9f-6a2395737981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:27:27.502368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bd3cf-739c-4e1e-8e9f-6a2395737981 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:27.502647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bd3cf-739c-4e1e-8e9f-6a2395737981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:27.502918 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bd3cf-739c-4e1e-8e9f-6a2395737981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:27.503562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bd3cf-739c-4e1e-8e9f-6a2395737981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:27:27.505231 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bd3cf-739c-4e1e-8e9f-6a2395737981 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:27:27.518968 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 967/1916] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:27:27.520127 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78141e8-ee2b-46fe-8ad5-ddfd7c976c8f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:27:27.531477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78141e8-ee2b-46fe-8ad5-ddfd7c976c8f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:27:27.536421 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f46d8-98b1-4dc2-a4db-8ea45c9d692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:27:27.537639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f46d8-98b1-4dc2-a4db-8ea45c9d692c admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:27.537916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f46d8-98b1-4dc2-a4db-8ea45c9d692c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:27.538187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f46d8-98b1-4dc2-a4db-8ea45c9d692c admin admin] PATH_INFO: `/v3/projects/ac15fe120a3843f08963029a06f453d5/users/3d87a04a797f4a33b3676f2043b3a1ee/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:27.553152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f46d8-98b1-4dc2-a4db-8ea45c9d692c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac15fe120a3843f08963029a06f453d5, user_id=3d87a04a797f4a33b3676f2043b3a1ee, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:27:27.555841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f46d8-98b1-4dc2-a4db-8ea45c9d692c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:27:27.570345 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 950/1917] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:27:27 2022] PUT /identity/v3/projects/ac15fe120a3843f08963029a06f453d5/users/3d87a04a797f4a33b3676f2043b3a1ee/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:27:27.580573 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645c30-821c-46e8-921c-d3a637f8638e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:27.580879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645c30-821c-46e8-921c-d3a637f8638e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:27.581156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645c30-821c-46e8-921c-d3a637f8638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:27.610698 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-03645c30-821c-46e8-921c-d3a637f8638e None None] MFA Rules not processed for user `3d87a04a797f4a33b3676f2043b3a1ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:27:27.611950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-03645c30-821c-46e8-921c-d3a637f8638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:27:27.677596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 968/1918] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:27:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:27:27.689194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f46d8-98b1-4dc2-a4db-8ea45c9d692c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:27:27.690867 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0b3f46d8-98b1-4dc2-a4db-8ea45c9d692c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:27:27.746616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f46d8-98b1-4dc2-a4db-8ea45c9d692c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:27:27.750250 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c34df-3e12-4127-b2bc-beb3e277f8f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:27:27.750845 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c34df-3e12-4127-b2bc-beb3e277f8f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:27.751125 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c34df-3e12-4127-b2bc-beb3e277f8f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:27.751395 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c34df-3e12-4127-b2bc-beb3e277f8f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:27.760049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c34df-3e12-4127-b2bc-beb3e277f8f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:27:27.761461 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c34df-3e12-4127-b2bc-beb3e277f8f3 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:27:27.770107 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 951/1919] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:27:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:27:37.674676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:37.766114 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:38.014151 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03645c30-821c-46e8-921c-d3a637f8638e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:27:38.090224 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03645c30-821c-46e8-921c-d3a637f8638e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:27:38.094782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201126ee-f3ee-443e-a06d-9f6a5708cad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:27:38.095419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201126ee-f3ee-443e-a06d-9f6a5708cad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:38.095698 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201126ee-f3ee-443e-a06d-9f6a5708cad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:38.096008 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201126ee-f3ee-443e-a06d-9f6a5708cad4 admin admin] PATH_INFO: `/v3/users/3d87a04a797f4a33b3676f2043b3a1ee` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:38.097154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201126ee-f3ee-443e-a06d-9f6a5708cad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d87a04a797f4a33b3676f2043b3a1ee)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:27:38.099087 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201126ee-f3ee-443e-a06d-9f6a5708cad4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:27:38.146990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-201126ee-f3ee-443e-a06d-9f6a5708cad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d87a04a797f4a33b3676f2043b3a1ee'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:38.147654 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-201126ee-f3ee-443e-a06d-9f6a5708cad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d87a04a797f4a33b3676f2043b3a1ee'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:38.154717 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-201126ee-f3ee-443e-a06d-9f6a5708cad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d87a04a797f4a33b3676f2043b3a1ee'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:38.155371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-201126ee-f3ee-443e-a06d-9f6a5708cad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d87a04a797f4a33b3676f2043b3a1ee'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:38.162845 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-201126ee-f3ee-443e-a06d-9f6a5708cad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d87a04a797f4a33b3676f2043b3a1ee'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:38.180595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 969/1920] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:27:38 2022] DELETE /identity/v3/users/3d87a04a797f4a33b3676f2043b3a1ee => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:27:38.185081 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc282f-658c-40f7-9dda-321f540244ab None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:38.185373 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc282f-658c-40f7-9dda-321f540244ab None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:38.185650 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc282f-658c-40f7-9dda-321f540244ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:38.206183 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-77bc282f-658c-40f7-9dda-321f540244ab None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:27:38.207368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-77bc282f-658c-40f7-9dda-321f540244ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:27:38.268032 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 952/1921] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:27:38.277982 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201126ee-f3ee-443e-a06d-9f6a5708cad4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:27:38.279532 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-201126ee-f3ee-443e-a06d-9f6a5708cad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:27:38.339389 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201126ee-f3ee-443e-a06d-9f6a5708cad4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:27:38.343235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09218dd-2c9b-4cca-add6-74e97913ea2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:27:38.343849 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09218dd-2c9b-4cca-add6-74e97913ea2c service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:38.344160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09218dd-2c9b-4cca-add6-74e97913ea2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:38.344429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09218dd-2c9b-4cca-add6-74e97913ea2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:38.354471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09218dd-2c9b-4cca-add6-74e97913ea2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:27:38.355921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09218dd-2c9b-4cca-add6-74e97913ea2c service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:27:38.365449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 970/1922] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:27:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:27:38.635033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc282f-658c-40f7-9dda-321f540244ab None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:27:38.636617 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-77bc282f-658c-40f7-9dda-321f540244ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:27:38.649087 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc282f-658c-40f7-9dda-321f540244ab None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:27:38.654481 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaaf01-43fb-4ae1-9491-ceae7667406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:27:38.655177 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaaf01-43fb-4ae1-9491-ceae7667406f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:38.655459 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaaf01-43fb-4ae1-9491-ceae7667406f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:38.655733 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaaf01-43fb-4ae1-9491-ceae7667406f admin admin] PATH_INFO: `/v3/projects/ac15fe120a3843f08963029a06f453d5` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:38.656905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbaaf01-43fb-4ae1-9491-ceae7667406f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac15fe120a3843f08963029a06f453d5)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:27:38.658861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbaaf01-43fb-4ae1-9491-ceae7667406f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:27:38.708933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cbaaf01-43fb-4ae1-9491-ceae7667406f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac15fe120a3843f08963029a06f453d5', 'request_id': 'req-2cbaaf01-43fb-4ae1-9491-ceae7667406f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:38.717496 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cbaaf01-43fb-4ae1-9491-ceae7667406f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac15fe120a3843f08963029a06f453d5', 'request_id': 'req-2cbaaf01-43fb-4ae1-9491-ceae7667406f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:38.724295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cbaaf01-43fb-4ae1-9491-ceae7667406f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac15fe120a3843f08963029a06f453d5', 'request_id': 'req-2cbaaf01-43fb-4ae1-9491-ceae7667406f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:38.735290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cbaaf01-43fb-4ae1-9491-ceae7667406f admin admin] The token cache is being invalidate because project ac15fe120a3843f08963029a06f453d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:27:38.735581 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cbaaf01-43fb-4ae1-9491-ceae7667406f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:38.736257 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cbaaf01-43fb-4ae1-9491-ceae7667406f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:27:38.737759 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 953/1923] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:27:38 2022] DELETE /identity/v3/projects/ac15fe120a3843f08963029a06f453d5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:27:48.361581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:48.732229 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:51.715546 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de01c2-a1b8-481f-93cf-866d87dfa131 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:51.716124 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de01c2-a1b8-481f-93cf-866d87dfa131 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:51.716224 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de01c2-a1b8-481f-93cf-866d87dfa131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:51.735716 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-33de01c2-a1b8-481f-93cf-866d87dfa131 None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:27:51.736960 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-33de01c2-a1b8-481f-93cf-866d87dfa131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:27:51.793098 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 971/1924] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 17 10:27:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:27:51.819972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaaf01-43fb-4ae1-9491-ceae7667406f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:27:51.821514 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2cbaaf01-43fb-4ae1-9491-ceae7667406f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:27:51.898788 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaaf01-43fb-4ae1-9491-ceae7667406f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:27:51.906033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fede13b-2f32-48a1-9d7e-34d70e33a068 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:27:51.906746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fede13b-2f32-48a1-9d7e-34d70e33a068 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:27:51.907154 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fede13b-2f32-48a1-9d7e-34d70e33a068 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:27:51.907430 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fede13b-2f32-48a1-9d7e-34d70e33a068 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:27:51.916865 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fede13b-2f32-48a1-9d7e-34d70e33a068 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:27:51.918418 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fede13b-2f32-48a1-9d7e-34d70e33a068 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:27:51.926617 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 954/1925] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:27:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 10:28:01.785105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=25 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:01.923280 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=32 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:04.229283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de01c2-a1b8-481f-93cf-866d87dfa131 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:28:04.230684 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-33de01c2-a1b8-481f-93cf-866d87dfa131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:28:04.298293 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de01c2-a1b8-481f-93cf-866d87dfa131 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:28:04.303346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88033f-27ae-4e6f-b815-189db47ae7a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd52eee25ef347e1ae905cc3cba17284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:28:04.303986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88033f-27ae-4e6f-b815-189db47ae7a5 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:28:04.304268 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88033f-27ae-4e6f-b815-189db47ae7a5 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:28:04.304536 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88033f-27ae-4e6f-b815-189db47ae7a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:28:04.306810 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ca88033f-27ae-4e6f-b815-189db47ae7a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:28:04.317685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88033f-27ae-4e6f-b815-189db47ae7a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:28:04.319242 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88033f-27ae-4e6f-b815-189db47ae7a5 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:28:04.329048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 972/1926] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:28:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:28:05.820701 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676c7f8-ffc4-4060-bb04-e9bec5e80a17 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:28:05.821259 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676c7f8-ffc4-4060-bb04-e9bec5e80a17 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:28:05.821259 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676c7f8-ffc4-4060-bb04-e9bec5e80a17 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:28:05.822694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 955/1927] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 17 10:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:28:05.828898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f55ef-af4f-43d9-b8d6-e461f5615464 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:28:05.829333 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f55ef-af4f-43d9-b8d6-e461f5615464 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:28:05.829431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f55ef-af4f-43d9-b8d6-e461f5615464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:28:05.848858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d85f55ef-af4f-43d9-b8d6-e461f5615464 None None] MFA Rules not processed for user `a80cc7ec3d2d49f88c81403f918a6900`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:28:05.850047 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d85f55ef-af4f-43d9-b8d6-e461f5615464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:28:05.918221 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 973/1928] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 17 10:28:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:28:05.931672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676c7f8-ffc4-4060-bb04-e9bec5e80a17 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:28:05.933561 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7676c7f8-ffc4-4060-bb04-e9bec5e80a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:28:05.995797 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676c7f8-ffc4-4060-bb04-e9bec5e80a17 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:28:05.999507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7976f-28d4-4b1e-b35e-94824e11aa9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd5d41f6a16403f990a4cd5922a2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:28:06.000155 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7976f-28d4-4b1e-b35e-94824e11aa9b service glance] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:28:06.000436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7976f-28d4-4b1e-b35e-94824e11aa9b service glance] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:28:06.000709 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7976f-28d4-4b1e-b35e-94824e11aa9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:28:06.010898 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7976f-28d4-4b1e-b35e-94824e11aa9b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:28:06.012369 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7976f-28d4-4b1e-b35e-94824e11aa9b service glance] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:28:06.022940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 956/1929] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:28:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:28:06.091027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0f147-b088-4943-bc79-133bac804d4e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:28:06.091245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0f147-b088-4943-bc79-133bac804d4e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:28:06.091514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0f147-b088-4943-bc79-133bac804d4e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:28:06.092931 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 974/1930] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 17 10:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:28:06.097938 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b363258-95ad-4dd6-b785-e6ef8aefabe9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:28:06.098283 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b363258-95ad-4dd6-b785-e6ef8aefabe9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:28:06.098555 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b363258-95ad-4dd6-b785-e6ef8aefabe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:28:06.119730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2b363258-95ad-4dd6-b785-e6ef8aefabe9 None None] MFA Rules not processed for user `98030e60807e44ec928488e904ca24c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:28:06.120970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2b363258-95ad-4dd6-b785-e6ef8aefabe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:28:06.171389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 957/1931] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 17 10:28:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:28:06.183155 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0f147-b088-4943-bc79-133bac804d4e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:28:06.184907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f1e0f147-b088-4943-bc79-133bac804d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:28:06.198200 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0f147-b088-4943-bc79-133bac804d4e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:28:06.201759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c568e0-e338-4203-8619-38655fd87cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:28:06.202356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c568e0-e338-4203-8619-38655fd87cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:28:06.202662 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c568e0-e338-4203-8619-38655fd87cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:28:06.203051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c568e0-e338-4203-8619-38655fd87cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:28:06.210100 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c568e0-e338-4203-8619-38655fd87cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:28:06.211521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c568e0-e338-4203-8619-38655fd87cc3 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:28:06.219759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 975/1932] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:28:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:28:06.300197 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f42178-e8e8-4464-b7d4-dd27e73167da None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:28:06.300489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f42178-e8e8-4464-b7d4-dd27e73167da None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:28:06.300768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f42178-e8e8-4464-b7d4-dd27e73167da None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:28:06.302129 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 958/1933] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 17 10:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:28:06.307420 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea2726-69a7-4068-a7f4-030060849119 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:28:06.307705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea2726-69a7-4068-a7f4-030060849119 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:28:06.308002 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea2726-69a7-4068-a7f4-030060849119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:28:06.327445 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c4ea2726-69a7-4068-a7f4-030060849119 None None] MFA Rules not processed for user `a80cc7ec3d2d49f88c81403f918a6900`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:28:06.328692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c4ea2726-69a7-4068-a7f4-030060849119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:28:06.338470 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 976/1934] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 17 10:28:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:28:06.348847 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f42178-e8e8-4464-b7d4-dd27e73167da None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:28:06.360412 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f42178-e8e8-4464-b7d4-dd27e73167da None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:28:06.363947 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d63e6d-641a-4245-a854-5385afa75015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:28:06.364541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d63e6d-641a-4245-a854-5385afa75015 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:28:06.364817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d63e6d-641a-4245-a854-5385afa75015 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:28:06.365086 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d63e6d-641a-4245-a854-5385afa75015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:28:06.375115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d63e6d-641a-4245-a854-5385afa75015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:28:06.376571 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d63e6d-641a-4245-a854-5385afa75015 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:28:06.386872 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 959/1935] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:28:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:28:08.924067 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e940fe-6f24-46f0-8289-d324a4a0d167 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:28:08.924531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e940fe-6f24-46f0-8289-d324a4a0d167 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:28:08.924646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e940fe-6f24-46f0-8289-d324a4a0d167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:28:08.945033 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-70e940fe-6f24-46f0-8289-d324a4a0d167 None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:28:08.946242 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-70e940fe-6f24-46f0-8289-d324a4a0d167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:28:08.953302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 977/1936] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 17 10:28:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:28:08.965210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d63e6d-641a-4245-a854-5385afa75015 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:28:08.976431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d63e6d-641a-4245-a854-5385afa75015 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:28:08.981878 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39debe-f887-45b3-93d3-1363f79da58f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:28:08.982465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39debe-f887-45b3-93d3-1363f79da58f service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:28:08.982741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39debe-f887-45b3-93d3-1363f79da58f service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:28:08.983010 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39debe-f887-45b3-93d3-1363f79da58f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:28:08.990837 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39debe-f887-45b3-93d3-1363f79da58f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:28:08.992424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39debe-f887-45b3-93d3-1363f79da58f service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:28:09.001302 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 960/1937] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:28:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 10:28:18.939646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=75 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:18.997964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=61 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:31.897495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149da5bf-7a12-446c-b515-ebaae693c557 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:28:31.897990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149da5bf-7a12-446c-b515-ebaae693c557 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:28:31.898099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149da5bf-7a12-446c-b515-ebaae693c557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:28:31.917388 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-149da5bf-7a12-446c-b515-ebaae693c557 None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:28:31.919143 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-149da5bf-7a12-446c-b515-ebaae693c557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:28:31.926407 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 978/1938] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 17 10:28:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:28:31.938880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39debe-f887-45b3-93d3-1363f79da58f service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:28:31.950033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39debe-f887-45b3-93d3-1363f79da58f service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:28:31.955274 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6c948-7fb3-4a2f-ab9a-a3333fb6f2f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:28:31.956076 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6c948-7fb3-4a2f-ab9a-a3333fb6f2f9 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:28:31.956426 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6c948-7fb3-4a2f-ab9a-a3333fb6f2f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:28:31.956772 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6c948-7fb3-4a2f-ab9a-a3333fb6f2f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:28:31.965878 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6c948-7fb3-4a2f-ab9a-a3333fb6f2f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:28:31.967462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6c948-7fb3-4a2f-ab9a-a3333fb6f2f9 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:28:31.975808 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 961/1939] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:28:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 10:28:41.911876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:41.972382 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:10.034862 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57c419-eb8e-432e-949d-a6e6826be7c3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:29:10.035396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57c419-eb8e-432e-949d-a6e6826be7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:29:10.035396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57c419-eb8e-432e-949d-a6e6826be7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:29:10.054485 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3c57c419-eb8e-432e-949d-a6e6826be7c3 None None] MFA Rules not processed for user `b8532a4cfb224d75aab98dddf1dcd0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:29:10.055679 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3c57c419-eb8e-432e-949d-a6e6826be7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:29:10.109226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 979/1940] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:29:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:29:20.101971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=25 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:31.944968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bae7a-ecf9-4dda-8dd2-4765387a3d99 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:29:31.945907 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bae7a-ecf9-4dda-8dd2-4765387a3d99 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:29:31.946187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bae7a-ecf9-4dda-8dd2-4765387a3d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:29:31.964713 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-320bae7a-ecf9-4dda-8dd2-4765387a3d99 None None] MFA Rules not processed for user `38b48da35205469abf5aa714dacfe6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:29:31.965902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-320bae7a-ecf9-4dda-8dd2-4765387a3d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:29:32.019701 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 962/1941] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:29:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:29:35.043430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57c419-eb8e-432e-949d-a6e6826be7c3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:29:35.044909 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3c57c419-eb8e-432e-949d-a6e6826be7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:29:35.069158 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57c419-eb8e-432e-949d-a6e6826be7c3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:29:35.073979 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fa5d2-0221-4aca-8f8d-42b316ec49f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:29:35.074698 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fa5d2-0221-4aca-8f8d-42b316ec49f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:29:35.074962 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fa5d2-0221-4aca-8f8d-42b316ec49f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:29:35.075234 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fa5d2-0221-4aca-8f8d-42b316ec49f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:29:35.077115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-376fa5d2-0221-4aca-8f8d-42b316ec49f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:29:35.091541 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fa5d2-0221-4aca-8f8d-42b316ec49f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:29:35.092996 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fa5d2-0221-4aca-8f8d-42b316ec49f0 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:29:35.104690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 980/1942] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:29:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:29:37.449531 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bae7a-ecf9-4dda-8dd2-4765387a3d99 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:29:37.459580 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bae7a-ecf9-4dda-8dd2-4765387a3d99 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:29:37.463289 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5bc24-c0be-4d8d-93c6-1d4801376998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:29:37.464019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5bc24-c0be-4d8d-93c6-1d4801376998 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:29:37.464303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5bc24-c0be-4d8d-93c6-1d4801376998 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:29:37.464577 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5bc24-c0be-4d8d-93c6-1d4801376998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:29:37.466379 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9db5bc24-c0be-4d8d-93c6-1d4801376998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:29:37.479639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5bc24-c0be-4d8d-93c6-1d4801376998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:29:37.481177 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5bc24-c0be-4d8d-93c6-1d4801376998 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:29:37.492576 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 963/1943] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:29:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:29:45.099636 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:47.487507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=31 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:48.776858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd90e31-fa5a-4706-ad14-c5f70c37d90e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:29:48.777375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd90e31-fa5a-4706-ad14-c5f70c37d90e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:29:48.777478 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd90e31-fa5a-4706-ad14-c5f70c37d90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:29:48.796569 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7fd90e31-fa5a-4706-ad14-c5f70c37d90e None None] MFA Rules not processed for user `9bc07aa85f5643cfb89280a136496619`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:29:48.797769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7fd90e31-fa5a-4706-ad14-c5f70c37d90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:29:48.852056 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 981/1944] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:29:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:29:57.620780 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5bc24-c0be-4d8d-93c6-1d4801376998 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:29:57.622392 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9db5bc24-c0be-4d8d-93c6-1d4801376998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:29:57.636775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5bc24-c0be-4d8d-93c6-1d4801376998 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:29:57.642253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd261ec-f114-4f77-b350-70e03b89937b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:29:57.642844 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd261ec-f114-4f77-b350-70e03b89937b service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:29:57.643138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd261ec-f114-4f77-b350-70e03b89937b service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:29:57.643408 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd261ec-f114-4f77-b350-70e03b89937b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:29:57.645138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1cd261ec-f114-4f77-b350-70e03b89937b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:29:57.655610 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd261ec-f114-4f77-b350-70e03b89937b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:29:57.657220 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd261ec-f114-4f77-b350-70e03b89937b service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:29:57.666919 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 964/1945] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:29:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:29:58.845445 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=25 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:07.662717 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:19.637572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd90e31-fa5a-4706-ad14-c5f70c37d90e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:19.638968 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7fd90e31-fa5a-4706-ad14-c5f70c37d90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:19.696737 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd90e31-fa5a-4706-ad14-c5f70c37d90e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:19.700321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066ec06-74cc-4676-a994-d1668d6429ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:19.700924 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066ec06-74cc-4676-a994-d1668d6429ae service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:19.701201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066ec06-74cc-4676-a994-d1668d6429ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:19.701471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066ec06-74cc-4676-a994-d1668d6429ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:19.703167 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6066ec06-74cc-4676-a994-d1668d6429ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:19.714201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066ec06-74cc-4676-a994-d1668d6429ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:19.715612 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066ec06-74cc-4676-a994-d1668d6429ae service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:19.724903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 982/1946] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:30:19 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:30:21.034365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd261ec-f114-4f77-b350-70e03b89937b service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:21.045752 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd261ec-f114-4f77-b350-70e03b89937b service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:21.061619 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0080a-3986-4b9a-a2b8-6d7d6adcda82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:21.062418 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0080a-3986-4b9a-a2b8-6d7d6adcda82 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:21.062742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0080a-3986-4b9a-a2b8-6d7d6adcda82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:21.063105 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0080a-3986-4b9a-a2b8-6d7d6adcda82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:21.070168 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3ef0080a-3986-4b9a-a2b8-6d7d6adcda82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:21.080888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0080a-3986-4b9a-a2b8-6d7d6adcda82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:21.082476 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0080a-3986-4b9a-a2b8-6d7d6adcda82 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:21.101719 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 965/1947] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:30:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:30:27.521833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066ec06-74cc-4676-a994-d1668d6429ae service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:27.523391 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6066ec06-74cc-4676-a994-d1668d6429ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:27.545361 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066ec06-74cc-4676-a994-d1668d6429ae service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:27.552565 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e6aa8-8e77-44ff-adff-be4082150305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:27.553452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6aa8-8e77-44ff-adff-be4082150305 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:27.553941 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6aa8-8e77-44ff-adff-be4082150305 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:27.554434 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6aa8-8e77-44ff-adff-be4082150305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:27.556357 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fb7e6aa8-8e77-44ff-adff-be4082150305 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:27.571008 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e6aa8-8e77-44ff-adff-be4082150305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:27.573462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e6aa8-8e77-44ff-adff-be4082150305 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:27.592014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 983/1948] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:30:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:30:28.333760 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0080a-3986-4b9a-a2b8-6d7d6adcda82 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:28.347333 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0080a-3986-4b9a-a2b8-6d7d6adcda82 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:28.352781 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f0b77-1711-4c59-b1eb-efc5354ad018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:28.353674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f0b77-1711-4c59-b1eb-efc5354ad018 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:28.353963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f0b77-1711-4c59-b1eb-efc5354ad018 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:28.354239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f0b77-1711-4c59-b1eb-efc5354ad018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:28.358161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-229f0b77-1711-4c59-b1eb-efc5354ad018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:28.389321 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f0b77-1711-4c59-b1eb-efc5354ad018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:28.393535 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f0b77-1711-4c59-b1eb-efc5354ad018 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:28.413500 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e6aa8-8e77-44ff-adff-be4082150305 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:28.434308 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e6aa8-8e77-44ff-adff-be4082150305 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:28.442198 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae0af7-be05-4e00-ab0c-6cbeca673774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:28.443092 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae0af7-be05-4e00-ab0c-6cbeca673774 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:28.443838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 966/1949] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:30:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:30:28.454668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae0af7-be05-4e00-ab0c-6cbeca673774 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:28.455275 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae0af7-be05-4e00-ab0c-6cbeca673774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:28.462161 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2cae0af7-be05-4e00-ab0c-6cbeca673774 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:28.479741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae0af7-be05-4e00-ab0c-6cbeca673774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:28.482047 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae0af7-be05-4e00-ab0c-6cbeca673774 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:28.510460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 984/1950] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:30:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:30:28.637222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066e244-9388-4bae-a9c1-aac5384c3491 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:28.638189 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066e244-9388-4bae-a9c1-aac5384c3491 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:28.638567 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066e244-9388-4bae-a9c1-aac5384c3491 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:28.640041 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 967/1951] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 17 10:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:30:28.648547 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130e011-3273-493b-bcde-ecc3c31c8748 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:28.649077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130e011-3273-493b-bcde-ecc3c31c8748 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:28.649316 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130e011-3273-493b-bcde-ecc3c31c8748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:28.675051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9130e011-3273-493b-bcde-ecc3c31c8748 None None] MFA Rules not processed for user `98030e60807e44ec928488e904ca24c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:30:28.676385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9130e011-3273-493b-bcde-ecc3c31c8748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:28.685186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 985/1952] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 17 10:30:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:30:28.698273 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066e244-9388-4bae-a9c1-aac5384c3491 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:28.714164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066e244-9388-4bae-a9c1-aac5384c3491 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:28.719424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c450729-b9ea-47ab-9ef2-57bc31a38ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:28.720327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c450729-b9ea-47ab-9ef2-57bc31a38ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:28.721098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c450729-b9ea-47ab-9ef2-57bc31a38ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:28.721501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c450729-b9ea-47ab-9ef2-57bc31a38ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:28.732840 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c450729-b9ea-47ab-9ef2-57bc31a38ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:28.734862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c450729-b9ea-47ab-9ef2-57bc31a38ec4 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:28.746848 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 968/1953] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:30:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:30:28.841468 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66faebb-6ccc-413e-bbf8-03c247ac8d4b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:28.841825 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66faebb-6ccc-413e-bbf8-03c247ac8d4b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:28.842184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66faebb-6ccc-413e-bbf8-03c247ac8d4b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:28.843636 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 986/1954] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 17 10:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:30:28.849081 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81694d94-6d6f-458d-9da0-4f5e9425754c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:28.849481 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81694d94-6d6f-458d-9da0-4f5e9425754c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:28.849862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81694d94-6d6f-458d-9da0-4f5e9425754c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:28.872419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-81694d94-6d6f-458d-9da0-4f5e9425754c None None] MFA Rules not processed for user `a80cc7ec3d2d49f88c81403f918a6900`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:30:28.873805 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-81694d94-6d6f-458d-9da0-4f5e9425754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:28.883391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 969/1955] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 17 10:30:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:30:28.895399 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66faebb-6ccc-413e-bbf8-03c247ac8d4b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:28.906987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66faebb-6ccc-413e-bbf8-03c247ac8d4b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:28.910591 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0263e7-d43c-4b9f-89a9-5538070573a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:28.911199 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0263e7-d43c-4b9f-89a9-5538070573a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:28.911477 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0263e7-d43c-4b9f-89a9-5538070573a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:28.911747 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0263e7-d43c-4b9f-89a9-5538070573a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:28.923233 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0263e7-d43c-4b9f-89a9-5538070573a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:28.924720 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0263e7-d43c-4b9f-89a9-5538070573a1 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:28.937350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 987/1956] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:30:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:30:29.000691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81694d94-6d6f-458d-9da0-4f5e9425754c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:29.012457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81694d94-6d6f-458d-9da0-4f5e9425754c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:29.018143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d15a7-c265-48c8-be04-25c70c049871 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd52eee25ef347e1ae905cc3cba17284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:29.018842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d15a7-c265-48c8-be04-25c70c049871 service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:29.019127 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d15a7-c265-48c8-be04-25c70c049871 service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:29.019400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d15a7-c265-48c8-be04-25c70c049871 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:29.021446 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-282d15a7-c265-48c8-be04-25c70c049871 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:29.034928 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d15a7-c265-48c8-be04-25c70c049871 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:29.036376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d15a7-c265-48c8-be04-25c70c049871 service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:29.046981 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 970/1957] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:30:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:30:38.931523 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=47 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:39.042223 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=27 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:42.863298 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0263e7-d43c-4b9f-89a9-5538070573a1 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:42.885650 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0263e7-d43c-4b9f-89a9-5538070573a1 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:42.896124 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26abd9a-18ae-4e0a-9753-b8f08e869f78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:42.896649 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26abd9a-18ae-4e0a-9753-b8f08e869f78 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:42.897363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26abd9a-18ae-4e0a-9753-b8f08e869f78 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:42.897805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26abd9a-18ae-4e0a-9753-b8f08e869f78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:42.901673 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b26abd9a-18ae-4e0a-9753-b8f08e869f78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:42.916932 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26abd9a-18ae-4e0a-9753-b8f08e869f78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:42.921457 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26abd9a-18ae-4e0a-9753-b8f08e869f78 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:42.934463 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 988/1958] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:30:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:30:44.482754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d15a7-c265-48c8-be04-25c70c049871 service placement] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:44.492236 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d15a7-c265-48c8-be04-25c70c049871 service placement] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:44.495800 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570026a-99aa-4ce5-b658-5470ec0cd1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:44.496425 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570026a-99aa-4ce5-b658-5470ec0cd1df service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:44.496704 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570026a-99aa-4ce5-b658-5470ec0cd1df service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:44.496981 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570026a-99aa-4ce5-b658-5470ec0cd1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:44.499122 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4570026a-99aa-4ce5-b658-5470ec0cd1df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:44.569332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570026a-99aa-4ce5-b658-5470ec0cd1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:44.570850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570026a-99aa-4ce5-b658-5470ec0cd1df service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:44.580898 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 971/1959] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:30:47.674433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26abd9a-18ae-4e0a-9753-b8f08e869f78 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:47.675997 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b26abd9a-18ae-4e0a-9753-b8f08e869f78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:47.698302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26abd9a-18ae-4e0a-9753-b8f08e869f78 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:47.703440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08582383-3301-43c6-98dc-f45266bc3a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:47.704456 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582383-3301-43c6-98dc-f45266bc3a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:47.704745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582383-3301-43c6-98dc-f45266bc3a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:47.705020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582383-3301-43c6-98dc-f45266bc3a8c admin admin] PATH_INFO: `/v3/users/b8532a4cfb224d75aab98dddf1dcd0fb` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:47.706203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08582383-3301-43c6-98dc-f45266bc3a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8532a4cfb224d75aab98dddf1dcd0fb)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:47.708234 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08582383-3301-43c6-98dc-f45266bc3a8c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:47.768570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-08582383-3301-43c6-98dc-f45266bc3a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8532a4cfb224d75aab98dddf1dcd0fb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:47.769240 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-08582383-3301-43c6-98dc-f45266bc3a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8532a4cfb224d75aab98dddf1dcd0fb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:47.776970 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-08582383-3301-43c6-98dc-f45266bc3a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8532a4cfb224d75aab98dddf1dcd0fb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:47.778334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-08582383-3301-43c6-98dc-f45266bc3a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8532a4cfb224d75aab98dddf1dcd0fb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:47.787180 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-08582383-3301-43c6-98dc-f45266bc3a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8532a4cfb224d75aab98dddf1dcd0fb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:47.805455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 989/1960] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:30:47 2022] DELETE /identity/v3/users/b8532a4cfb224d75aab98dddf1dcd0fb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:30:48.002102 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570026a-99aa-4ce5-b658-5470ec0cd1df service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:48.014527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570026a-99aa-4ce5-b658-5470ec0cd1df service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:48.091585 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a06616-2ae0-4bd3-b753-c20978c771df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:48.092332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a06616-2ae0-4bd3-b753-c20978c771df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:48.092603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a06616-2ae0-4bd3-b753-c20978c771df admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:48.092877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a06616-2ae0-4bd3-b753-c20978c771df admin admin] PATH_INFO: `/v3/projects/9d5fb5e955514f76b48b44fd9bf9f2d7` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:48.094027 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a06616-2ae0-4bd3-b753-c20978c771df admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5fb5e955514f76b48b44fd9bf9f2d7)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:48.095955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a06616-2ae0-4bd3-b753-c20978c771df admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:48.144933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c2a06616-2ae0-4bd3-b753-c20978c771df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5fb5e955514f76b48b44fd9bf9f2d7', 'request_id': 'req-c2a06616-2ae0-4bd3-b753-c20978c771df'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:48.153546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c2a06616-2ae0-4bd3-b753-c20978c771df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5fb5e955514f76b48b44fd9bf9f2d7', 'request_id': 'req-c2a06616-2ae0-4bd3-b753-c20978c771df'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:48.162961 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c2a06616-2ae0-4bd3-b753-c20978c771df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5fb5e955514f76b48b44fd9bf9f2d7', 'request_id': 'req-c2a06616-2ae0-4bd3-b753-c20978c771df'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:48.174537 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c2a06616-2ae0-4bd3-b753-c20978c771df admin admin] The token cache is being invalidate because project 9d5fb5e955514f76b48b44fd9bf9f2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:30:48.174827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c2a06616-2ae0-4bd3-b753-c20978c771df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:48.175597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c2a06616-2ae0-4bd3-b753-c20978c771df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:48.177146 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 972/1961] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:30:48 2022] DELETE /identity/v3/projects/9d5fb5e955514f76b48b44fd9bf9f2d7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:30:48.182096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae5ed6-4e95-49cf-82b4-7034d1627de4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:48.182392 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae5ed6-4e95-49cf-82b4-7034d1627de4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:48.182685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae5ed6-4e95-49cf-82b4-7034d1627de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:48.203603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c4ae5ed6-4e95-49cf-82b4-7034d1627de4 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:30:48.204853 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c4ae5ed6-4e95-49cf-82b4-7034d1627de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:48.267478 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 990/1962] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:30:48.274786 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ae74d-83c7-4f55-880d-c5b1a83d35bb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:48.275066 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ae74d-83c7-4f55-880d-c5b1a83d35bb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:48.275338 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ae74d-83c7-4f55-880d-c5b1a83d35bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:48.295565 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-df2ae74d-83c7-4f55-880d-c5b1a83d35bb None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:30:48.296975 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-df2ae74d-83c7-4f55-880d-c5b1a83d35bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:48.305371 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 973/1963] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:30:48.310220 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae5ed6-4e95-49cf-82b4-7034d1627de4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:48.320255 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae5ed6-4e95-49cf-82b4-7034d1627de4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:48.325755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbde9c8-cd2a-4751-9fe1-2246ca076a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:48.326377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbde9c8-cd2a-4751-9fe1-2246ca076a5c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:48.326658 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbde9c8-cd2a-4751-9fe1-2246ca076a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:48.326937 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbde9c8-cd2a-4751-9fe1-2246ca076a5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:48.327593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbde9c8-cd2a-4751-9fe1-2246ca076a5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:30:48.327949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbde9c8-cd2a-4751-9fe1-2246ca076a5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:48.329559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbde9c8-cd2a-4751-9fe1-2246ca076a5c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:48.341730 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 991/1964] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:30:48.346080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ae74d-83c7-4f55-880d-c5b1a83d35bb None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:48.355312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ae74d-83c7-4f55-880d-c5b1a83d35bb None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:48.360221 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b5f39-d581-4788-a459-fc2bf9a89a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:48.360818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b5f39-d581-4788-a459-fc2bf9a89a28 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:48.361091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b5f39-d581-4788-a459-fc2bf9a89a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:48.361358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b5f39-d581-4788-a459-fc2bf9a89a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:48.362301 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b5f39-d581-4788-a459-fc2bf9a89a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:48.364230 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b5f39-d581-4788-a459-fc2bf9a89a28 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:48.382659 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:48.396717 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 974/1965] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:30:48 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:30:48.400954 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbde9c8-cd2a-4751-9fe1-2246ca076a5c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:48.413226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbde9c8-cd2a-4751-9fe1-2246ca076a5c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:48.457787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:48.473991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6f1c6-8f67-4477-97f0-a6c6772701c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:48.474616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6f1c6-8f67-4477-97f0-a6c6772701c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:48.474901 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6f1c6-8f67-4477-97f0-a6c6772701c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:48.475177 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6f1c6-8f67-4477-97f0-a6c6772701c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:48.475834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6f1c6-8f67-4477-97f0-a6c6772701c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:48.477808 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6f1c6-8f67-4477-97f0-a6c6772701c4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:48.501451 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 992/1966] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:30:48 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:30:48.505317 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b5f39-d581-4788-a459-fc2bf9a89a28 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:48.516281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b5f39-d581-4788-a459-fc2bf9a89a28 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:48.522001 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4b8e7-6527-4e85-9088-1ed8a366c938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:48.522685 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4b8e7-6527-4e85-9088-1ed8a366c938 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:48.522963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4b8e7-6527-4e85-9088-1ed8a366c938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:48.523233 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4b8e7-6527-4e85-9088-1ed8a366c938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:48.523880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4b8e7-6527-4e85-9088-1ed8a366c938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:48.525500 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4b8e7-6527-4e85-9088-1ed8a366c938 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:48.535893 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 975/1967] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:30:48.540064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6f1c6-8f67-4477-97f0-a6c6772701c4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:48.551324 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6f1c6-8f67-4477-97f0-a6c6772701c4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:48.556927 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa32da-15da-43ac-a306-5c648d904b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:48.557536 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa32da-15da-43ac-a306-5c648d904b9f admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:48.557802 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa32da-15da-43ac-a306-5c648d904b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:48.558075 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa32da-15da-43ac-a306-5c648d904b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:48.559256 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa32da-15da-43ac-a306-5c648d904b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:48.560866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa32da-15da-43ac-a306-5c648d904b9f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:48.571842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 993/1968] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:30:48.576283 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4b8e7-6527-4e85-9088-1ed8a366c938 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:48.587230 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4b8e7-6527-4e85-9088-1ed8a366c938 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:48.592107 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa568d-6efb-495f-92e3-51bd3f89fee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:48.592758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa568d-6efb-495f-92e3-51bd3f89fee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:48.593037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa568d-6efb-495f-92e3-51bd3f89fee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:48.593307 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa568d-6efb-495f-92e3-51bd3f89fee2 admin admin] PATH_INFO: `/v3/projects/6616c5509b7247158a2121c278503745/users/8ead4b3615834f8397099e44f74ebac0/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:48.609108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa568d-6efb-495f-92e3-51bd3f89fee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6616c5509b7247158a2121c278503745, user_id=8ead4b3615834f8397099e44f74ebac0, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:48.611821 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa568d-6efb-495f-92e3-51bd3f89fee2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:48.626453 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 976/1969] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:30:48 2022] PUT /identity/v3/projects/6616c5509b7247158a2121c278503745/users/8ead4b3615834f8397099e44f74ebac0/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:30:48.637376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea584e5-8861-44b4-876e-a72b08b881b3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:48.637660 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea584e5-8861-44b4-876e-a72b08b881b3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:48.637929 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea584e5-8861-44b4-876e-a72b08b881b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:48.667756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cea584e5-8861-44b4-876e-a72b08b881b3 None None] MFA Rules not processed for user `8ead4b3615834f8397099e44f74ebac0`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:30:48.669031 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cea584e5-8861-44b4-876e-a72b08b881b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:48.735983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 994/1970] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:30:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:30:48.740417 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa568d-6efb-495f-92e3-51bd3f89fee2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:48.811533 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa568d-6efb-495f-92e3-51bd3f89fee2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:48.816419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca5251-44d2-4727-b5b7-387e49ab4829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:48.817023 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca5251-44d2-4727-b5b7-387e49ab4829 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:48.817305 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca5251-44d2-4727-b5b7-387e49ab4829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:48.817577 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca5251-44d2-4727-b5b7-387e49ab4829 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:48.818211 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca5251-44d2-4727-b5b7-387e49ab4829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:48.820146 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca5251-44d2-4727-b5b7-387e49ab4829 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:48.849245 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 977/1971] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:30:48 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:30:48.853209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea584e5-8861-44b4-876e-a72b08b881b3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:48.864676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea584e5-8861-44b4-876e-a72b08b881b3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:48.923154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfe70b-5c41-4bb5-a70d-59a2d2e7cd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:48.923879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfe70b-5c41-4bb5-a70d-59a2d2e7cd78 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:48.924032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfe70b-5c41-4bb5-a70d-59a2d2e7cd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:48.924268 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfe70b-5c41-4bb5-a70d-59a2d2e7cd78 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:48.925382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfe70b-5c41-4bb5-a70d-59a2d2e7cd78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:48.927346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfe70b-5c41-4bb5-a70d-59a2d2e7cd78 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:48.950848 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 995/1972] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:30:48 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:30:48.956366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca5251-44d2-4727-b5b7-387e49ab4829 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:48.967465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca5251-44d2-4727-b5b7-387e49ab4829 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:48.972284 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb6498-4532-44d1-8521-02482970225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:48.972890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb6498-4532-44d1-8521-02482970225e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:48.973183 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb6498-4532-44d1-8521-02482970225e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:48.973433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb6498-4532-44d1-8521-02482970225e admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:48.974078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb6498-4532-44d1-8521-02482970225e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:48.975670 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb6498-4532-44d1-8521-02482970225e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:48.987371 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 978/1973] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:30:48.991683 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfe70b-5c41-4bb5-a70d-59a2d2e7cd78 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:49.002576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfe70b-5c41-4bb5-a70d-59a2d2e7cd78 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:49.007793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56a178-f7bf-49fd-a339-e3e41c0a43fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:49.008543 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56a178-f7bf-49fd-a339-e3e41c0a43fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:49.008834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56a178-f7bf-49fd-a339-e3e41c0a43fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:49.009117 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56a178-f7bf-49fd-a339-e3e41c0a43fc admin admin] PATH_INFO: `/v3/projects/5806753e517a4a29afb5232c312d2777/users/79b356a91b864e00a231b8f9c7bbbb25/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:49.024175 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56a178-f7bf-49fd-a339-e3e41c0a43fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5806753e517a4a29afb5232c312d2777, user_id=79b356a91b864e00a231b8f9c7bbbb25, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:49.026848 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56a178-f7bf-49fd-a339-e3e41c0a43fc admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:49.042025 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 996/1974] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:30:48 2022] PUT /identity/v3/projects/5806753e517a4a29afb5232c312d2777/users/79b356a91b864e00a231b8f9c7bbbb25/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:30:49.046745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb6498-4532-44d1-8521-02482970225e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:49.056874 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb6498-4532-44d1-8521-02482970225e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:49.116579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85df88-f7d0-4dcc-a7ad-b0ff19c92cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:49.117191 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85df88-f7d0-4dcc-a7ad-b0ff19c92cca admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:49.117473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85df88-f7d0-4dcc-a7ad-b0ff19c92cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:49.117748 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85df88-f7d0-4dcc-a7ad-b0ff19c92cca admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:49.118388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85df88-f7d0-4dcc-a7ad-b0ff19c92cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:49.120021 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85df88-f7d0-4dcc-a7ad-b0ff19c92cca admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:49.130063 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 979/1975] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:30:49.134414 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56a178-f7bf-49fd-a339-e3e41c0a43fc admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:49.148813 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56a178-f7bf-49fd-a339-e3e41c0a43fc admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:49.154488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c180d-7e3d-4b82-922a-9fb39b6fb081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:49.155151 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c180d-7e3d-4b82-922a-9fb39b6fb081 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:49.155425 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c180d-7e3d-4b82-922a-9fb39b6fb081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:49.155706 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c180d-7e3d-4b82-922a-9fb39b6fb081 admin admin] PATH_INFO: `/v3/projects/5806753e517a4a29afb5232c312d2777/users/79b356a91b864e00a231b8f9c7bbbb25/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:49.157810 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c180d-7e3d-4b82-922a-9fb39b6fb081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5806753e517a4a29afb5232c312d2777, user_id=79b356a91b864e00a231b8f9c7bbbb25, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:49.160789 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c180d-7e3d-4b82-922a-9fb39b6fb081 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:49.172479 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 997/1976] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:30:49 2022] PUT /identity/v3/projects/5806753e517a4a29afb5232c312d2777/users/79b356a91b864e00a231b8f9c7bbbb25/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:30:49.184323 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc073-0237-4043-8635-c29936d05477 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:49.184546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc073-0237-4043-8635-c29936d05477 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:49.184823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc073-0237-4043-8635-c29936d05477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:49.213056 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-979bc073-0237-4043-8635-c29936d05477 None None] MFA Rules not processed for user `79b356a91b864e00a231b8f9c7bbbb25`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:30:49.214253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-979bc073-0237-4043-8635-c29936d05477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:49.234207 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:49.288936 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 980/1977] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:30:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:30:49.296512 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c180d-7e3d-4b82-922a-9fb39b6fb081 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:49.299592 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-550c180d-7e3d-4b82-922a-9fb39b6fb081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:49.311066 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:49.361884 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c180d-7e3d-4b82-922a-9fb39b6fb081 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:49.365631 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943ae57-ab48-4d90-aa9c-fafab9bb5082 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:49.366232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943ae57-ab48-4d90-aa9c-fafab9bb5082 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:49.366509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943ae57-ab48-4d90-aa9c-fafab9bb5082 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:49.366774 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943ae57-ab48-4d90-aa9c-fafab9bb5082 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:49.376333 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943ae57-ab48-4d90-aa9c-fafab9bb5082 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:49.377755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943ae57-ab48-4d90-aa9c-fafab9bb5082 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:49.387478 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 998/1978] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:30:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:30:49.467790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bc073-0237-4043-8635-c29936d05477 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:49.479911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bc073-0237-4043-8635-c29936d05477 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:49.484684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430ef37-732c-4fba-9bf0-1be0d2f3957e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:49.485371 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430ef37-732c-4fba-9bf0-1be0d2f3957e service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:49.485727 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430ef37-732c-4fba-9bf0-1be0d2f3957e service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:49.486072 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430ef37-732c-4fba-9bf0-1be0d2f3957e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:49.544471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430ef37-732c-4fba-9bf0-1be0d2f3957e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:49.545901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430ef37-732c-4fba-9bf0-1be0d2f3957e service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:49.554847 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 981/1979] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:30:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:30:56.351355 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943ae57-ab48-4d90-aa9c-fafab9bb5082 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:56.414906 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943ae57-ab48-4d90-aa9c-fafab9bb5082 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:56.420007 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf661c7-23c8-453c-be62-324dbc45c510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:56.420632 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf661c7-23c8-453c-be62-324dbc45c510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:56.420904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf661c7-23c8-453c-be62-324dbc45c510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:56.421166 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf661c7-23c8-453c-be62-324dbc45c510 admin admin] PATH_INFO: `/v3/users/8ead4b3615834f8397099e44f74ebac0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:56.422268 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf661c7-23c8-453c-be62-324dbc45c510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ead4b3615834f8397099e44f74ebac0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:56.424285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf661c7-23c8-453c-be62-324dbc45c510 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:56.470696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1bf661c7-23c8-453c-be62-324dbc45c510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ead4b3615834f8397099e44f74ebac0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:56.471331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1bf661c7-23c8-453c-be62-324dbc45c510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ead4b3615834f8397099e44f74ebac0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:56.478142 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1bf661c7-23c8-453c-be62-324dbc45c510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ead4b3615834f8397099e44f74ebac0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:56.478759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1bf661c7-23c8-453c-be62-324dbc45c510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ead4b3615834f8397099e44f74ebac0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:56.487446 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1bf661c7-23c8-453c-be62-324dbc45c510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ead4b3615834f8397099e44f74ebac0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:56.504922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 999/1980] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:30:56 2022] DELETE /identity/v3/users/8ead4b3615834f8397099e44f74ebac0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:30:56.509293 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61057933-737e-4518-b7da-759d36ba72e3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:56.509753 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61057933-737e-4518-b7da-759d36ba72e3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:56.509865 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61057933-737e-4518-b7da-759d36ba72e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:56.529923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-61057933-737e-4518-b7da-759d36ba72e3 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:30:56.531105 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-61057933-737e-4518-b7da-759d36ba72e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:56.588454 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 982/1981] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:30:56.598536 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf661c7-23c8-453c-be62-324dbc45c510 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:56.600023 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1bf661c7-23c8-453c-be62-324dbc45c510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:56.631876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:56.657625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf661c7-23c8-453c-be62-324dbc45c510 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:56.661246 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0fa63-a717-43d6-a327-85eca300d2cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:56.661896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0fa63-a717-43d6-a327-85eca300d2cd service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:56.662198 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0fa63-a717-43d6-a327-85eca300d2cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:56.662467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0fa63-a717-43d6-a327-85eca300d2cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:56.671343 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0fa63-a717-43d6-a327-85eca300d2cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:56.672790 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0fa63-a717-43d6-a327-85eca300d2cd service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:56.681969 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1000/1982] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:30:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:30:56.941022 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61057933-737e-4518-b7da-759d36ba72e3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:56.942613 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-61057933-737e-4518-b7da-759d36ba72e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:56.954676 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61057933-737e-4518-b7da-759d36ba72e3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:56.959408 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0025b-5b11-41b7-853f-9e3666c217f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:56.960072 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0025b-5b11-41b7-853f-9e3666c217f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:56.960352 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0025b-5b11-41b7-853f-9e3666c217f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:56.960625 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0025b-5b11-41b7-853f-9e3666c217f8 admin admin] PATH_INFO: `/v3/projects/6616c5509b7247158a2121c278503745` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:56.961751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0025b-5b11-41b7-853f-9e3666c217f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6616c5509b7247158a2121c278503745)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:56.963706 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0025b-5b11-41b7-853f-9e3666c217f8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:57.010296 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9ac0025b-5b11-41b7-853f-9e3666c217f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6616c5509b7247158a2121c278503745', 'request_id': 'req-9ac0025b-5b11-41b7-853f-9e3666c217f8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:57.011974 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:57.018311 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9ac0025b-5b11-41b7-853f-9e3666c217f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6616c5509b7247158a2121c278503745', 'request_id': 'req-9ac0025b-5b11-41b7-853f-9e3666c217f8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:57.025192 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9ac0025b-5b11-41b7-853f-9e3666c217f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6616c5509b7247158a2121c278503745', 'request_id': 'req-9ac0025b-5b11-41b7-853f-9e3666c217f8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:57.035806 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9ac0025b-5b11-41b7-853f-9e3666c217f8 admin admin] The token cache is being invalidate because project 6616c5509b7247158a2121c278503745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:30:57.036118 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9ac0025b-5b11-41b7-853f-9e3666c217f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:57.036757 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9ac0025b-5b11-41b7-853f-9e3666c217f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:57.038232 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 983/1983] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:30:56 2022] DELETE /identity/v3/projects/6616c5509b7247158a2121c278503745 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:30:57.042143 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0fa63-a717-43d6-a327-85eca300d2cd service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:57.052511 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0fa63-a717-43d6-a327-85eca300d2cd service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:57.108013 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e67f7-fabd-4639-9ce9-d5ef4663f96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:57.108642 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e67f7-fabd-4639-9ce9-d5ef4663f96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:57.108920 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e67f7-fabd-4639-9ce9-d5ef4663f96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:57.109189 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e67f7-fabd-4639-9ce9-d5ef4663f96c admin admin] PATH_INFO: `/v3/users/79b356a91b864e00a231b8f9c7bbbb25` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:57.110296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e67f7-fabd-4639-9ce9-d5ef4663f96c admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b356a91b864e00a231b8f9c7bbbb25)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:57.112237 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e67f7-fabd-4639-9ce9-d5ef4663f96c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:57.158068 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-798e67f7-fabd-4639-9ce9-d5ef4663f96c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b356a91b864e00a231b8f9c7bbbb25'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:57.158768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-798e67f7-fabd-4639-9ce9-d5ef4663f96c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b356a91b864e00a231b8f9c7bbbb25'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:57.165952 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-798e67f7-fabd-4639-9ce9-d5ef4663f96c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b356a91b864e00a231b8f9c7bbbb25'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:57.166603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-798e67f7-fabd-4639-9ce9-d5ef4663f96c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b356a91b864e00a231b8f9c7bbbb25'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:57.173515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-798e67f7-fabd-4639-9ce9-d5ef4663f96c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b356a91b864e00a231b8f9c7bbbb25'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:57.190563 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1001/1984] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:30:57 2022] DELETE /identity/v3/users/79b356a91b864e00a231b8f9c7bbbb25 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:30:57.459638 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0025b-5b11-41b7-853f-9e3666c217f8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:57.461275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9ac0025b-5b11-41b7-853f-9e3666c217f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:57.475565 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0025b-5b11-41b7-853f-9e3666c217f8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:57.532489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dc210-4371-45bf-92c2-c817c5a5e0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:57.533181 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dc210-4371-45bf-92c2-c817c5a5e0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:57.533447 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dc210-4371-45bf-92c2-c817c5a5e0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:57.533711 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dc210-4371-45bf-92c2-c817c5a5e0bb admin admin] PATH_INFO: `/v3/projects/5806753e517a4a29afb5232c312d2777` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:57.534870 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6dc210-4371-45bf-92c2-c817c5a5e0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5806753e517a4a29afb5232c312d2777)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:57.536839 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6dc210-4371-45bf-92c2-c817c5a5e0bb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:57.583272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef6dc210-4371-45bf-92c2-c817c5a5e0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5806753e517a4a29afb5232c312d2777', 'request_id': 'req-ef6dc210-4371-45bf-92c2-c817c5a5e0bb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:57.591100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef6dc210-4371-45bf-92c2-c817c5a5e0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5806753e517a4a29afb5232c312d2777', 'request_id': 'req-ef6dc210-4371-45bf-92c2-c817c5a5e0bb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:57.597633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef6dc210-4371-45bf-92c2-c817c5a5e0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5806753e517a4a29afb5232c312d2777', 'request_id': 'req-ef6dc210-4371-45bf-92c2-c817c5a5e0bb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:57.608817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef6dc210-4371-45bf-92c2-c817c5a5e0bb admin admin] The token cache is being invalidate because project 5806753e517a4a29afb5232c312d2777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:30:57.609104 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef6dc210-4371-45bf-92c2-c817c5a5e0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:57.609747 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ef6dc210-4371-45bf-92c2-c817c5a5e0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:30:57.611225 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 984/1985] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:30:57 2022] DELETE /identity/v3/projects/5806753e517a4a29afb5232c312d2777 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:30:57.616268 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6087f-4b12-425e-838a-25d30775cdef None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:57.616745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6087f-4b12-425e-838a-25d30775cdef None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:57.616848 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6087f-4b12-425e-838a-25d30775cdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:57.637248 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a7d6087f-4b12-425e-838a-25d30775cdef None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:30:57.638446 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a7d6087f-4b12-425e-838a-25d30775cdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:57.681820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:57.697963 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1002/1986] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:30:57.705946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf230a-88a5-4a1d-b3e7-495f58018826 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:57.706237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf230a-88a5-4a1d-b3e7-495f58018826 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:57.706517 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf230a-88a5-4a1d-b3e7-495f58018826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:57.725809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0ebf230a-88a5-4a1d-b3e7-495f58018826 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:30:57.727004 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0ebf230a-88a5-4a1d-b3e7-495f58018826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:57.735332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 985/1987] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:30:57.739459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6087f-4b12-425e-838a-25d30775cdef None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:57.749988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6087f-4b12-425e-838a-25d30775cdef None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:57.754596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40dbac-21bb-4739-97ca-fefd0bb34571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:57.755192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40dbac-21bb-4739-97ca-fefd0bb34571 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:57.755473 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40dbac-21bb-4739-97ca-fefd0bb34571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:57.755747 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40dbac-21bb-4739-97ca-fefd0bb34571 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:57.756429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40dbac-21bb-4739-97ca-fefd0bb34571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:30:57.756737 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40dbac-21bb-4739-97ca-fefd0bb34571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:57.758330 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40dbac-21bb-4739-97ca-fefd0bb34571 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:57.769588 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1003/1988] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:30:57.773605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf230a-88a5-4a1d-b3e7-495f58018826 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:57.783355 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf230a-88a5-4a1d-b3e7-495f58018826 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:57.788229 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e80dd-f8e0-4611-942b-75703e8fc0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:57.788763 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e80dd-f8e0-4611-942b-75703e8fc0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:57.789042 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e80dd-f8e0-4611-942b-75703e8fc0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:57.789335 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e80dd-f8e0-4611-942b-75703e8fc0a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:57.789972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e80dd-f8e0-4611-942b-75703e8fc0a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:57.791869 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e80dd-f8e0-4611-942b-75703e8fc0a8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:57.819259 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 986/1989] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:30:57 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:30:57.823435 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40dbac-21bb-4739-97ca-fefd0bb34571 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:57.833400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40dbac-21bb-4739-97ca-fefd0bb34571 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:57.889506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c001d-22e4-4909-ba43-477a37d6faed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:57.890113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c001d-22e4-4909-ba43-477a37d6faed admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:57.890396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c001d-22e4-4909-ba43-477a37d6faed admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:57.890696 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c001d-22e4-4909-ba43-477a37d6faed admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:57.891338 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c001d-22e4-4909-ba43-477a37d6faed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:57.893306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c001d-22e4-4909-ba43-477a37d6faed admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:57.914830 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1004/1990] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:30:57 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:30:57.919123 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e80dd-f8e0-4611-942b-75703e8fc0a8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:57.930066 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e80dd-f8e0-4611-942b-75703e8fc0a8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:57.934711 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdc98f-c6ab-4252-a24f-b4333a1db104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:57.935303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdc98f-c6ab-4252-a24f-b4333a1db104 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:57.935581 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdc98f-c6ab-4252-a24f-b4333a1db104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:57.935852 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdc98f-c6ab-4252-a24f-b4333a1db104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:57.936525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdc98f-c6ab-4252-a24f-b4333a1db104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:57.938121 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdc98f-c6ab-4252-a24f-b4333a1db104 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:57.947770 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 987/1991] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:30:57.951776 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c001d-22e4-4909-ba43-477a37d6faed admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:57.961776 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c001d-22e4-4909-ba43-477a37d6faed admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:57.966925 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c063d0f-cbaf-4ad4-b64b-1572fe0a0128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:57.967519 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c063d0f-cbaf-4ad4-b64b-1572fe0a0128 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:57.967798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c063d0f-cbaf-4ad4-b64b-1572fe0a0128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:57.968113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c063d0f-cbaf-4ad4-b64b-1572fe0a0128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:57.968755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c063d0f-cbaf-4ad4-b64b-1572fe0a0128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:57.970342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c063d0f-cbaf-4ad4-b64b-1572fe0a0128 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:57.980790 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1005/1992] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:30:57.985366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdc98f-c6ab-4252-a24f-b4333a1db104 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:57.995153 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdc98f-c6ab-4252-a24f-b4333a1db104 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:58.000051 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27db42-e91e-4fee-a0a1-0232c9ec4c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:58.000694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27db42-e91e-4fee-a0a1-0232c9ec4c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:58.000971 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27db42-e91e-4fee-a0a1-0232c9ec4c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:58.001241 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27db42-e91e-4fee-a0a1-0232c9ec4c10 admin admin] PATH_INFO: `/v3/projects/70234d9e7bf842d4b1456a830fcb16b4/users/f3b7f4106829455d9e41cbb427388611/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:58.015281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27db42-e91e-4fee-a0a1-0232c9ec4c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70234d9e7bf842d4b1456a830fcb16b4, user_id=f3b7f4106829455d9e41cbb427388611, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:58.017944 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27db42-e91e-4fee-a0a1-0232c9ec4c10 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:58.031907 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 988/1993] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:30:57 2022] PUT /identity/v3/projects/70234d9e7bf842d4b1456a830fcb16b4/users/f3b7f4106829455d9e41cbb427388611/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:30:58.043317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004a17-96d7-489d-9bb1-a9430beeae03 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:58.043317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004a17-96d7-489d-9bb1-a9430beeae03 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:58.043543 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004a17-96d7-489d-9bb1-a9430beeae03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:58.072464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a1004a17-96d7-489d-9bb1-a9430beeae03 None None] MFA Rules not processed for user `f3b7f4106829455d9e41cbb427388611`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:30:58.073681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a1004a17-96d7-489d-9bb1-a9430beeae03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:58.136037 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1006/1994] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:30:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:30:58.140959 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27db42-e91e-4fee-a0a1-0232c9ec4c10 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:58.146418 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:58.203854 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27db42-e91e-4fee-a0a1-0232c9ec4c10 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:58.208424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa994f4-2ffa-4654-a09e-04e6cfc0b064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:58.209016 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa994f4-2ffa-4654-a09e-04e6cfc0b064 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:58.209292 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa994f4-2ffa-4654-a09e-04e6cfc0b064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:58.209562 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa994f4-2ffa-4654-a09e-04e6cfc0b064 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:58.210197 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa994f4-2ffa-4654-a09e-04e6cfc0b064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:58.212106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa994f4-2ffa-4654-a09e-04e6cfc0b064 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:58.240704 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 989/1995] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:30:58 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:30:58.241819 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1004a17-96d7-489d-9bb1-a9430beeae03 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:58.252679 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1004a17-96d7-489d-9bb1-a9430beeae03 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:58.295237 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:58.308711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cf8ca-ad0f-437f-873c-77f39668a70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:58.309425 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cf8ca-ad0f-437f-873c-77f39668a70e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:58.309728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cf8ca-ad0f-437f-873c-77f39668a70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:58.310007 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cf8ca-ad0f-437f-873c-77f39668a70e admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:58.310635 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cf8ca-ad0f-437f-873c-77f39668a70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:58.312592 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cf8ca-ad0f-437f-873c-77f39668a70e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:58.333515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1007/1996] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:30:58 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:30:58.337611 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa994f4-2ffa-4654-a09e-04e6cfc0b064 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:58.348364 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa994f4-2ffa-4654-a09e-04e6cfc0b064 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:58.353005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac00d1-0c30-4fd3-8512-f47877f698b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:58.353596 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac00d1-0c30-4fd3-8512-f47877f698b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:58.353868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac00d1-0c30-4fd3-8512-f47877f698b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:58.354139 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac00d1-0c30-4fd3-8512-f47877f698b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:58.354768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac00d1-0c30-4fd3-8512-f47877f698b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:58.356384 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac00d1-0c30-4fd3-8512-f47877f698b5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:58.366860 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 990/1997] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:30:58.370866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cf8ca-ad0f-437f-873c-77f39668a70e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:58.381042 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cf8ca-ad0f-437f-873c-77f39668a70e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:58.385617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f99052-364f-4791-b7b3-29966181664e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:58.386247 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f99052-364f-4791-b7b3-29966181664e admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:58.386523 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f99052-364f-4791-b7b3-29966181664e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:58.386794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f99052-364f-4791-b7b3-29966181664e admin admin] PATH_INFO: `/v3/projects/21ba57f6219247688d2e20914599035f/users/bfbf2fac4cdf40e5b1b63da44f7180cc/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:58.402598 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f99052-364f-4791-b7b3-29966181664e admin admin] RBAC: Authorizing `identity:create_grant(project_id=21ba57f6219247688d2e20914599035f, user_id=bfbf2fac4cdf40e5b1b63da44f7180cc, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:58.405871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f99052-364f-4791-b7b3-29966181664e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:58.418911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1008/1998] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:30:58 2022] PUT /identity/v3/projects/21ba57f6219247688d2e20914599035f/users/bfbf2fac4cdf40e5b1b63da44f7180cc/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:30:58.422757 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac00d1-0c30-4fd3-8512-f47877f698b5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:58.432614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac00d1-0c30-4fd3-8512-f47877f698b5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:58.488456 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5996a93-de04-437b-984b-3e2952c75996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:58.489052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5996a93-de04-437b-984b-3e2952c75996 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:58.489331 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5996a93-de04-437b-984b-3e2952c75996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:58.489604 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5996a93-de04-437b-984b-3e2952c75996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:58.490236 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5996a93-de04-437b-984b-3e2952c75996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:58.491817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5996a93-de04-437b-984b-3e2952c75996 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:58.501652 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 991/1999] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:30:58.505728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f99052-364f-4791-b7b3-29966181664e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:58.516205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f99052-364f-4791-b7b3-29966181664e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:58.520763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa612e4-519c-46ff-b6d4-a839934e49d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:58.521430 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa612e4-519c-46ff-b6d4-a839934e49d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:58.521705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa612e4-519c-46ff-b6d4-a839934e49d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:58.521975 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa612e4-519c-46ff-b6d4-a839934e49d4 admin admin] PATH_INFO: `/v3/projects/21ba57f6219247688d2e20914599035f/users/bfbf2fac4cdf40e5b1b63da44f7180cc/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:58.523846 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa612e4-519c-46ff-b6d4-a839934e49d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21ba57f6219247688d2e20914599035f, user_id=bfbf2fac4cdf40e5b1b63da44f7180cc, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:58.526485 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa612e4-519c-46ff-b6d4-a839934e49d4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:58.536841 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1009/2000] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:30:58 2022] PUT /identity/v3/projects/21ba57f6219247688d2e20914599035f/users/bfbf2fac4cdf40e5b1b63da44f7180cc/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:30:58.546769 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d94fcb-eb60-4bee-b375-76a3ce97e66d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:58.547240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d94fcb-eb60-4bee-b375-76a3ce97e66d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:58.547240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d94fcb-eb60-4bee-b375-76a3ce97e66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:58.574579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c8d94fcb-eb60-4bee-b375-76a3ce97e66d None None] MFA Rules not processed for user `bfbf2fac4cdf40e5b1b63da44f7180cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:30:58.575827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c8d94fcb-eb60-4bee-b375-76a3ce97e66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:58.640689 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:58.644798 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 992/2001] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:30:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:30:58.656025 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa612e4-519c-46ff-b6d4-a839934e49d4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:30:58.657827 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9aa612e4-519c-46ff-b6d4-a839934e49d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:30:58.712341 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa612e4-519c-46ff-b6d4-a839934e49d4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:30:58.715914 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeba274-f79f-43de-a8a1-00ada275a732 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:30:58.717022 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeba274-f79f-43de-a8a1-00ada275a732 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:30:58.717316 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeba274-f79f-43de-a8a1-00ada275a732 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:30:58.717566 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeba274-f79f-43de-a8a1-00ada275a732 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:30:58.771144 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeba274-f79f-43de-a8a1-00ada275a732 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:30:58.772605 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeba274-f79f-43de-a8a1-00ada275a732 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:30:58.781774 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1010/2002] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:30:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:31:00.135345 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d94fcb-eb60-4bee-b375-76a3ce97e66d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:00.136671 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c8d94fcb-eb60-4bee-b375-76a3ce97e66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:00.148994 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d94fcb-eb60-4bee-b375-76a3ce97e66d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:00.152518 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9127c-eab9-4fd7-8f53-4c5c6ee48c84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:00.153110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9127c-eab9-4fd7-8f53-4c5c6ee48c84 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:00.153386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9127c-eab9-4fd7-8f53-4c5c6ee48c84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:00.153685 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9127c-eab9-4fd7-8f53-4c5c6ee48c84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:00.162410 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9127c-eab9-4fd7-8f53-4c5c6ee48c84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:00.163826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9127c-eab9-4fd7-8f53-4c5c6ee48c84 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:00.173131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 993/2003] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:31:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:31:03.951357 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeba274-f79f-43de-a8a1-00ada275a732 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:04.000613 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:04.013659 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeba274-f79f-43de-a8a1-00ada275a732 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:04.018317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986147c-93ba-4205-a236-9895fff98132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:04.018938 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986147c-93ba-4205-a236-9895fff98132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:04.019214 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986147c-93ba-4205-a236-9895fff98132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:04.019484 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986147c-93ba-4205-a236-9895fff98132 admin admin] PATH_INFO: `/v3/users/f3b7f4106829455d9e41cbb427388611` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:04.020603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986147c-93ba-4205-a236-9895fff98132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3b7f4106829455d9e41cbb427388611)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:04.022505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986147c-93ba-4205-a236-9895fff98132 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:04.071264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a986147c-93ba-4205-a236-9895fff98132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3b7f4106829455d9e41cbb427388611'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:04.071915 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a986147c-93ba-4205-a236-9895fff98132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3b7f4106829455d9e41cbb427388611'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:04.079607 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a986147c-93ba-4205-a236-9895fff98132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3b7f4106829455d9e41cbb427388611'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:04.080241 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a986147c-93ba-4205-a236-9895fff98132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3b7f4106829455d9e41cbb427388611'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:04.087674 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a986147c-93ba-4205-a236-9895fff98132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3b7f4106829455d9e41cbb427388611'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:04.105708 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1011/2004] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:31:03 2022] DELETE /identity/v3/users/f3b7f4106829455d9e41cbb427388611 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:04.110097 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969ad2e-8fad-432b-96cf-44175db64e84 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:04.110576 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969ad2e-8fad-432b-96cf-44175db64e84 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:04.110676 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969ad2e-8fad-432b-96cf-44175db64e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:04.129888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e969ad2e-8fad-432b-96cf-44175db64e84 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:04.131075 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e969ad2e-8fad-432b-96cf-44175db64e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:04.188743 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 994/2005] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:04.198317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986147c-93ba-4205-a236-9895fff98132 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:04.199692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a986147c-93ba-4205-a236-9895fff98132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:04.255518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986147c-93ba-4205-a236-9895fff98132 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:04.259282 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18620a93-91c4-4ac3-afa8-9e73ee10190b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:04.259883 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18620a93-91c4-4ac3-afa8-9e73ee10190b service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:04.260205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18620a93-91c4-4ac3-afa8-9e73ee10190b service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:04.260481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18620a93-91c4-4ac3-afa8-9e73ee10190b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:04.269405 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18620a93-91c4-4ac3-afa8-9e73ee10190b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:04.270833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18620a93-91c4-4ac3-afa8-9e73ee10190b service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:04.280214 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1012/2006] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:31:04.541405 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969ad2e-8fad-432b-96cf-44175db64e84 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:04.542917 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e969ad2e-8fad-432b-96cf-44175db64e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:04.564400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969ad2e-8fad-432b-96cf-44175db64e84 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:04.569971 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8da07-3d5b-48b6-b442-06ee424a3e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:04.570633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8da07-3d5b-48b6-b442-06ee424a3e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:04.571081 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8da07-3d5b-48b6-b442-06ee424a3e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:04.571466 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8da07-3d5b-48b6-b442-06ee424a3e56 admin admin] PATH_INFO: `/v3/projects/70234d9e7bf842d4b1456a830fcb16b4` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:04.572494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8da07-3d5b-48b6-b442-06ee424a3e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70234d9e7bf842d4b1456a830fcb16b4)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:04.574483 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8da07-3d5b-48b6-b442-06ee424a3e56 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:04.621417 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-feb8da07-3d5b-48b6-b442-06ee424a3e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70234d9e7bf842d4b1456a830fcb16b4', 'request_id': 'req-feb8da07-3d5b-48b6-b442-06ee424a3e56'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:04.628882 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-feb8da07-3d5b-48b6-b442-06ee424a3e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70234d9e7bf842d4b1456a830fcb16b4', 'request_id': 'req-feb8da07-3d5b-48b6-b442-06ee424a3e56'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:04.635508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-feb8da07-3d5b-48b6-b442-06ee424a3e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70234d9e7bf842d4b1456a830fcb16b4', 'request_id': 'req-feb8da07-3d5b-48b6-b442-06ee424a3e56'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:04.645692 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-feb8da07-3d5b-48b6-b442-06ee424a3e56 admin admin] The token cache is being invalidate because project 70234d9e7bf842d4b1456a830fcb16b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:31:04.645974 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-feb8da07-3d5b-48b6-b442-06ee424a3e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:04.646594 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-feb8da07-3d5b-48b6-b442-06ee424a3e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:04.648082 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 995/2007] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:31:04 2022] DELETE /identity/v3/projects/70234d9e7bf842d4b1456a830fcb16b4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:04.652138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18620a93-91c4-4ac3-afa8-9e73ee10190b service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:04.662160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18620a93-91c4-4ac3-afa8-9e73ee10190b service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:04.717125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c509d-023c-4804-a187-ddbfb1c55ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:04.717674 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c509d-023c-4804-a187-ddbfb1c55ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:04.717949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c509d-023c-4804-a187-ddbfb1c55ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:04.718216 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c509d-023c-4804-a187-ddbfb1c55ff3 admin admin] PATH_INFO: `/v3/users/bfbf2fac4cdf40e5b1b63da44f7180cc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:04.719322 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c509d-023c-4804-a187-ddbfb1c55ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfbf2fac4cdf40e5b1b63da44f7180cc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:04.721260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c509d-023c-4804-a187-ddbfb1c55ff3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:04.736233 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:04.766388 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-431c509d-023c-4804-a187-ddbfb1c55ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfbf2fac4cdf40e5b1b63da44f7180cc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:04.767040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-431c509d-023c-4804-a187-ddbfb1c55ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfbf2fac4cdf40e5b1b63da44f7180cc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:04.773907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-431c509d-023c-4804-a187-ddbfb1c55ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfbf2fac4cdf40e5b1b63da44f7180cc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:04.774538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-431c509d-023c-4804-a187-ddbfb1c55ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfbf2fac4cdf40e5b1b63da44f7180cc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:04.781718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-431c509d-023c-4804-a187-ddbfb1c55ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfbf2fac4cdf40e5b1b63da44f7180cc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:04.799356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1013/2008] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:31:04 2022] DELETE /identity/v3/users/bfbf2fac4cdf40e5b1b63da44f7180cc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:05.065629 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8da07-3d5b-48b6-b442-06ee424a3e56 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:05.067101 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-feb8da07-3d5b-48b6-b442-06ee424a3e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:05.082562 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8da07-3d5b-48b6-b442-06ee424a3e56 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:05.140476 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdd421-5631-439d-9f6c-12302dacaa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:05.141134 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdd421-5631-439d-9f6c-12302dacaa55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:05.141369 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdd421-5631-439d-9f6c-12302dacaa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:05.141634 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdd421-5631-439d-9f6c-12302dacaa55 admin admin] PATH_INFO: `/v3/projects/21ba57f6219247688d2e20914599035f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:05.142742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdd421-5631-439d-9f6c-12302dacaa55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21ba57f6219247688d2e20914599035f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:05.144697 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdd421-5631-439d-9f6c-12302dacaa55 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:05.156352 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:05.191427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7fdd421-5631-439d-9f6c-12302dacaa55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21ba57f6219247688d2e20914599035f', 'request_id': 'req-a7fdd421-5631-439d-9f6c-12302dacaa55'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:05.198527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7fdd421-5631-439d-9f6c-12302dacaa55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21ba57f6219247688d2e20914599035f', 'request_id': 'req-a7fdd421-5631-439d-9f6c-12302dacaa55'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:05.205438 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7fdd421-5631-439d-9f6c-12302dacaa55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21ba57f6219247688d2e20914599035f', 'request_id': 'req-a7fdd421-5631-439d-9f6c-12302dacaa55'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:05.215606 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7fdd421-5631-439d-9f6c-12302dacaa55 admin admin] The token cache is being invalidate because project 21ba57f6219247688d2e20914599035f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:31:05.215892 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7fdd421-5631-439d-9f6c-12302dacaa55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:05.217151 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7fdd421-5631-439d-9f6c-12302dacaa55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:05.218640 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 996/2009] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:31:05 2022] DELETE /identity/v3/projects/21ba57f6219247688d2e20914599035f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:05.223518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f37d38-0da2-4f95-a9e5-f9b41d6032d3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:05.224024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f37d38-0da2-4f95-a9e5-f9b41d6032d3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:05.224122 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f37d38-0da2-4f95-a9e5-f9b41d6032d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:05.243186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c4f37d38-0da2-4f95-a9e5-f9b41d6032d3 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:05.244337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c4f37d38-0da2-4f95-a9e5-f9b41d6032d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:05.302147 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1014/2010] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:05.310448 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb83420-cbdb-498f-9acb-cd7a21737d6c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:05.310733 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb83420-cbdb-498f-9acb-cd7a21737d6c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:05.311006 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb83420-cbdb-498f-9acb-cd7a21737d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:05.330859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6fb83420-cbdb-498f-9acb-cd7a21737d6c None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:05.332101 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6fb83420-cbdb-498f-9acb-cd7a21737d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:05.339803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 997/2011] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:05.343775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f37d38-0da2-4f95-a9e5-f9b41d6032d3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:05.353469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f37d38-0da2-4f95-a9e5-f9b41d6032d3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:05.358085 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71164be2-5f27-4762-ab46-f98f233a0d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:05.358682 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71164be2-5f27-4762-ab46-f98f233a0d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:05.358963 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71164be2-5f27-4762-ab46-f98f233a0d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:05.359239 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71164be2-5f27-4762-ab46-f98f233a0d94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:05.359888 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71164be2-5f27-4762-ab46-f98f233a0d94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:31:05.360223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71164be2-5f27-4762-ab46-f98f233a0d94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:05.361823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71164be2-5f27-4762-ab46-f98f233a0d94 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:05.373871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1015/2012] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:31:05.377894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb83420-cbdb-498f-9acb-cd7a21737d6c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:05.386985 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb83420-cbdb-498f-9acb-cd7a21737d6c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:05.392254 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab2a19-df78-475f-a914-981e4477f703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:05.392850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab2a19-df78-475f-a914-981e4477f703 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:05.393133 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab2a19-df78-475f-a914-981e4477f703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:05.393403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab2a19-df78-475f-a914-981e4477f703 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:05.394047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab2a19-df78-475f-a914-981e4477f703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:05.395948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab2a19-df78-475f-a914-981e4477f703 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:05.421913 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 998/2013] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:31:05 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:31:05.425911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71164be2-5f27-4762-ab46-f98f233a0d94 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:05.436304 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71164be2-5f27-4762-ab46-f98f233a0d94 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:05.492060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327ba0b-ae24-4902-aaae-57465d49aac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:05.492659 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327ba0b-ae24-4902-aaae-57465d49aac9 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:05.492939 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327ba0b-ae24-4902-aaae-57465d49aac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:05.493260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327ba0b-ae24-4902-aaae-57465d49aac9 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:05.493839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327ba0b-ae24-4902-aaae-57465d49aac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:05.495776 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327ba0b-ae24-4902-aaae-57465d49aac9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:05.517243 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1016/2014] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:31:05 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:31:05.521204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab2a19-df78-475f-a914-981e4477f703 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:05.531449 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab2a19-df78-475f-a914-981e4477f703 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:05.536436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30de86a-338d-4df6-83ef-70b5d35c4bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:05.537031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30de86a-338d-4df6-83ef-70b5d35c4bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:05.537312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30de86a-338d-4df6-83ef-70b5d35c4bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:05.537582 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30de86a-338d-4df6-83ef-70b5d35c4bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:05.538222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30de86a-338d-4df6-83ef-70b5d35c4bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:05.539806 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30de86a-338d-4df6-83ef-70b5d35c4bcc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:05.549849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 999/2015] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:31:05.553677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327ba0b-ae24-4902-aaae-57465d49aac9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:05.564041 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327ba0b-ae24-4902-aaae-57465d49aac9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:05.568695 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddecce-8f73-4fbd-9369-a792601e924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:05.569280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddecce-8f73-4fbd-9369-a792601e924d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:05.569562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddecce-8f73-4fbd-9369-a792601e924d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:05.569837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddecce-8f73-4fbd-9369-a792601e924d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:05.570487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddecce-8f73-4fbd-9369-a792601e924d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:05.572126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddecce-8f73-4fbd-9369-a792601e924d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:05.577802 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:05.585056 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1017/2016] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:31:05.588681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30de86a-338d-4df6-83ef-70b5d35c4bcc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:05.598563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30de86a-338d-4df6-83ef-70b5d35c4bcc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:05.603131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf5be3-647e-452e-b0b6-b828361bbfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:05.603772 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf5be3-647e-452e-b0b6-b828361bbfcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:05.604084 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf5be3-647e-452e-b0b6-b828361bbfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:05.604355 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf5be3-647e-452e-b0b6-b828361bbfcc admin admin] PATH_INFO: `/v3/projects/f0ac99e4d7fc4caea4c26c17ec1756ae/users/194335b9bc854ed482317af923987801/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:05.618923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf5be3-647e-452e-b0b6-b828361bbfcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ac99e4d7fc4caea4c26c17ec1756ae, user_id=194335b9bc854ed482317af923987801, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:05.621624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf5be3-647e-452e-b0b6-b828361bbfcc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:05.636032 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1000/2017] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:31:05 2022] PUT /identity/v3/projects/f0ac99e4d7fc4caea4c26c17ec1756ae/users/194335b9bc854ed482317af923987801/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:05.647897 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66718077-b4be-47c4-8e88-fd7941643277 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:05.648220 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66718077-b4be-47c4-8e88-fd7941643277 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:05.648498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66718077-b4be-47c4-8e88-fd7941643277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:05.675858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-66718077-b4be-47c4-8e88-fd7941643277 None None] MFA Rules not processed for user `194335b9bc854ed482317af923987801`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:05.677088 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-66718077-b4be-47c4-8e88-fd7941643277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:05.739110 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1018/2018] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:05.743558 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf5be3-647e-452e-b0b6-b828361bbfcc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:05.804447 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf5be3-647e-452e-b0b6-b828361bbfcc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:05.809261 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab70630-ef7d-4ba0-aa24-837dc74f065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:05.810570 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab70630-ef7d-4ba0-aa24-837dc74f065d admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:05.810937 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab70630-ef7d-4ba0-aa24-837dc74f065d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:05.811279 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab70630-ef7d-4ba0-aa24-837dc74f065d admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:05.812015 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab70630-ef7d-4ba0-aa24-837dc74f065d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:05.814123 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab70630-ef7d-4ba0-aa24-837dc74f065d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:05.843169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1001/2019] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:31:05 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:31:05.844391 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66718077-b4be-47c4-8e88-fd7941643277 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:05.855098 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66718077-b4be-47c4-8e88-fd7941643277 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:05.911028 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048911b-fb70-4fb2-86c8-7959f02d8fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:05.911630 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048911b-fb70-4fb2-86c8-7959f02d8fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:05.911906 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048911b-fb70-4fb2-86c8-7959f02d8fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:05.912203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048911b-fb70-4fb2-86c8-7959f02d8fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:05.912824 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048911b-fb70-4fb2-86c8-7959f02d8fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:05.914736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048911b-fb70-4fb2-86c8-7959f02d8fb6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:05.936831 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1019/2020] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:31:05 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:31:05.940816 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab70630-ef7d-4ba0-aa24-837dc74f065d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:05.950950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab70630-ef7d-4ba0-aa24-837dc74f065d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:05.955446 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ed404-4e27-40b6-8dd3-655774a1bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:05.956102 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ed404-4e27-40b6-8dd3-655774a1bf31 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:05.956378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ed404-4e27-40b6-8dd3-655774a1bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:05.956647 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ed404-4e27-40b6-8dd3-655774a1bf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:05.957285 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ed404-4e27-40b6-8dd3-655774a1bf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:05.958896 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ed404-4e27-40b6-8dd3-655774a1bf31 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:05.969167 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1002/2021] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:31:05.973123 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048911b-fb70-4fb2-86c8-7959f02d8fb6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:05.983795 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048911b-fb70-4fb2-86c8-7959f02d8fb6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:05.988412 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d56c1-e0cc-4aca-9682-6b39a9fc8384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:05.989054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d56c1-e0cc-4aca-9682-6b39a9fc8384 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:05.989332 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d56c1-e0cc-4aca-9682-6b39a9fc8384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:05.989603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d56c1-e0cc-4aca-9682-6b39a9fc8384 admin admin] PATH_INFO: `/v3/projects/24527dc7dd3540a6b90ce26b80f603c3/users/593ec5de6fb14e61b2facd42ba37ad0d/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:06.004609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d56c1-e0cc-4aca-9682-6b39a9fc8384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24527dc7dd3540a6b90ce26b80f603c3, user_id=593ec5de6fb14e61b2facd42ba37ad0d, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:06.007177 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d56c1-e0cc-4aca-9682-6b39a9fc8384 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:06.019360 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1020/2022] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:31:05 2022] PUT /identity/v3/projects/24527dc7dd3540a6b90ce26b80f603c3/users/593ec5de6fb14e61b2facd42ba37ad0d/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:06.023192 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ed404-4e27-40b6-8dd3-655774a1bf31 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:06.033547 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ed404-4e27-40b6-8dd3-655774a1bf31 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:06.041288 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:06.090735 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f85ca7-f858-4df2-a692-832205ecbb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:06.091852 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f85ca7-f858-4df2-a692-832205ecbb51 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:06.092160 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f85ca7-f858-4df2-a692-832205ecbb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:06.092434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f85ca7-f858-4df2-a692-832205ecbb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:06.093065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f85ca7-f858-4df2-a692-832205ecbb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:06.094630 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f85ca7-f858-4df2-a692-832205ecbb51 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:06.103951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1003/2023] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:31:06.108755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d56c1-e0cc-4aca-9682-6b39a9fc8384 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:06.119016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d56c1-e0cc-4aca-9682-6b39a9fc8384 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:06.123855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99717118-2cd2-41a2-81af-01c7e5754026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:06.124534 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99717118-2cd2-41a2-81af-01c7e5754026 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:06.124815 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99717118-2cd2-41a2-81af-01c7e5754026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:06.125084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99717118-2cd2-41a2-81af-01c7e5754026 admin admin] PATH_INFO: `/v3/projects/24527dc7dd3540a6b90ce26b80f603c3/users/593ec5de6fb14e61b2facd42ba37ad0d/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:06.126978 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99717118-2cd2-41a2-81af-01c7e5754026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24527dc7dd3540a6b90ce26b80f603c3, user_id=593ec5de6fb14e61b2facd42ba37ad0d, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:06.129676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99717118-2cd2-41a2-81af-01c7e5754026 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:06.139699 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1021/2024] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:31:06 2022] PUT /identity/v3/projects/24527dc7dd3540a6b90ce26b80f603c3/users/593ec5de6fb14e61b2facd42ba37ad0d/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:06.149951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4efef0-dfc9-4dcd-ba13-827d36487bdf None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:06.150462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4efef0-dfc9-4dcd-ba13-827d36487bdf None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:06.150556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4efef0-dfc9-4dcd-ba13-827d36487bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:06.179564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ef4efef0-dfc9-4dcd-ba13-827d36487bdf None None] MFA Rules not processed for user `593ec5de6fb14e61b2facd42ba37ad0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:06.180799 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ef4efef0-dfc9-4dcd-ba13-827d36487bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:06.247589 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1004/2025] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:06.258540 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99717118-2cd2-41a2-81af-01c7e5754026 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:06.260237 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-99717118-2cd2-41a2-81af-01c7e5754026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:06.305129 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:06.317780 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99717118-2cd2-41a2-81af-01c7e5754026 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:06.321483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f23417-336a-42d8-a212-36d75e667989 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:06.322074 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f23417-336a-42d8-a212-36d75e667989 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:06.322347 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f23417-336a-42d8-a212-36d75e667989 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:06.322614 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f23417-336a-42d8-a212-36d75e667989 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:06.331591 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f23417-336a-42d8-a212-36d75e667989 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:06.333068 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f23417-336a-42d8-a212-36d75e667989 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:06.342930 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1022/2026] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:31:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:31:06.444472 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4efef0-dfc9-4dcd-ba13-827d36487bdf None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:06.454310 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4efef0-dfc9-4dcd-ba13-827d36487bdf None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:06.457845 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bb3c9-3847-42d4-accb-d257e309fd13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:06.458442 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bb3c9-3847-42d4-accb-d257e309fd13 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:06.458718 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bb3c9-3847-42d4-accb-d257e309fd13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:06.458986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bb3c9-3847-42d4-accb-d257e309fd13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:06.513743 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bb3c9-3847-42d4-accb-d257e309fd13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:06.515091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bb3c9-3847-42d4-accb-d257e309fd13 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:06.523637 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1005/2027] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:31:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:31:08.950598 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f23417-336a-42d8-a212-36d75e667989 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:08.959155 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f23417-336a-42d8-a212-36d75e667989 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:08.962793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8661c9c-8914-4c83-a039-0bc4b165e83b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:08.963379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8661c9c-8914-4c83-a039-0bc4b165e83b service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:08.963656 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8661c9c-8914-4c83-a039-0bc4b165e83b service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:08.963941 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8661c9c-8914-4c83-a039-0bc4b165e83b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:08.965649 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d8661c9c-8914-4c83-a039-0bc4b165e83b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:09.022883 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8661c9c-8914-4c83-a039-0bc4b165e83b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:09.024353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8661c9c-8914-4c83-a039-0bc4b165e83b service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:09.033575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1023/2028] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:31:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:31:09.109181 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bb3c9-3847-42d4-accb-d257e309fd13 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:09.143184 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:09.172205 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bb3c9-3847-42d4-accb-d257e309fd13 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:09.176761 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb6337-2547-47ab-bdd7-f76871f155c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:09.177392 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb6337-2547-47ab-bdd7-f76871f155c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:09.177671 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb6337-2547-47ab-bdd7-f76871f155c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:09.177945 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb6337-2547-47ab-bdd7-f76871f155c2 admin admin] PATH_INFO: `/v3/users/194335b9bc854ed482317af923987801` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:09.179070 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb6337-2547-47ab-bdd7-f76871f155c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=194335b9bc854ed482317af923987801)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:09.192131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb6337-2547-47ab-bdd7-f76871f155c2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:09.229910 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6ecb6337-2547-47ab-bdd7-f76871f155c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '194335b9bc854ed482317af923987801'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:09.230811 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6ecb6337-2547-47ab-bdd7-f76871f155c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '194335b9bc854ed482317af923987801'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:09.238738 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6ecb6337-2547-47ab-bdd7-f76871f155c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '194335b9bc854ed482317af923987801'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:09.239383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6ecb6337-2547-47ab-bdd7-f76871f155c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '194335b9bc854ed482317af923987801'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:09.246555 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6ecb6337-2547-47ab-bdd7-f76871f155c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '194335b9bc854ed482317af923987801'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:09.265639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1006/2029] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:31:09 2022] DELETE /identity/v3/users/194335b9bc854ed482317af923987801 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:09.270269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1833711-e8d4-42a6-8c94-293209e85509 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:09.270725 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1833711-e8d4-42a6-8c94-293209e85509 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:09.271005 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1833711-e8d4-42a6-8c94-293209e85509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:09.291029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d1833711-e8d4-42a6-8c94-293209e85509 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:09.292278 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d1833711-e8d4-42a6-8c94-293209e85509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:09.354698 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1024/2030] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:09.364608 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb6337-2547-47ab-bdd7-f76871f155c2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:09.366001 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6ecb6337-2547-47ab-bdd7-f76871f155c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:09.426640 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb6337-2547-47ab-bdd7-f76871f155c2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:09.430398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbae0b5-0e4c-4f9e-8fed-400e236ab566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:09.431005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbae0b5-0e4c-4f9e-8fed-400e236ab566 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:09.431279 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbae0b5-0e4c-4f9e-8fed-400e236ab566 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:09.431546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbae0b5-0e4c-4f9e-8fed-400e236ab566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:09.440923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbae0b5-0e4c-4f9e-8fed-400e236ab566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:09.442620 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbae0b5-0e4c-4f9e-8fed-400e236ab566 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:09.453030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1007/2031] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:31:09.726442 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1833711-e8d4-42a6-8c94-293209e85509 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:09.727852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d1833711-e8d4-42a6-8c94-293209e85509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:09.739655 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1833711-e8d4-42a6-8c94-293209e85509 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:09.744257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79966ef-09fd-4233-938e-af01be76f06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:09.744883 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79966ef-09fd-4233-938e-af01be76f06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:09.745166 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79966ef-09fd-4233-938e-af01be76f06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:09.745427 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79966ef-09fd-4233-938e-af01be76f06d admin admin] PATH_INFO: `/v3/projects/f0ac99e4d7fc4caea4c26c17ec1756ae` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:09.746548 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79966ef-09fd-4233-938e-af01be76f06d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ac99e4d7fc4caea4c26c17ec1756ae)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:09.748754 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79966ef-09fd-4233-938e-af01be76f06d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:09.794614 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a79966ef-09fd-4233-938e-af01be76f06d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ac99e4d7fc4caea4c26c17ec1756ae', 'request_id': 'req-a79966ef-09fd-4233-938e-af01be76f06d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:09.801832 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a79966ef-09fd-4233-938e-af01be76f06d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ac99e4d7fc4caea4c26c17ec1756ae', 'request_id': 'req-a79966ef-09fd-4233-938e-af01be76f06d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:09.808020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a79966ef-09fd-4233-938e-af01be76f06d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ac99e4d7fc4caea4c26c17ec1756ae', 'request_id': 'req-a79966ef-09fd-4233-938e-af01be76f06d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:09.819352 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a79966ef-09fd-4233-938e-af01be76f06d admin admin] The token cache is being invalidate because project f0ac99e4d7fc4caea4c26c17ec1756ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:31:09.819637 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a79966ef-09fd-4233-938e-af01be76f06d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:09.820288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a79966ef-09fd-4233-938e-af01be76f06d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:09.821763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1025/2032] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:31:09 2022] DELETE /identity/v3/projects/f0ac99e4d7fc4caea4c26c17ec1756ae => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:09.826449 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbae0b5-0e4c-4f9e-8fed-400e236ab566 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:09.835894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbae0b5-0e4c-4f9e-8fed-400e236ab566 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:09.881954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:09.893218 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d3918-a1f6-43bb-aa48-27d81c9fdd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:09.893863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d3918-a1f6-43bb-aa48-27d81c9fdd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:09.894164 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d3918-a1f6-43bb-aa48-27d81c9fdd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:09.894438 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d3918-a1f6-43bb-aa48-27d81c9fdd5d admin admin] PATH_INFO: `/v3/users/593ec5de6fb14e61b2facd42ba37ad0d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:09.895562 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d3918-a1f6-43bb-aa48-27d81c9fdd5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=593ec5de6fb14e61b2facd42ba37ad0d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:09.897550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d3918-a1f6-43bb-aa48-27d81c9fdd5d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:09.942448 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0c9d3918-a1f6-43bb-aa48-27d81c9fdd5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593ec5de6fb14e61b2facd42ba37ad0d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:09.943092 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0c9d3918-a1f6-43bb-aa48-27d81c9fdd5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593ec5de6fb14e61b2facd42ba37ad0d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:09.949934 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0c9d3918-a1f6-43bb-aa48-27d81c9fdd5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593ec5de6fb14e61b2facd42ba37ad0d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:09.951193 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0c9d3918-a1f6-43bb-aa48-27d81c9fdd5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593ec5de6fb14e61b2facd42ba37ad0d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:09.958180 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0c9d3918-a1f6-43bb-aa48-27d81c9fdd5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593ec5de6fb14e61b2facd42ba37ad0d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:09.975587 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1008/2033] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:31:09 2022] DELETE /identity/v3/users/593ec5de6fb14e61b2facd42ba37ad0d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:10.236878 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79966ef-09fd-4233-938e-af01be76f06d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:10.238323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a79966ef-09fd-4233-938e-af01be76f06d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:10.253567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79966ef-09fd-4233-938e-af01be76f06d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:10.257326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:10.312384 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420db54-c8e2-482d-9816-dfbf7253ef37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:10.313011 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420db54-c8e2-482d-9816-dfbf7253ef37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:10.313285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420db54-c8e2-482d-9816-dfbf7253ef37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:10.313552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420db54-c8e2-482d-9816-dfbf7253ef37 admin admin] PATH_INFO: `/v3/projects/24527dc7dd3540a6b90ce26b80f603c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:10.314646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420db54-c8e2-482d-9816-dfbf7253ef37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24527dc7dd3540a6b90ce26b80f603c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:10.316626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420db54-c8e2-482d-9816-dfbf7253ef37 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:10.362279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4420db54-c8e2-482d-9816-dfbf7253ef37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24527dc7dd3540a6b90ce26b80f603c3', 'request_id': 'req-4420db54-c8e2-482d-9816-dfbf7253ef37'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:10.369365 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4420db54-c8e2-482d-9816-dfbf7253ef37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24527dc7dd3540a6b90ce26b80f603c3', 'request_id': 'req-4420db54-c8e2-482d-9816-dfbf7253ef37'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:10.377142 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4420db54-c8e2-482d-9816-dfbf7253ef37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24527dc7dd3540a6b90ce26b80f603c3', 'request_id': 'req-4420db54-c8e2-482d-9816-dfbf7253ef37'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:10.387232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4420db54-c8e2-482d-9816-dfbf7253ef37 admin admin] The token cache is being invalidate because project 24527dc7dd3540a6b90ce26b80f603c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:31:10.387513 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4420db54-c8e2-482d-9816-dfbf7253ef37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:10.388171 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4420db54-c8e2-482d-9816-dfbf7253ef37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:10.389629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1026/2034] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:31:10 2022] DELETE /identity/v3/projects/24527dc7dd3540a6b90ce26b80f603c3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:10.394409 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7af3e-3f5e-4c0b-bc24-4eff59e4d1dc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:10.394886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7af3e-3f5e-4c0b-bc24-4eff59e4d1dc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:10.395003 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7af3e-3f5e-4c0b-bc24-4eff59e4d1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:10.414298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-06f7af3e-3f5e-4c0b-bc24-4eff59e4d1dc None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:10.415518 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-06f7af3e-3f5e-4c0b-bc24-4eff59e4d1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:10.473036 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1009/2035] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:10.480756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61f268-e66e-4859-acb6-f4ac80c16a7d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:10.480987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61f268-e66e-4859-acb6-f4ac80c16a7d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:10.481257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61f268-e66e-4859-acb6-f4ac80c16a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:10.502627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-df61f268-e66e-4859-acb6-f4ac80c16a7d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:10.504344 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-df61f268-e66e-4859-acb6-f4ac80c16a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:10.512181 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1027/2036] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:10.517876 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7af3e-3f5e-4c0b-bc24-4eff59e4d1dc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:10.527672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7af3e-3f5e-4c0b-bc24-4eff59e4d1dc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:10.534004 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d427e-53d4-455c-9c51-fc38d10b73cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:10.534602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d427e-53d4-455c-9c51-fc38d10b73cc admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:10.534878 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d427e-53d4-455c-9c51-fc38d10b73cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:10.535148 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d427e-53d4-455c-9c51-fc38d10b73cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:10.535791 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d427e-53d4-455c-9c51-fc38d10b73cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:31:10.536131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d427e-53d4-455c-9c51-fc38d10b73cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:10.537826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d427e-53d4-455c-9c51-fc38d10b73cc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:10.550378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1010/2037] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:31:10.554680 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61f268-e66e-4859-acb6-f4ac80c16a7d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:10.563793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61f268-e66e-4859-acb6-f4ac80c16a7d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:10.568413 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a4b3a-ec1b-4129-b038-13fbfccdfc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:10.569002 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a4b3a-ec1b-4129-b038-13fbfccdfc71 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:10.569280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a4b3a-ec1b-4129-b038-13fbfccdfc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:10.569547 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a4b3a-ec1b-4129-b038-13fbfccdfc71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:10.570182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a4b3a-ec1b-4129-b038-13fbfccdfc71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:10.572119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a4b3a-ec1b-4129-b038-13fbfccdfc71 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:10.600749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1028/2038] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:31:10 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:31:10.604816 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d427e-53d4-455c-9c51-fc38d10b73cc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:10.615600 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d427e-53d4-455c-9c51-fc38d10b73cc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:10.676951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fc334-deb2-42cb-89e6-6146617331d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:10.677565 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fc334-deb2-42cb-89e6-6146617331d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:10.677842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fc334-deb2-42cb-89e6-6146617331d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:10.678115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fc334-deb2-42cb-89e6-6146617331d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:10.678758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fc334-deb2-42cb-89e6-6146617331d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:10.680699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fc334-deb2-42cb-89e6-6146617331d1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:10.688665 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:10.706110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1011/2039] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:31:10 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:31:10.707270 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a4b3a-ec1b-4129-b038-13fbfccdfc71 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:10.717818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a4b3a-ec1b-4129-b038-13fbfccdfc71 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:10.722571 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83206067-7d66-49fe-bd94-b19800bc592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:10.723169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83206067-7d66-49fe-bd94-b19800bc592b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:10.723445 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83206067-7d66-49fe-bd94-b19800bc592b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:10.723736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83206067-7d66-49fe-bd94-b19800bc592b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:10.724404 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83206067-7d66-49fe-bd94-b19800bc592b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:10.725988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83206067-7d66-49fe-bd94-b19800bc592b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:10.736409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1029/2040] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:31:10.740039 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fc334-deb2-42cb-89e6-6146617331d1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:10.749833 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fc334-deb2-42cb-89e6-6146617331d1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:10.754357 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655a858-e5b3-4822-a608-1d9996333981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:10.754935 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655a858-e5b3-4822-a608-1d9996333981 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:10.755208 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655a858-e5b3-4822-a608-1d9996333981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:10.755474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655a858-e5b3-4822-a608-1d9996333981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:10.756142 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655a858-e5b3-4822-a608-1d9996333981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:10.757699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655a858-e5b3-4822-a608-1d9996333981 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:10.767339 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1012/2041] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:31:10.771168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83206067-7d66-49fe-bd94-b19800bc592b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:10.781878 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83206067-7d66-49fe-bd94-b19800bc592b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:10.786445 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bd899-a211-4044-abf0-963c7c8402aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:10.787077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bd899-a211-4044-abf0-963c7c8402aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:10.787349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bd899-a211-4044-abf0-963c7c8402aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:10.787617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bd899-a211-4044-abf0-963c7c8402aa admin admin] PATH_INFO: `/v3/projects/7ec44815d4ac43c180465c0cee3c32a9/users/d0d6aef07cd2426aa4d8128d66c2d2f9/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:10.802394 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bd899-a211-4044-abf0-963c7c8402aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec44815d4ac43c180465c0cee3c32a9, user_id=d0d6aef07cd2426aa4d8128d66c2d2f9, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:10.805052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bd899-a211-4044-abf0-963c7c8402aa admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:10.818146 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1030/2042] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:31:10 2022] PUT /identity/v3/projects/7ec44815d4ac43c180465c0cee3c32a9/users/d0d6aef07cd2426aa4d8128d66c2d2f9/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:10.823034 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47614f48-f10a-4ac3-a54c-5cc05fee794b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:10.823319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47614f48-f10a-4ac3-a54c-5cc05fee794b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:10.823589 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47614f48-f10a-4ac3-a54c-5cc05fee794b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:10.842746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-47614f48-f10a-4ac3-a54c-5cc05fee794b None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:10.843918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-47614f48-f10a-4ac3-a54c-5cc05fee794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:10.901688 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1013/2043] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:10.911788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bd899-a211-4044-abf0-963c7c8402aa admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:10.913524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-689bd899-a211-4044-abf0-963c7c8402aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:10.947281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:10.971514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bd899-a211-4044-abf0-963c7c8402aa admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:10.975517 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9fe5d-6067-456a-819c-70b08a516b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:10.976167 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9fe5d-6067-456a-819c-70b08a516b4b service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:10.976443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9fe5d-6067-456a-819c-70b08a516b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:10.976709 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9fe5d-6067-456a-819c-70b08a516b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:10.985695 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9fe5d-6067-456a-819c-70b08a516b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:10.987158 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9fe5d-6067-456a-819c-70b08a516b4b service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:10.996508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1031/2044] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:31:11.610859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f3d3f-8898-4440-ae47-555cd0584709 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:11.611367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f3d3f-8898-4440-ae47-555cd0584709 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:11.611523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f3d3f-8898-4440-ae47-555cd0584709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:11.641871 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-215f3d3f-8898-4440-ae47-555cd0584709 None None] MFA Rules not processed for user `d0d6aef07cd2426aa4d8128d66c2d2f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:11.643253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-215f3d3f-8898-4440-ae47-555cd0584709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:11.734972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1014/2045] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:11.736709 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9fe5d-6067-456a-819c-70b08a516b4b service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:11.757302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9fe5d-6067-456a-819c-70b08a516b4b service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:11.764900 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8cc7c-c061-4fe8-96b6-e1a1dbae444f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:11.766218 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8cc7c-c061-4fe8-96b6-e1a1dbae444f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:11.766513 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8cc7c-c061-4fe8-96b6-e1a1dbae444f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:11.766790 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8cc7c-c061-4fe8-96b6-e1a1dbae444f admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:11.767444 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8cc7c-c061-4fe8-96b6-e1a1dbae444f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:11.770442 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8cc7c-c061-4fe8-96b6-e1a1dbae444f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:11.817727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1032/2046] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:31:11 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:31:11.819221 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f3d3f-8898-4440-ae47-555cd0584709 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:11.833838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f3d3f-8898-4440-ae47-555cd0584709 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:11.916948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c45e93-cc6e-4274-9165-a2fa982d0f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:11.917652 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c45e93-cc6e-4274-9165-a2fa982d0f69 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:11.918000 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c45e93-cc6e-4274-9165-a2fa982d0f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:11.918344 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c45e93-cc6e-4274-9165-a2fa982d0f69 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:11.919060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c45e93-cc6e-4274-9165-a2fa982d0f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:11.921662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c45e93-cc6e-4274-9165-a2fa982d0f69 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:11.938688 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:11.945823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1015/2047] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:31:11 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:31:11.949452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8cc7c-c061-4fe8-96b6-e1a1dbae444f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:11.960484 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8cc7c-c061-4fe8-96b6-e1a1dbae444f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:11.965457 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e6584-813e-4fe6-898d-d17c8f4fe2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:11.966227 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e6584-813e-4fe6-898d-d17c8f4fe2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:11.966572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e6584-813e-4fe6-898d-d17c8f4fe2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:11.966909 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e6584-813e-4fe6-898d-d17c8f4fe2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:11.967631 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e6584-813e-4fe6-898d-d17c8f4fe2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:11.969385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e6584-813e-4fe6-898d-d17c8f4fe2c0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:11.984477 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1033/2048] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:31:11.985820 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c45e93-cc6e-4274-9165-a2fa982d0f69 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:11.996451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c45e93-cc6e-4274-9165-a2fa982d0f69 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:12.002324 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f169e-2d19-40cd-9684-8c0647a2d5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:12.003301 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f169e-2d19-40cd-9684-8c0647a2d5de admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:12.003660 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f169e-2d19-40cd-9684-8c0647a2d5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:12.004035 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f169e-2d19-40cd-9684-8c0647a2d5de admin admin] PATH_INFO: `/v3/projects/77e186cbe66f4e33bbcb6a601e08df36/users/dd71ae68838b43fdabf33f13f33d3bf2/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:12.020484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f169e-2d19-40cd-9684-8c0647a2d5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=77e186cbe66f4e33bbcb6a601e08df36, user_id=dd71ae68838b43fdabf33f13f33d3bf2, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:12.023282 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f169e-2d19-40cd-9684-8c0647a2d5de admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:12.039379 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1016/2049] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:31:11 2022] PUT /identity/v3/projects/77e186cbe66f4e33bbcb6a601e08df36/users/dd71ae68838b43fdabf33f13f33d3bf2/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:12.045497 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e6584-813e-4fe6-898d-d17c8f4fe2c0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:12.056266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e6584-813e-4fe6-898d-d17c8f4fe2c0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:12.121908 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9df2dc-0f72-4a06-9420-e2df54540baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:12.122554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df2dc-0f72-4a06-9420-e2df54540baf admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:12.122832 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df2dc-0f72-4a06-9420-e2df54540baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:12.123102 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df2dc-0f72-4a06-9420-e2df54540baf admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:12.124045 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9df2dc-0f72-4a06-9420-e2df54540baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:12.125655 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9df2dc-0f72-4a06-9420-e2df54540baf admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:12.139382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1034/2050] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:31:12.140255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f169e-2d19-40cd-9684-8c0647a2d5de admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:12.150762 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f169e-2d19-40cd-9684-8c0647a2d5de admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:12.156038 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ecfb4-559a-47c1-884d-2e2bcd810ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:12.156707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ecfb4-559a-47c1-884d-2e2bcd810ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:12.156984 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ecfb4-559a-47c1-884d-2e2bcd810ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:12.157255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ecfb4-559a-47c1-884d-2e2bcd810ad3 admin admin] PATH_INFO: `/v3/projects/77e186cbe66f4e33bbcb6a601e08df36/users/dd71ae68838b43fdabf33f13f33d3bf2/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:12.159200 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ecfb4-559a-47c1-884d-2e2bcd810ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77e186cbe66f4e33bbcb6a601e08df36, user_id=dd71ae68838b43fdabf33f13f33d3bf2, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:12.161900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ecfb4-559a-47c1-884d-2e2bcd810ad3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:12.173810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1017/2051] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:31:12 2022] PUT /identity/v3/projects/77e186cbe66f4e33bbcb6a601e08df36/users/dd71ae68838b43fdabf33f13f33d3bf2/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:12.825358 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682c7dc-efb7-4bf3-8d6a-f1a230ab54f4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:12.826545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682c7dc-efb7-4bf3-8d6a-f1a230ab54f4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:12.826779 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682c7dc-efb7-4bf3-8d6a-f1a230ab54f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:12.860971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0682c7dc-efb7-4bf3-8d6a-f1a230ab54f4 None None] MFA Rules not processed for user `dd71ae68838b43fdabf33f13f33d3bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:12.862351 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0682c7dc-efb7-4bf3-8d6a-f1a230ab54f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:12.961811 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1035/2052] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:12.974361 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f599d4-be74-41d0-84b4-6c88f57ad7e7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:12.974901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f599d4-be74-41d0-84b4-6c88f57ad7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:12.975223 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f599d4-be74-41d0-84b4-6c88f57ad7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:13.014147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c0f599d4-be74-41d0-84b4-6c88f57ad7e7 None None] MFA Rules not processed for user `d0d6aef07cd2426aa4d8128d66c2d2f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:13.015510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c0f599d4-be74-41d0-84b4-6c88f57ad7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:13.095864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1018/2053] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:13.103645 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682c7dc-efb7-4bf3-8d6a-f1a230ab54f4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:13.105653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0682c7dc-efb7-4bf3-8d6a-f1a230ab54f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:13.134379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:13.183344 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682c7dc-efb7-4bf3-8d6a-f1a230ab54f4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:13.189044 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f233ae-bc5d-45dd-a141-e5df82a89c93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:13.189703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f233ae-bc5d-45dd-a141-e5df82a89c93 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:13.189985 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f233ae-bc5d-45dd-a141-e5df82a89c93 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:13.190259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f233ae-bc5d-45dd-a141-e5df82a89c93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:13.198714 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f233ae-bc5d-45dd-a141-e5df82a89c93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:13.200931 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f233ae-bc5d-45dd-a141-e5df82a89c93 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:13.209742 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1036/2054] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:31:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:31:13.451414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f599d4-be74-41d0-84b4-6c88f57ad7e7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:13.517348 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f599d4-be74-41d0-84b4-6c88f57ad7e7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:13.521141 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095568ad-244e-4859-94c8-c4acaa51b860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:13.521752 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095568ad-244e-4859-94c8-c4acaa51b860 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:13.522042 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095568ad-244e-4859-94c8-c4acaa51b860 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:13.522313 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095568ad-244e-4859-94c8-c4acaa51b860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:13.524049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-095568ad-244e-4859-94c8-c4acaa51b860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:13.534563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095568ad-244e-4859-94c8-c4acaa51b860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:13.536020 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095568ad-244e-4859-94c8-c4acaa51b860 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:13.545183 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1019/2055] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:31:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:31:13.890023 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f233ae-bc5d-45dd-a141-e5df82a89c93 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:13.902151 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f233ae-bc5d-45dd-a141-e5df82a89c93 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:13.925367 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea4afc-b031-4af2-8983-630ad4d5dd2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:13.926107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea4afc-b031-4af2-8983-630ad4d5dd2b service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:13.926596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea4afc-b031-4af2-8983-630ad4d5dd2b service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:13.926945 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea4afc-b031-4af2-8983-630ad4d5dd2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:13.928846 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d2ea4afc-b031-4af2-8983-630ad4d5dd2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:14.001784 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea4afc-b031-4af2-8983-630ad4d5dd2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:14.003491 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea4afc-b031-4af2-8983-630ad4d5dd2b service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:14.014607 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1037/2056] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:31:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:31:16.303110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5697b9d-d4f9-4807-8ed2-331e8a913abd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:16.303576 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5697b9d-d4f9-4807-8ed2-331e8a913abd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:16.303668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5697b9d-d4f9-4807-8ed2-331e8a913abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:16.325283 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f5697b9d-d4f9-4807-8ed2-331e8a913abd None None] MFA Rules not processed for user `e0a58360f5f7435b91c3d5be02adc3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:16.326554 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f5697b9d-d4f9-4807-8ed2-331e8a913abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:16.389207 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1020/2057] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:24.009176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=51 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:26.382352 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:30.077348 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea4afc-b031-4af2-8983-630ad4d5dd2b service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:30.078768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d2ea4afc-b031-4af2-8983-630ad4d5dd2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:30.143170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea4afc-b031-4af2-8983-630ad4d5dd2b service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:30.146818 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1175d-164c-4945-98f9-0a6645f448c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:30.147424 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1175d-164c-4945-98f9-0a6645f448c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:30.147700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1175d-164c-4945-98f9-0a6645f448c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:30.148082 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1175d-164c-4945-98f9-0a6645f448c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:30.158098 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1175d-164c-4945-98f9-0a6645f448c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:30.160265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1175d-164c-4945-98f9-0a6645f448c1 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:30.171281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1038/2058] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:31:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:31:30.852629 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1366-1b72-448b-9131-efb4025ab830 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:30.853317 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1366-1b72-448b-9131-efb4025ab830 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:30.853317 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1366-1b72-448b-9131-efb4025ab830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:30.875035 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3bce1366-1b72-448b-9131-efb4025ab830 None None] MFA Rules not processed for user `38b48da35205469abf5aa714dacfe6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:30.876288 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3bce1366-1b72-448b-9131-efb4025ab830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:30.890655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1021/2059] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:40.166249 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=26 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:40.872736 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:52.012620 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad21c8e-1931-4930-b092-d7e213233f6e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:52.013150 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad21c8e-1931-4930-b092-d7e213233f6e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:52.013150 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad21c8e-1931-4930-b092-d7e213233f6e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:52.015182 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1039/2060] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 17 10:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:31:52.047734 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd20bd-328f-4a9e-8a9e-758957990eed None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:52.048320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd20bd-328f-4a9e-8a9e-758957990eed None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:52.048411 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd20bd-328f-4a9e-8a9e-758957990eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:52.071946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ffdd20bd-328f-4a9e-8a9e-758957990eed None None] MFA Rules not processed for user `dd52eee25ef347e1ae905cc3cba17284`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:52.073222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ffdd20bd-328f-4a9e-8a9e-758957990eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:52.157525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1022/2061] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 17 10:31:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:52.168883 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad21c8e-1931-4930-b092-d7e213233f6e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:52.171096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cad21c8e-1931-4930-b092-d7e213233f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:52.189016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad21c8e-1931-4930-b092-d7e213233f6e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:52.194088 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b999e5-053b-45d8-b03c-21453ce8c00e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd52eee25ef347e1ae905cc3cba17284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:52.195345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b999e5-053b-45d8-b03c-21453ce8c00e service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:52.195345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b999e5-053b-45d8-b03c-21453ce8c00e service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:52.195345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b999e5-053b-45d8-b03c-21453ce8c00e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:52.205110 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b999e5-053b-45d8-b03c-21453ce8c00e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:52.206879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b999e5-053b-45d8-b03c-21453ce8c00e service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:52.217400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1040/2062] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:31:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:31:52.548778 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2063424-1b81-441c-ac34-14931acdd30b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:52.549215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2063424-1b81-441c-ac34-14931acdd30b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:52.549330 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2063424-1b81-441c-ac34-14931acdd30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:52.555311 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b999e5-053b-45d8-b03c-21453ce8c00e service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:52.565825 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b999e5-053b-45d8-b03c-21453ce8c00e service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:52.569603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c2063424-1b81-441c-ac34-14931acdd30b None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:52.570845 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c2063424-1b81-441c-ac34-14931acdd30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:52.572047 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6d9ee-3ac2-465c-adf8-3b5e80af643a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd52eee25ef347e1ae905cc3cba17284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:52.572685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6d9ee-3ac2-465c-adf8-3b5e80af643a service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:52.572964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6d9ee-3ac2-465c-adf8-3b5e80af643a service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:52.573286 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6d9ee-3ac2-465c-adf8-3b5e80af643a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:52.574988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-73b6d9ee-3ac2-465c-adf8-3b5e80af643a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:52.586854 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6d9ee-3ac2-465c-adf8-3b5e80af643a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:52.588481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6d9ee-3ac2-465c-adf8-3b5e80af643a service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:52.599373 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1041/2063] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:31:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:31:52.634222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1023/2064] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 17 10:31:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:52.657693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6d9ee-3ac2-465c-adf8-3b5e80af643a service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:52.685839 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2063424-1b81-441c-ac34-14931acdd30b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:52.687253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c2063424-1b81-441c-ac34-14931acdd30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:52.722455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6d9ee-3ac2-465c-adf8-3b5e80af643a service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:52.727105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a22900-97c4-4635-9d57-b27888b1c0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:52.727729 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a22900-97c4-4635-9d57-b27888b1c0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:52.728265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a22900-97c4-4635-9d57-b27888b1c0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:52.728409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a22900-97c4-4635-9d57-b27888b1c0b3 admin admin] PATH_INFO: `/v3/users/d0d6aef07cd2426aa4d8128d66c2d2f9` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:52.729479 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a22900-97c4-4635-9d57-b27888b1c0b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0d6aef07cd2426aa4d8128d66c2d2f9)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:52.731398 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a22900-97c4-4635-9d57-b27888b1c0b3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:52.758795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2063424-1b81-441c-ac34-14931acdd30b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:52.764625 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a9887-5bce-41d2-8161-aedfe70d0212 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:52.765508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a9887-5bce-41d2-8161-aedfe70d0212 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:52.765848 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a9887-5bce-41d2-8161-aedfe70d0212 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:52.766327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a9887-5bce-41d2-8161-aedfe70d0212 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:52.774846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a9887-5bce-41d2-8161-aedfe70d0212 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:52.776708 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a9887-5bce-41d2-8161-aedfe70d0212 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:52.780190 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c9a22900-97c4-4635-9d57-b27888b1c0b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0d6aef07cd2426aa4d8128d66c2d2f9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:52.780872 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c9a22900-97c4-4635-9d57-b27888b1c0b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0d6aef07cd2426aa4d8128d66c2d2f9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:52.785447 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1024/2065] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:31:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 10:31:52.788724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c9a22900-97c4-4635-9d57-b27888b1c0b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0d6aef07cd2426aa4d8128d66c2d2f9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:52.789273 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c9a22900-97c4-4635-9d57-b27888b1c0b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0d6aef07cd2426aa4d8128d66c2d2f9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:52.798397 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c9a22900-97c4-4635-9d57-b27888b1c0b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0d6aef07cd2426aa4d8128d66c2d2f9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:52.829681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1042/2066] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:31:52 2022] DELETE /identity/v3/users/d0d6aef07cd2426aa4d8128d66c2d2f9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:53.044276 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a9887-5bce-41d2-8161-aedfe70d0212 service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:53.058092 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a9887-5bce-41d2-8161-aedfe70d0212 service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:53.127401 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:53.161938 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd933a90-4abd-4aaf-8bdc-4606092e5526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:53.162578 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd933a90-4abd-4aaf-8bdc-4606092e5526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:53.163293 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd933a90-4abd-4aaf-8bdc-4606092e5526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:53.163769 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd933a90-4abd-4aaf-8bdc-4606092e5526 admin admin] PATH_INFO: `/v3/projects/7ec44815d4ac43c180465c0cee3c32a9` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:53.165108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd933a90-4abd-4aaf-8bdc-4606092e5526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec44815d4ac43c180465c0cee3c32a9)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:53.167184 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd933a90-4abd-4aaf-8bdc-4606092e5526 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:53.252485 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fd933a90-4abd-4aaf-8bdc-4606092e5526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec44815d4ac43c180465c0cee3c32a9', 'request_id': 'req-fd933a90-4abd-4aaf-8bdc-4606092e5526'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:53.263748 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fd933a90-4abd-4aaf-8bdc-4606092e5526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec44815d4ac43c180465c0cee3c32a9', 'request_id': 'req-fd933a90-4abd-4aaf-8bdc-4606092e5526'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:53.274041 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fd933a90-4abd-4aaf-8bdc-4606092e5526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec44815d4ac43c180465c0cee3c32a9', 'request_id': 'req-fd933a90-4abd-4aaf-8bdc-4606092e5526'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:53.286564 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fd933a90-4abd-4aaf-8bdc-4606092e5526 admin admin] The token cache is being invalidate because project 7ec44815d4ac43c180465c0cee3c32a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:31:53.286963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fd933a90-4abd-4aaf-8bdc-4606092e5526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:53.287791 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fd933a90-4abd-4aaf-8bdc-4606092e5526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:53.289724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1025/2067] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:31:53 2022] DELETE /identity/v3/projects/7ec44815d4ac43c180465c0cee3c32a9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:53.293519 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a22900-97c4-4635-9d57-b27888b1c0b3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:53.295608 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c9a22900-97c4-4635-9d57-b27888b1c0b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:53.309540 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a22900-97c4-4635-9d57-b27888b1c0b3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:53.363277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:53.376088 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84473ed2-3cc6-4e13-a48e-b5d62167efa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:53.376984 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84473ed2-3cc6-4e13-a48e-b5d62167efa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:53.377630 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84473ed2-3cc6-4e13-a48e-b5d62167efa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:53.378656 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84473ed2-3cc6-4e13-a48e-b5d62167efa6 admin admin] PATH_INFO: `/v3/users/dd71ae68838b43fdabf33f13f33d3bf2` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:53.380011 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84473ed2-3cc6-4e13-a48e-b5d62167efa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd71ae68838b43fdabf33f13f33d3bf2)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:53.382113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84473ed2-3cc6-4e13-a48e-b5d62167efa6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:53.439005 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-84473ed2-3cc6-4e13-a48e-b5d62167efa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd71ae68838b43fdabf33f13f33d3bf2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:53.439668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-84473ed2-3cc6-4e13-a48e-b5d62167efa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd71ae68838b43fdabf33f13f33d3bf2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:53.449359 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-84473ed2-3cc6-4e13-a48e-b5d62167efa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd71ae68838b43fdabf33f13f33d3bf2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:53.450064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-84473ed2-3cc6-4e13-a48e-b5d62167efa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd71ae68838b43fdabf33f13f33d3bf2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:53.458983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-84473ed2-3cc6-4e13-a48e-b5d62167efa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd71ae68838b43fdabf33f13f33d3bf2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:53.484029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1043/2068] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:31:53 2022] DELETE /identity/v3/users/dd71ae68838b43fdabf33f13f33d3bf2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:53.679546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd933a90-4abd-4aaf-8bdc-4606092e5526 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:53.681190 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fd933a90-4abd-4aaf-8bdc-4606092e5526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:53.700741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd933a90-4abd-4aaf-8bdc-4606092e5526 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:53.778058 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd822395-f9a2-4b8b-afe2-18d6b26c2a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:53.778888 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd822395-f9a2-4b8b-afe2-18d6b26c2a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:53.779435 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd822395-f9a2-4b8b-afe2-18d6b26c2a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:53.779811 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd822395-f9a2-4b8b-afe2-18d6b26c2a2b admin admin] PATH_INFO: `/v3/projects/77e186cbe66f4e33bbcb6a601e08df36` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:53.781122 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd822395-f9a2-4b8b-afe2-18d6b26c2a2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=77e186cbe66f4e33bbcb6a601e08df36)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:53.783190 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd822395-f9a2-4b8b-afe2-18d6b26c2a2b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:53.842459 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cd822395-f9a2-4b8b-afe2-18d6b26c2a2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77e186cbe66f4e33bbcb6a601e08df36', 'request_id': 'req-cd822395-f9a2-4b8b-afe2-18d6b26c2a2b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:53.855886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cd822395-f9a2-4b8b-afe2-18d6b26c2a2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77e186cbe66f4e33bbcb6a601e08df36', 'request_id': 'req-cd822395-f9a2-4b8b-afe2-18d6b26c2a2b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:53.864850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cd822395-f9a2-4b8b-afe2-18d6b26c2a2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77e186cbe66f4e33bbcb6a601e08df36', 'request_id': 'req-cd822395-f9a2-4b8b-afe2-18d6b26c2a2b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:53.867118 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:53.882794 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cd822395-f9a2-4b8b-afe2-18d6b26c2a2b admin admin] The token cache is being invalidate because project 77e186cbe66f4e33bbcb6a601e08df36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:31:53.883218 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cd822395-f9a2-4b8b-afe2-18d6b26c2a2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:53.883959 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cd822395-f9a2-4b8b-afe2-18d6b26c2a2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:31:53.889666 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1026/2069] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:31:53 2022] DELETE /identity/v3/projects/77e186cbe66f4e33bbcb6a601e08df36 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:31:53.891623 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643fc55-1bea-42f6-8be2-d1e1377f64fd None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:53.892065 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643fc55-1bea-42f6-8be2-d1e1377f64fd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:53.892472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643fc55-1bea-42f6-8be2-d1e1377f64fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:53.917716 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7643fc55-1bea-42f6-8be2-d1e1377f64fd None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:53.918932 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7643fc55-1bea-42f6-8be2-d1e1377f64fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:53.986613 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1044/2070] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:53.993933 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d7f7d-e952-4f50-a5ba-9a1e1a9c7c90 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:53.994230 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d7f7d-e952-4f50-a5ba-9a1e1a9c7c90 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:53.994507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d7f7d-e952-4f50-a5ba-9a1e1a9c7c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:54.018398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-940d7f7d-e952-4f50-a5ba-9a1e1a9c7c90 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:54.019635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-940d7f7d-e952-4f50-a5ba-9a1e1a9c7c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:54.027851 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1027/2071] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:54.032751 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643fc55-1bea-42f6-8be2-d1e1377f64fd None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:54.043513 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643fc55-1bea-42f6-8be2-d1e1377f64fd None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:54.049156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cd987-82de-4b6f-abd8-d2c7de9b91be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:54.050144 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cd987-82de-4b6f-abd8-d2c7de9b91be admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:54.050520 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cd987-82de-4b6f-abd8-d2c7de9b91be admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:54.050941 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cd987-82de-4b6f-abd8-d2c7de9b91be admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:54.051657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387cd987-82de-4b6f-abd8-d2c7de9b91be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:31:54.052217 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387cd987-82de-4b6f-abd8-d2c7de9b91be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:54.053915 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387cd987-82de-4b6f-abd8-d2c7de9b91be admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:54.073246 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1045/2072] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:31:54.077549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d7f7d-e952-4f50-a5ba-9a1e1a9c7c90 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:54.087280 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d7f7d-e952-4f50-a5ba-9a1e1a9c7c90 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:54.095270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea051fd-5137-4692-8d4e-2330d4429be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:54.095887 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea051fd-5137-4692-8d4e-2330d4429be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:54.096276 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea051fd-5137-4692-8d4e-2330d4429be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:54.096742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea051fd-5137-4692-8d4e-2330d4429be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:54.097348 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea051fd-5137-4692-8d4e-2330d4429be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:54.099357 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea051fd-5137-4692-8d4e-2330d4429be9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:54.132082 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1028/2073] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:31:54 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:31:54.136207 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cd987-82de-4b6f-abd8-d2c7de9b91be admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:54.149431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cd987-82de-4b6f-abd8-d2c7de9b91be admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:54.220316 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336f8b4-4cce-47d9-98cf-2dbe30387a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:54.221369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336f8b4-4cce-47d9-98cf-2dbe30387a91 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:54.221826 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336f8b4-4cce-47d9-98cf-2dbe30387a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:54.222099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336f8b4-4cce-47d9-98cf-2dbe30387a91 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:54.222765 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336f8b4-4cce-47d9-98cf-2dbe30387a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:54.224762 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336f8b4-4cce-47d9-98cf-2dbe30387a91 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:54.235567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:54.260273 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1046/2074] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:31:54 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:31:54.261467 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea051fd-5137-4692-8d4e-2330d4429be9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:54.274848 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea051fd-5137-4692-8d4e-2330d4429be9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:54.280535 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186a9ef-73fd-425a-8685-335d525cf879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:54.281391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186a9ef-73fd-425a-8685-335d525cf879 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:54.281683 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186a9ef-73fd-425a-8685-335d525cf879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:54.281949 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186a9ef-73fd-425a-8685-335d525cf879 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:54.282601 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186a9ef-73fd-425a-8685-335d525cf879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:54.284225 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186a9ef-73fd-425a-8685-335d525cf879 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:54.299086 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1029/2075] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:31:54.300321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336f8b4-4cce-47d9-98cf-2dbe30387a91 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:54.311881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336f8b4-4cce-47d9-98cf-2dbe30387a91 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:54.316837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c243b-d63d-4f44-9893-dd13486d89a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:54.317557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c243b-d63d-4f44-9893-dd13486d89a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:54.317912 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c243b-d63d-4f44-9893-dd13486d89a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:54.318255 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c243b-d63d-4f44-9893-dd13486d89a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:54.319020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c243b-d63d-4f44-9893-dd13486d89a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:54.320856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c243b-d63d-4f44-9893-dd13486d89a7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:54.332936 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1047/2076] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:31:54.337227 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186a9ef-73fd-425a-8685-335d525cf879 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:54.350226 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186a9ef-73fd-425a-8685-335d525cf879 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:54.355776 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8000b4-1a41-4210-8b1d-5b49632ed502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:54.356475 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8000b4-1a41-4210-8b1d-5b49632ed502 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:54.356758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8000b4-1a41-4210-8b1d-5b49632ed502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:54.358025 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8000b4-1a41-4210-8b1d-5b49632ed502 admin admin] PATH_INFO: `/v3/projects/6653fc3deb0447b69a455dabe9cb93a2/users/4cbbc144f37e4cc0a74d547b6f429bd5/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:54.377994 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8000b4-1a41-4210-8b1d-5b49632ed502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6653fc3deb0447b69a455dabe9cb93a2, user_id=4cbbc144f37e4cc0a74d547b6f429bd5, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:54.381237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8000b4-1a41-4210-8b1d-5b49632ed502 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:54.412484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1030/2077] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:31:54 2022] PUT /identity/v3/projects/6653fc3deb0447b69a455dabe9cb93a2/users/4cbbc144f37e4cc0a74d547b6f429bd5/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:31:54.468283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91a424-545f-49e2-9c61-7a8c74f02959 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:54.468990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91a424-545f-49e2-9c61-7a8c74f02959 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:54.469497 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91a424-545f-49e2-9c61-7a8c74f02959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:54.506675 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0f91a424-545f-49e2-9c61-7a8c74f02959 None None] MFA Rules not processed for user `4cbbc144f37e4cc0a74d547b6f429bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:31:54.508970 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0f91a424-545f-49e2-9c61-7a8c74f02959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:54.609802 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1048/2078] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:31:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:31:54.621717 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8000b4-1a41-4210-8b1d-5b49632ed502 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:31:54.624124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0c8000b4-1a41-4210-8b1d-5b49632ed502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:31:54.699801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8000b4-1a41-4210-8b1d-5b49632ed502 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:31:54.703731 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bd4b2-f49a-4567-9481-10ba0703fb0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd5d41f6a16403f990a4cd5922a2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:31:54.704466 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bd4b2-f49a-4567-9481-10ba0703fb0b service glance] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:31:54.704797 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bd4b2-f49a-4567-9481-10ba0703fb0b service glance] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:31:54.705137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bd4b2-f49a-4567-9481-10ba0703fb0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:31:54.715171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bd4b2-f49a-4567-9481-10ba0703fb0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:31:54.716805 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bd4b2-f49a-4567-9481-10ba0703fb0b service glance] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:31:54.726586 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1031/2079] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:31:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:32:04.606147 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:04.722109 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=56,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:07.440979 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd64437-7964-4b59-9f5d-2d389a240764 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:07.441490 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd64437-7964-4b59-9f5d-2d389a240764 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:07.441678 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd64437-7964-4b59-9f5d-2d389a240764 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:07.443160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1049/2080] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 17 10:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 10:32:07.448592 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284fad3-4ff3-4d2b-9a8f-d51e33932929 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:07.449064 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284fad3-4ff3-4d2b-9a8f-d51e33932929 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:07.449181 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284fad3-4ff3-4d2b-9a8f-d51e33932929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:07.468763 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3284fad3-4ff3-4d2b-9a8f-d51e33932929 None None] MFA Rules not processed for user `a80cc7ec3d2d49f88c81403f918a6900`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:32:07.469954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3284fad3-4ff3-4d2b-9a8f-d51e33932929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:07.537955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1032/2081] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 17 10:32:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:32:07.549569 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd64437-7964-4b59-9f5d-2d389a240764 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:07.551369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bfd64437-7964-4b59-9f5d-2d389a240764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:07.565093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd64437-7964-4b59-9f5d-2d389a240764 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:07.569006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade2cd5-c62b-4e98-9167-cfea86fd35cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd5d41f6a16403f990a4cd5922a2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:07.569670 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade2cd5-c62b-4e98-9167-cfea86fd35cf service glance] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:07.570020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade2cd5-c62b-4e98-9167-cfea86fd35cf service glance] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:07.570357 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade2cd5-c62b-4e98-9167-cfea86fd35cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:07.580776 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade2cd5-c62b-4e98-9167-cfea86fd35cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:07.582205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade2cd5-c62b-4e98-9167-cfea86fd35cf service glance] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:07.593569 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1050/2082] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:32:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:32:09.544638 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda15d09-9b52-4845-a671-7b234a236ae8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:09.545118 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda15d09-9b52-4845-a671-7b234a236ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:09.545283 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda15d09-9b52-4845-a671-7b234a236ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:09.564128 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bda15d09-9b52-4845-a671-7b234a236ae8 None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:32:09.565247 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bda15d09-9b52-4845-a671-7b234a236ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:09.619415 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1033/2083] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 17 10:32:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:32:09.631642 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade2cd5-c62b-4e98-9167-cfea86fd35cf service glance] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:09.633032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7ade2cd5-c62b-4e98-9167-cfea86fd35cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:09.699478 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade2cd5-c62b-4e98-9167-cfea86fd35cf service glance] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:09.705109 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e3689-8ac2-466f-a62d-9f1c63c8837c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:09.705709 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e3689-8ac2-466f-a62d-9f1c63c8837c service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:09.705989 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e3689-8ac2-466f-a62d-9f1c63c8837c service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:09.706265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e3689-8ac2-466f-a62d-9f1c63c8837c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:09.714157 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e3689-8ac2-466f-a62d-9f1c63c8837c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:09.715777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e3689-8ac2-466f-a62d-9f1c63c8837c service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:09.724277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1051/2084] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:32:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 10:32:14.687414 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda15d09-9b52-4845-a671-7b234a236ae8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:14.761179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda15d09-9b52-4845-a671-7b234a236ae8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:14.767344 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc7563-fd2e-4b6c-a692-05c607395d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:14.768155 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc7563-fd2e-4b6c-a692-05c607395d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:14.768538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc7563-fd2e-4b6c-a692-05c607395d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:14.768915 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc7563-fd2e-4b6c-a692-05c607395d9b admin admin] PATH_INFO: `/v3/users/4cbbc144f37e4cc0a74d547b6f429bd5` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:14.770336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc7563-fd2e-4b6c-a692-05c607395d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cbbc144f37e4cc0a74d547b6f429bd5)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:14.772922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc7563-fd2e-4b6c-a692-05c607395d9b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:14.827869 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:14.834844 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-10fc7563-fd2e-4b6c-a692-05c607395d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cbbc144f37e4cc0a74d547b6f429bd5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:14.835639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-10fc7563-fd2e-4b6c-a692-05c607395d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cbbc144f37e4cc0a74d547b6f429bd5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:14.843605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-10fc7563-fd2e-4b6c-a692-05c607395d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cbbc144f37e4cc0a74d547b6f429bd5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:14.844261 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-10fc7563-fd2e-4b6c-a692-05c607395d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cbbc144f37e4cc0a74d547b6f429bd5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:14.851354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-10fc7563-fd2e-4b6c-a692-05c607395d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cbbc144f37e4cc0a74d547b6f429bd5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:14.870342 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1034/2085] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:32:14 2022] DELETE /identity/v3/users/4cbbc144f37e4cc0a74d547b6f429bd5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:32:14.874801 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa65b1-d7f2-4d68-8aca-36d731ab871a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:14.875551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa65b1-d7f2-4d68-8aca-36d731ab871a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:14.875665 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa65b1-d7f2-4d68-8aca-36d731ab871a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:14.896926 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c0fa65b1-d7f2-4d68-8aca-36d731ab871a None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:32:14.898188 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c0fa65b1-d7f2-4d68-8aca-36d731ab871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:14.961950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1052/2086] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:32:14.971853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc7563-fd2e-4b6c-a692-05c607395d9b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:14.973387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-10fc7563-fd2e-4b6c-a692-05c607395d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:15.033288 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc7563-fd2e-4b6c-a692-05c607395d9b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:15.037101 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d89b6-92a0-4fe1-833c-0efe8e58a53d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:15.037739 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d89b6-92a0-4fe1-833c-0efe8e58a53d service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:15.038021 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d89b6-92a0-4fe1-833c-0efe8e58a53d service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:15.038320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d89b6-92a0-4fe1-833c-0efe8e58a53d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:15.048232 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d89b6-92a0-4fe1-833c-0efe8e58a53d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:15.049673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d89b6-92a0-4fe1-833c-0efe8e58a53d service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:15.067087 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1035/2087] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:32:15.356801 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa65b1-d7f2-4d68-8aca-36d731ab871a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:15.358930 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c0fa65b1-d7f2-4d68-8aca-36d731ab871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:15.384866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa65b1-d7f2-4d68-8aca-36d731ab871a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:15.389779 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3049b6a-1268-4aa2-a8ef-090f7bc5ba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:15.390424 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3049b6a-1268-4aa2-a8ef-090f7bc5ba91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:15.390700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3049b6a-1268-4aa2-a8ef-090f7bc5ba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:15.390966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3049b6a-1268-4aa2-a8ef-090f7bc5ba91 admin admin] PATH_INFO: `/v3/projects/6653fc3deb0447b69a455dabe9cb93a2` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:15.392106 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3049b6a-1268-4aa2-a8ef-090f7bc5ba91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6653fc3deb0447b69a455dabe9cb93a2)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:15.394008 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3049b6a-1268-4aa2-a8ef-090f7bc5ba91 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:15.448385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e3049b6a-1268-4aa2-a8ef-090f7bc5ba91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6653fc3deb0447b69a455dabe9cb93a2', 'request_id': 'req-e3049b6a-1268-4aa2-a8ef-090f7bc5ba91'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:15.457267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e3049b6a-1268-4aa2-a8ef-090f7bc5ba91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6653fc3deb0447b69a455dabe9cb93a2', 'request_id': 'req-e3049b6a-1268-4aa2-a8ef-090f7bc5ba91'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:15.464171 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e3049b6a-1268-4aa2-a8ef-090f7bc5ba91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6653fc3deb0447b69a455dabe9cb93a2', 'request_id': 'req-e3049b6a-1268-4aa2-a8ef-090f7bc5ba91'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:15.471763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:15.482769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e3049b6a-1268-4aa2-a8ef-090f7bc5ba91 admin admin] The token cache is being invalidate because project 6653fc3deb0447b69a455dabe9cb93a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:32:15.485250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e3049b6a-1268-4aa2-a8ef-090f7bc5ba91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:15.487799 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e3049b6a-1268-4aa2-a8ef-090f7bc5ba91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:15.493186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1053/2088] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:32:15 2022] DELETE /identity/v3/projects/6653fc3deb0447b69a455dabe9cb93a2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:32:15.495282 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e6bc7-8d28-4852-9064-4cc9504447e2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:15.495428 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e6bc7-8d28-4852-9064-4cc9504447e2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:15.495716 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e6bc7-8d28-4852-9064-4cc9504447e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:15.517695 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d68e6bc7-8d28-4852-9064-4cc9504447e2 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:32:15.520209 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d68e6bc7-8d28-4852-9064-4cc9504447e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:15.584163 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1036/2089] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:32:15.592473 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd4979-a0ae-4259-af9e-bb9786668a65 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:15.592759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd4979-a0ae-4259-af9e-bb9786668a65 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:15.593028 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd4979-a0ae-4259-af9e-bb9786668a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:15.616537 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d5fd4979-a0ae-4259-af9e-bb9786668a65 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:32:15.617916 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d5fd4979-a0ae-4259-af9e-bb9786668a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:15.627507 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1054/2090] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:32:15.631833 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e6bc7-8d28-4852-9064-4cc9504447e2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:15.641894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e6bc7-8d28-4852-9064-4cc9504447e2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:15.646768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345322db-6a36-44f2-8b0f-b9fe80b7c629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:15.647378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345322db-6a36-44f2-8b0f-b9fe80b7c629 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:15.647654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345322db-6a36-44f2-8b0f-b9fe80b7c629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:15.647921 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345322db-6a36-44f2-8b0f-b9fe80b7c629 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:15.648597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345322db-6a36-44f2-8b0f-b9fe80b7c629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:32:15.648898 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345322db-6a36-44f2-8b0f-b9fe80b7c629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:15.650475 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345322db-6a36-44f2-8b0f-b9fe80b7c629 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:15.662507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1037/2091] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:32:15.666855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd4979-a0ae-4259-af9e-bb9786668a65 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:15.676992 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd4979-a0ae-4259-af9e-bb9786668a65 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:15.681759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adad5f-c4f0-4e22-9266-3617b3c13c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:15.682367 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adad5f-c4f0-4e22-9266-3617b3c13c6f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:15.682648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adad5f-c4f0-4e22-9266-3617b3c13c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:15.682919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adad5f-c4f0-4e22-9266-3617b3c13c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:15.683566 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5adad5f-c4f0-4e22-9266-3617b3c13c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:15.686101 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5adad5f-c4f0-4e22-9266-3617b3c13c6f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:15.714742 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1055/2092] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:32:15 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:32:15.718918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345322db-6a36-44f2-8b0f-b9fe80b7c629 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:15.729790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345322db-6a36-44f2-8b0f-b9fe80b7c629 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:15.781336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:15.801308 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51197c4a-c4e3-4023-97e2-eceec3349810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:15.801745 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51197c4a-c4e3-4023-97e2-eceec3349810 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:15.802024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51197c4a-c4e3-4023-97e2-eceec3349810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:15.802294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51197c4a-c4e3-4023-97e2-eceec3349810 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:15.802928 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51197c4a-c4e3-4023-97e2-eceec3349810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:15.804914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51197c4a-c4e3-4023-97e2-eceec3349810 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:15.847988 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1038/2093] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:32:15 2022] POST /identity/v3/users => generated 284 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:32:15.851283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adad5f-c4f0-4e22-9266-3617b3c13c6f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:15.864395 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adad5f-c4f0-4e22-9266-3617b3c13c6f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:15.869403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d0fdb-e023-4eba-bd8d-42706dea844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:15.870108 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d0fdb-e023-4eba-bd8d-42706dea844e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:15.870475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d0fdb-e023-4eba-bd8d-42706dea844e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:15.871004 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d0fdb-e023-4eba-bd8d-42706dea844e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:15.871554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d0fdb-e023-4eba-bd8d-42706dea844e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:15.873694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d0fdb-e023-4eba-bd8d-42706dea844e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:15.888175 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1056/2094] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:32:15.889587 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51197c4a-c4e3-4023-97e2-eceec3349810 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:15.899891 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51197c4a-c4e3-4023-97e2-eceec3349810 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:15.905292 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e237cb-1070-40e3-af83-c4617bcc29ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:15.905905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e237cb-1070-40e3-af83-c4617bcc29ec admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:15.906186 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e237cb-1070-40e3-af83-c4617bcc29ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:15.906605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e237cb-1070-40e3-af83-c4617bcc29ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:15.907265 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e237cb-1070-40e3-af83-c4617bcc29ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:15.910026 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e237cb-1070-40e3-af83-c4617bcc29ec admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:15.926737 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1039/2095] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:32:15.928180 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d0fdb-e023-4eba-bd8d-42706dea844e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:15.938849 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d0fdb-e023-4eba-bd8d-42706dea844e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:15.943699 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17eedc-cb60-4fbf-99ce-e6e3db325eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:15.944510 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17eedc-cb60-4fbf-99ce-e6e3db325eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:15.944866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17eedc-cb60-4fbf-99ce-e6e3db325eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:15.945224 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17eedc-cb60-4fbf-99ce-e6e3db325eb1 admin admin] PATH_INFO: `/v3/projects/4ba559a41d87454c847a289cf6a90322/users/1e75d8d8d2464f21b0217f83fde3e26f/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:15.965355 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17eedc-cb60-4fbf-99ce-e6e3db325eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba559a41d87454c847a289cf6a90322, user_id=1e75d8d8d2464f21b0217f83fde3e26f, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:15.968759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17eedc-cb60-4fbf-99ce-e6e3db325eb1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:15.999966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1057/2096] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:32:15 2022] PUT /identity/v3/projects/4ba559a41d87454c847a289cf6a90322/users/1e75d8d8d2464f21b0217f83fde3e26f/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:32:16.004352 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff73ad1-0e73-4809-8b30-d0e1471820b0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:16.004958 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff73ad1-0e73-4809-8b30-d0e1471820b0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:16.005452 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff73ad1-0e73-4809-8b30-d0e1471820b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:16.049429 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bff73ad1-0e73-4809-8b30-d0e1471820b0 None None] MFA Rules not processed for user `1e75d8d8d2464f21b0217f83fde3e26f`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:32:16.051053 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bff73ad1-0e73-4809-8b30-d0e1471820b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:16.124752 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1040/2097] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:32:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:32:16.139506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17eedc-cb60-4fbf-99ce-e6e3db325eb1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:16.141234 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9a17eedc-cb60-4fbf-99ce-e6e3db325eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:16.199023 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17eedc-cb60-4fbf-99ce-e6e3db325eb1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:16.203306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b62d74-38a7-4ce3-b1fa-3f6b650da3b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd5d41f6a16403f990a4cd5922a2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:16.203987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b62d74-38a7-4ce3-b1fa-3f6b650da3b3 service glance] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:16.204218 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b62d74-38a7-4ce3-b1fa-3f6b650da3b3 service glance] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:16.204488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b62d74-38a7-4ce3-b1fa-3f6b650da3b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:16.213362 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b62d74-38a7-4ce3-b1fa-3f6b650da3b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:16.214790 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b62d74-38a7-4ce3-b1fa-3f6b650da3b3 service glance] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:16.224809 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1058/2098] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:32:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:32:26.121466 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:26.220598 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=53,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:29.841563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff73ad1-0e73-4809-8b30-d0e1471820b0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:29.843556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bff73ad1-0e73-4809-8b30-d0e1471820b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:29.905035 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff73ad1-0e73-4809-8b30-d0e1471820b0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:29.908623 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd102b-730d-4cf8-ac34-05700835a606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:29.909228 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd102b-730d-4cf8-ac34-05700835a606 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:29.909512 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd102b-730d-4cf8-ac34-05700835a606 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:29.909779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd102b-730d-4cf8-ac34-05700835a606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:29.911497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a0dd102b-730d-4cf8-ac34-05700835a606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:29.975735 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd102b-730d-4cf8-ac34-05700835a606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:29.977224 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd102b-730d-4cf8-ac34-05700835a606 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:29.986505 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1041/2099] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:32:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:32:35.165927 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6a916-38cb-49a7-8bf8-e4ba4ec42af1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:35.166388 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6a916-38cb-49a7-8bf8-e4ba4ec42af1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:35.166497 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6a916-38cb-49a7-8bf8-e4ba4ec42af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:35.205586 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0fa6a916-38cb-49a7-8bf8-e4ba4ec42af1 None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:32:35.206781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0fa6a916-38cb-49a7-8bf8-e4ba4ec42af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:35.287578 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1059/2100] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 17 10:32:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:32:35.300398 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd102b-730d-4cf8-ac34-05700835a606 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:35.301759 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a0dd102b-730d-4cf8-ac34-05700835a606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:35.413608 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd102b-730d-4cf8-ac34-05700835a606 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:35.419028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870743f-b95f-432f-8634-e46cf16142b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:35.419651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870743f-b95f-432f-8634-e46cf16142b7 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:35.419948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870743f-b95f-432f-8634-e46cf16142b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:35.420223 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870743f-b95f-432f-8634-e46cf16142b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:35.428365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870743f-b95f-432f-8634-e46cf16142b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:35.429938 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870743f-b95f-432f-8634-e46cf16142b7 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:35.438303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1042/2101] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:32:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 10:32:37.128692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6a916-38cb-49a7-8bf8-e4ba4ec42af1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:37.130111 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0fa6a916-38cb-49a7-8bf8-e4ba4ec42af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:37.142244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6a916-38cb-49a7-8bf8-e4ba4ec42af1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:37.145865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277b8e7-0be0-4adc-b851-0d0379811cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:37.146465 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277b8e7-0be0-4adc-b851-0d0379811cba service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:37.146744 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277b8e7-0be0-4adc-b851-0d0379811cba service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:37.147017 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277b8e7-0be0-4adc-b851-0d0379811cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:37.148719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4277b8e7-0be0-4adc-b851-0d0379811cba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:37.234204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277b8e7-0be0-4adc-b851-0d0379811cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:37.235557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277b8e7-0be0-4adc-b851-0d0379811cba service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:37.254378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1060/2102] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:32:43.792185 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870743f-b95f-432f-8634-e46cf16142b7 service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:43.793845 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3870743f-b95f-432f-8634-e46cf16142b7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:43.804735 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:43.808948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870743f-b95f-432f-8634-e46cf16142b7 service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:43.813751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a700b8-2883-4f15-a625-041f5384b153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:43.814411 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a700b8-2883-4f15-a625-041f5384b153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:43.814690 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a700b8-2883-4f15-a625-041f5384b153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:43.814961 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a700b8-2883-4f15-a625-041f5384b153 admin admin] PATH_INFO: `/v3/users/d0a554db24c541f48ea49015c9cd2dc1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:43.816106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a700b8-2883-4f15-a625-041f5384b153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a554db24c541f48ea49015c9cd2dc1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:43.818057 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a700b8-2883-4f15-a625-041f5384b153 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:43.863158 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-87a700b8-2883-4f15-a625-041f5384b153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a554db24c541f48ea49015c9cd2dc1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:43.863806 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-87a700b8-2883-4f15-a625-041f5384b153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a554db24c541f48ea49015c9cd2dc1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:43.870602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-87a700b8-2883-4f15-a625-041f5384b153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a554db24c541f48ea49015c9cd2dc1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:43.871240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-87a700b8-2883-4f15-a625-041f5384b153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a554db24c541f48ea49015c9cd2dc1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:43.878780 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-87a700b8-2883-4f15-a625-041f5384b153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a554db24c541f48ea49015c9cd2dc1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:43.899410 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1043/2103] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:32:43 2022] DELETE /identity/v3/users/d0a554db24c541f48ea49015c9cd2dc1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:32:44.078045 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277b8e7-0be0-4adc-b851-0d0379811cba service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:44.096934 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277b8e7-0be0-4adc-b851-0d0379811cba service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:44.121846 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:44.156758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:44.157387 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:44.157663 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:44.157950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad admin admin] PATH_INFO: `/v3/projects/92254065467744f68cf34bd6d8550526` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:44.159049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=92254065467744f68cf34bd6d8550526)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:44.160996 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:44.205354 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92254065467744f68cf34bd6d8550526', 'request_id': 'req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:44.212236 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92254065467744f68cf34bd6d8550526', 'request_id': 'req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:44.218912 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92254065467744f68cf34bd6d8550526', 'request_id': 'req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:44.228905 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad admin admin] The token cache is being invalidate because project 92254065467744f68cf34bd6d8550526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:32:44.229186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:44.229809 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:44.231254 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1061/2104] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:32:44 2022] DELETE /identity/v3/projects/92254065467744f68cf34bd6d8550526 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:32:44.235378 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a700b8-2883-4f15-a625-041f5384b153 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:44.236792 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-87a700b8-2883-4f15-a625-041f5384b153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:44.249404 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a700b8-2883-4f15-a625-041f5384b153 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:44.308044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faaad5-a0fc-4803-82c3-46a1098f7d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:44.308684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faaad5-a0fc-4803-82c3-46a1098f7d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:44.308963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faaad5-a0fc-4803-82c3-46a1098f7d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:44.309236 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faaad5-a0fc-4803-82c3-46a1098f7d71 admin admin] PATH_INFO: `/v3/users/56c8e72952e249328f6f2048a17d0910` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:44.310876 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65faaad5-a0fc-4803-82c3-46a1098f7d71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56c8e72952e249328f6f2048a17d0910)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:44.313129 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65faaad5-a0fc-4803-82c3-46a1098f7d71 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:44.374276 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-65faaad5-a0fc-4803-82c3-46a1098f7d71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56c8e72952e249328f6f2048a17d0910'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:44.374975 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-65faaad5-a0fc-4803-82c3-46a1098f7d71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56c8e72952e249328f6f2048a17d0910'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:44.382683 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-65faaad5-a0fc-4803-82c3-46a1098f7d71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56c8e72952e249328f6f2048a17d0910'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:44.383329 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-65faaad5-a0fc-4803-82c3-46a1098f7d71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56c8e72952e249328f6f2048a17d0910'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:44.392843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-65faaad5-a0fc-4803-82c3-46a1098f7d71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56c8e72952e249328f6f2048a17d0910'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:44.403567 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:44.410960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1044/2105] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:32:44 2022] DELETE /identity/v3/users/56c8e72952e249328f6f2048a17d0910 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:32:44.590899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:44.592508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:44.608942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e00a2-4e2b-4eee-977a-a2ee5fdd36ad admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:44.667617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f6130-3d4c-4c19-8581-5b9dea37720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:44.668284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f6130-3d4c-4c19-8581-5b9dea37720e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:44.668568 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f6130-3d4c-4c19-8581-5b9dea37720e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:44.668845 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f6130-3d4c-4c19-8581-5b9dea37720e admin admin] PATH_INFO: `/v3/projects/1530d89e5a8c4ac897d873b190a62634` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:44.670501 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f6130-3d4c-4c19-8581-5b9dea37720e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1530d89e5a8c4ac897d873b190a62634)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:44.672455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f6130-3d4c-4c19-8581-5b9dea37720e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:44.716532 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d1f6130-3d4c-4c19-8581-5b9dea37720e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1530d89e5a8c4ac897d873b190a62634', 'request_id': 'req-7d1f6130-3d4c-4c19-8581-5b9dea37720e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:44.723533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d1f6130-3d4c-4c19-8581-5b9dea37720e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1530d89e5a8c4ac897d873b190a62634', 'request_id': 'req-7d1f6130-3d4c-4c19-8581-5b9dea37720e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:44.725408 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:44.730733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d1f6130-3d4c-4c19-8581-5b9dea37720e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1530d89e5a8c4ac897d873b190a62634', 'request_id': 'req-7d1f6130-3d4c-4c19-8581-5b9dea37720e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:44.742473 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d1f6130-3d4c-4c19-8581-5b9dea37720e admin admin] The token cache is being invalidate because project 1530d89e5a8c4ac897d873b190a62634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:32:44.742770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d1f6130-3d4c-4c19-8581-5b9dea37720e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:44.743376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d1f6130-3d4c-4c19-8581-5b9dea37720e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:44.744865 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1062/2106] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:32:44 2022] DELETE /identity/v3/projects/1530d89e5a8c4ac897d873b190a62634 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:32:45.416091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faaad5-a0fc-4803-82c3-46a1098f7d71 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:45.417488 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-65faaad5-a0fc-4803-82c3-46a1098f7d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:45.430061 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faaad5-a0fc-4803-82c3-46a1098f7d71 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:45.486066 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3386546-c169-46a2-a51e-c515db0addcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:45.486691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3386546-c169-46a2-a51e-c515db0addcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:45.486969 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3386546-c169-46a2-a51e-c515db0addcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:45.487239 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3386546-c169-46a2-a51e-c515db0addcf admin admin] PATH_INFO: `/v3/users/1e75d8d8d2464f21b0217f83fde3e26f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:45.488474 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3386546-c169-46a2-a51e-c515db0addcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e75d8d8d2464f21b0217f83fde3e26f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:45.490410 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3386546-c169-46a2-a51e-c515db0addcf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:45.538793 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a3386546-c169-46a2-a51e-c515db0addcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e75d8d8d2464f21b0217f83fde3e26f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:45.539435 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a3386546-c169-46a2-a51e-c515db0addcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e75d8d8d2464f21b0217f83fde3e26f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:45.546201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a3386546-c169-46a2-a51e-c515db0addcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e75d8d8d2464f21b0217f83fde3e26f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:45.546815 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a3386546-c169-46a2-a51e-c515db0addcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e75d8d8d2464f21b0217f83fde3e26f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:45.554063 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a3386546-c169-46a2-a51e-c515db0addcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e75d8d8d2464f21b0217f83fde3e26f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:45.570672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1045/2107] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:32:45 2022] DELETE /identity/v3/users/1e75d8d8d2464f21b0217f83fde3e26f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:32:45.575115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72717db9-bffd-4815-a33a-f6b6baae26e8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:45.575574 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72717db9-bffd-4815-a33a-f6b6baae26e8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:45.575693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72717db9-bffd-4815-a33a-f6b6baae26e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:45.603703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-72717db9-bffd-4815-a33a-f6b6baae26e8 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:32:45.604964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-72717db9-bffd-4815-a33a-f6b6baae26e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:45.663127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1063/2108] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:32:45.672604 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3386546-c169-46a2-a51e-c515db0addcf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:45.674020 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a3386546-c169-46a2-a51e-c515db0addcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:45.730072 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3386546-c169-46a2-a51e-c515db0addcf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:45.733784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0651262-9c80-4c15-9c39-32704120b0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:45.734383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0651262-9c80-4c15-9c39-32704120b0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:45.734657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0651262-9c80-4c15-9c39-32704120b0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:45.734926 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0651262-9c80-4c15-9c39-32704120b0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:45.743901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0651262-9c80-4c15-9c39-32704120b0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:45.745339 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0651262-9c80-4c15-9c39-32704120b0a7 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:45.755108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1046/2109] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:32:46.010580 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72717db9-bffd-4815-a33a-f6b6baae26e8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:46.012025 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-72717db9-bffd-4815-a33a-f6b6baae26e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:46.024561 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72717db9-bffd-4815-a33a-f6b6baae26e8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:46.029776 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc98d30-940f-4fc6-abcf-eb00b351abd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:46.030409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc98d30-940f-4fc6-abcf-eb00b351abd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:46.030686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc98d30-940f-4fc6-abcf-eb00b351abd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:46.030958 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc98d30-940f-4fc6-abcf-eb00b351abd6 admin admin] PATH_INFO: `/v3/projects/4ba559a41d87454c847a289cf6a90322` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:46.032128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc98d30-940f-4fc6-abcf-eb00b351abd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ba559a41d87454c847a289cf6a90322)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:46.034057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc98d30-940f-4fc6-abcf-eb00b351abd6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:46.086337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ecc98d30-940f-4fc6-abcf-eb00b351abd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ba559a41d87454c847a289cf6a90322', 'request_id': 'req-ecc98d30-940f-4fc6-abcf-eb00b351abd6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:46.094781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ecc98d30-940f-4fc6-abcf-eb00b351abd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ba559a41d87454c847a289cf6a90322', 'request_id': 'req-ecc98d30-940f-4fc6-abcf-eb00b351abd6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:46.101626 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ecc98d30-940f-4fc6-abcf-eb00b351abd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ba559a41d87454c847a289cf6a90322', 'request_id': 'req-ecc98d30-940f-4fc6-abcf-eb00b351abd6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:46.112163 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ecc98d30-940f-4fc6-abcf-eb00b351abd6 admin admin] The token cache is being invalidate because project 4ba559a41d87454c847a289cf6a90322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:32:46.112452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ecc98d30-940f-4fc6-abcf-eb00b351abd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:46.113096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ecc98d30-940f-4fc6-abcf-eb00b351abd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:32:46.114616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1064/2110] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:32:46 2022] DELETE /identity/v3/projects/4ba559a41d87454c847a289cf6a90322 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:32:46.119546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be2eba-f15c-48a0-ae6e-9595e1b89d58 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:46.119828 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be2eba-f15c-48a0-ae6e-9595e1b89d58 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:46.120134 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be2eba-f15c-48a0-ae6e-9595e1b89d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:46.145597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:46.176483 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c2be2eba-f15c-48a0-ae6e-9595e1b89d58 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:32:46.177690 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c2be2eba-f15c-48a0-ae6e-9595e1b89d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:46.237910 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1047/2111] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:32:46.245494 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bdb88-2b13-40de-b2f9-63861e192dad None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:46.245779 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bdb88-2b13-40de-b2f9-63861e192dad None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:46.246050 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bdb88-2b13-40de-b2f9-63861e192dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:46.266941 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4f6bdb88-2b13-40de-b2f9-63861e192dad None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:32:46.268213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4f6bdb88-2b13-40de-b2f9-63861e192dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:46.276213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1065/2112] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:32:46.280470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be2eba-f15c-48a0-ae6e-9595e1b89d58 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:46.290553 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be2eba-f15c-48a0-ae6e-9595e1b89d58 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:46.296246 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a69078-7931-4387-b4b8-6db1ce5cc36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:46.296940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a69078-7931-4387-b4b8-6db1ce5cc36b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:46.297219 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a69078-7931-4387-b4b8-6db1ce5cc36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:46.297635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a69078-7931-4387-b4b8-6db1ce5cc36b admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:46.298415 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a69078-7931-4387-b4b8-6db1ce5cc36b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:32:46.298723 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a69078-7931-4387-b4b8-6db1ce5cc36b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:46.300432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a69078-7931-4387-b4b8-6db1ce5cc36b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:46.314568 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1048/2113] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:32:46.318945 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6bdb88-2b13-40de-b2f9-63861e192dad None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:46.328613 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6bdb88-2b13-40de-b2f9-63861e192dad None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:46.333451 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad177a7-e6b3-400e-b5de-169e8010d56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:46.334098 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad177a7-e6b3-400e-b5de-169e8010d56c admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:46.334380 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad177a7-e6b3-400e-b5de-169e8010d56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:46.334801 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad177a7-e6b3-400e-b5de-169e8010d56c admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:46.335465 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad177a7-e6b3-400e-b5de-169e8010d56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:46.337487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad177a7-e6b3-400e-b5de-169e8010d56c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:46.368924 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1066/2114] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:32:46 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:32:46.370968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a69078-7931-4387-b4b8-6db1ce5cc36b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:46.384611 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a69078-7931-4387-b4b8-6db1ce5cc36b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:46.444154 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2566d0-43c6-48ce-a85c-2da0b156f194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:46.444880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2566d0-43c6-48ce-a85c-2da0b156f194 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:46.445022 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2566d0-43c6-48ce-a85c-2da0b156f194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:46.445281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2566d0-43c6-48ce-a85c-2da0b156f194 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:46.445951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2566d0-43c6-48ce-a85c-2da0b156f194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:46.447909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2566d0-43c6-48ce-a85c-2da0b156f194 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:46.470047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1049/2115] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:32:46 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:32:46.474127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad177a7-e6b3-400e-b5de-169e8010d56c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:46.485672 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad177a7-e6b3-400e-b5de-169e8010d56c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:46.490686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9660d7-e47d-4e55-a896-fc06ed039dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:46.491232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9660d7-e47d-4e55-a896-fc06ed039dfd admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:46.491509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9660d7-e47d-4e55-a896-fc06ed039dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:46.491779 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9660d7-e47d-4e55-a896-fc06ed039dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:46.492459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9660d7-e47d-4e55-a896-fc06ed039dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:46.494086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9660d7-e47d-4e55-a896-fc06ed039dfd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:46.505369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1067/2116] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:32:46.509669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2566d0-43c6-48ce-a85c-2da0b156f194 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:46.521910 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2566d0-43c6-48ce-a85c-2da0b156f194 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:46.526511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a7d59-b412-445c-88c5-a527ffb4c76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:46.527111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a7d59-b412-445c-88c5-a527ffb4c76d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:46.527417 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a7d59-b412-445c-88c5-a527ffb4c76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:46.527691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a7d59-b412-445c-88c5-a527ffb4c76d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:46.528396 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a7d59-b412-445c-88c5-a527ffb4c76d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:46.531567 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a7d59-b412-445c-88c5-a527ffb4c76d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:46.542865 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1050/2117] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:32:46.547320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9660d7-e47d-4e55-a896-fc06ed039dfd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:46.557532 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9660d7-e47d-4e55-a896-fc06ed039dfd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:46.563111 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d5bce-fe73-4f45-8ec8-cbfb8af97112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:46.563771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d5bce-fe73-4f45-8ec8-cbfb8af97112 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:46.564090 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d5bce-fe73-4f45-8ec8-cbfb8af97112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:46.565079 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d5bce-fe73-4f45-8ec8-cbfb8af97112 admin admin] PATH_INFO: `/v3/projects/08946559590c413f992b8f3e2558d2f4/users/70a604c53c5947f1ba4bff590a18eb59/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:46.580262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d5bce-fe73-4f45-8ec8-cbfb8af97112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08946559590c413f992b8f3e2558d2f4, user_id=70a604c53c5947f1ba4bff590a18eb59, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:46.583044 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d5bce-fe73-4f45-8ec8-cbfb8af97112 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:46.593359 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:46.598482 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1068/2118] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:32:46 2022] PUT /identity/v3/projects/08946559590c413f992b8f3e2558d2f4/users/70a604c53c5947f1ba4bff590a18eb59/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:32:46.606039 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6b6af-5faf-4f20-a58e-bda7145048bb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:46.606497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6b6af-5faf-4f20-a58e-bda7145048bb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:46.607005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6b6af-5faf-4f20-a58e-bda7145048bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:46.632241 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-04a6b6af-5faf-4f20-a58e-bda7145048bb None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:32:46.633436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-04a6b6af-5faf-4f20-a58e-bda7145048bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:46.682590 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:46.692042 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1051/2119] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:32:46.701936 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d5bce-fe73-4f45-8ec8-cbfb8af97112 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:46.703664 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4e7d5bce-fe73-4f45-8ec8-cbfb8af97112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:46.758714 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d5bce-fe73-4f45-8ec8-cbfb8af97112 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:46.762241 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0fbba-cb2f-4b35-a504-93e01a0cea7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:46.762829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0fbba-cb2f-4b35-a504-93e01a0cea7d service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:46.763105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0fbba-cb2f-4b35-a504-93e01a0cea7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:46.763412 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0fbba-cb2f-4b35-a504-93e01a0cea7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:46.772147 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0fbba-cb2f-4b35-a504-93e01a0cea7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:46.773557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0fbba-cb2f-4b35-a504-93e01a0cea7d service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:46.783250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1069/2120] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:32:47.401515 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed2913-c88f-439c-95ec-7add0c8e37d9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:47.401802 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed2913-c88f-439c-95ec-7add0c8e37d9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:47.402100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed2913-c88f-439c-95ec-7add0c8e37d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:47.429146 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c2ed2913-c88f-439c-95ec-7add0c8e37d9 None None] MFA Rules not processed for user `70a604c53c5947f1ba4bff590a18eb59`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:32:47.430343 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c2ed2913-c88f-439c-95ec-7add0c8e37d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:47.494951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1052/2121] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:32:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:32:47.507126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0fbba-cb2f-4b35-a504-93e01a0cea7d service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:32:47.508727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1ee0fbba-cb2f-4b35-a504-93e01a0cea7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:47.567574 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0fbba-cb2f-4b35-a504-93e01a0cea7d service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:32:47.571103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546f233-c6b7-4c42-9e58-27006aedeb39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:32:47.571715 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546f233-c6b7-4c42-9e58-27006aedeb39 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:47.572018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546f233-c6b7-4c42-9e58-27006aedeb39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:47.572290 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546f233-c6b7-4c42-9e58-27006aedeb39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:47.581589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546f233-c6b7-4c42-9e58-27006aedeb39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:32:47.583262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546f233-c6b7-4c42-9e58-27006aedeb39 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:32:47.593724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1070/2122] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:32:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:32:48.966404 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2313afe-db5e-46d8-b04a-851c100482e3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:32:48.966950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2313afe-db5e-46d8-b04a-851c100482e3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:32:48.966950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2313afe-db5e-46d8-b04a-851c100482e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:32:48.985759 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b2313afe-db5e-46d8-b04a-851c100482e3 None None] MFA Rules not processed for user `70a604c53c5947f1ba4bff590a18eb59`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:32:48.986937 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b2313afe-db5e-46d8-b04a-851c100482e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:32:48.993708 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1053/2123] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:32:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:32:57.588685 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=52 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:58.980968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=35 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:25.206905 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546f233-c6b7-4c42-9e58-27006aedeb39 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:25.209013 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8546f233-c6b7-4c42-9e58-27006aedeb39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:25.326946 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546f233-c6b7-4c42-9e58-27006aedeb39 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:25.332652 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc93ad6-6230-4514-920e-c98d8484333b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd52eee25ef347e1ae905cc3cba17284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:25.333584 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc93ad6-6230-4514-920e-c98d8484333b service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:25.334232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc93ad6-6230-4514-920e-c98d8484333b service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:25.334796 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc93ad6-6230-4514-920e-c98d8484333b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:25.336727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1bc93ad6-6230-4514-920e-c98d8484333b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:25.350733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc93ad6-6230-4514-920e-c98d8484333b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:25.353061 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc93ad6-6230-4514-920e-c98d8484333b service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:25.364706 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1071/2124] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:25.977268 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975b9b8-0a87-4754-8983-e24cb329d7bb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:25.978340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975b9b8-0a87-4754-8983-e24cb329d7bb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:25.978448 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975b9b8-0a87-4754-8983-e24cb329d7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:25.997911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9975b9b8-0a87-4754-8983-e24cb329d7bb None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:25.999104 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9975b9b8-0a87-4754-8983-e24cb329d7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:26.008442 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1054/2125] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Oct 17 10:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:26.032925 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc93ad6-6230-4514-920e-c98d8484333b service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:26.034646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1bc93ad6-6230-4514-920e-c98d8484333b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:26.139107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc93ad6-6230-4514-920e-c98d8484333b service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:26.146060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99efc3-d0cc-4f4c-bd7c-d69874a49206 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:26.146827 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99efc3-d0cc-4f4c-bd7c-d69874a49206 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:26.147096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99efc3-d0cc-4f4c-bd7c-d69874a49206 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:26.147369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99efc3-d0cc-4f4c-bd7c-d69874a49206 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:26.156317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99efc3-d0cc-4f4c-bd7c-d69874a49206 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:26.157887 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99efc3-d0cc-4f4c-bd7c-d69874a49206 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:26.169874 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1072/2126] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:31.246267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8ce86-a267-473a-9e40-c1ec638c6e13 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:31.246776 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8ce86-a267-473a-9e40-c1ec638c6e13 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:31.247116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8ce86-a267-473a-9e40-c1ec638c6e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:31.280209 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ebe8ce86-a267-473a-9e40-c1ec638c6e13 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:31.280209 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ebe8ce86-a267-473a-9e40-c1ec638c6e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:31.293489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1055/2127] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Oct 17 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:31.327824 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99efc3-d0cc-4f4c-bd7c-d69874a49206 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:31.339221 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99efc3-d0cc-4f4c-bd7c-d69874a49206 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:31.346075 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd834b0-9337-4516-a3ed-416ad7bc97b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:31.347138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd834b0-9337-4516-a3ed-416ad7bc97b8 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:31.347441 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd834b0-9337-4516-a3ed-416ad7bc97b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:31.347693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd834b0-9337-4516-a3ed-416ad7bc97b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:31.357898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd834b0-9337-4516-a3ed-416ad7bc97b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:31.359804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd834b0-9337-4516-a3ed-416ad7bc97b8 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:31.370577 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1073/2128] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:34.483713 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b452b-8a26-4e15-b05b-f3685d0e3244 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:34.484213 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b452b-8a26-4e15-b05b-f3685d0e3244 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:34.484558 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b452b-8a26-4e15-b05b-f3685d0e3244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:34.504758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-483b452b-8a26-4e15-b05b-f3685d0e3244 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:34.505946 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-483b452b-8a26-4e15-b05b-f3685d0e3244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:34.514483 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1056/2129] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Oct 17 10:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:33:34.536094 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd834b0-9337-4516-a3ed-416ad7bc97b8 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:34.544801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b452b-8a26-4e15-b05b-f3685d0e3244 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:34.545887 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd834b0-9337-4516-a3ed-416ad7bc97b8 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:34.546219 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-483b452b-8a26-4e15-b05b-f3685d0e3244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:34.551822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c21e30-5f66-4f38-b4c0-51887fd10cb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:34.552535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c21e30-5f66-4f38-b4c0-51887fd10cb6 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:34.552810 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c21e30-5f66-4f38-b4c0-51887fd10cb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:34.553078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c21e30-5f66-4f38-b4c0-51887fd10cb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:34.567242 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c21e30-5f66-4f38-b4c0-51887fd10cb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:34.569137 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c21e30-5f66-4f38-b4c0-51887fd10cb6 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:34.581070 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1074/2130] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:34.582431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b452b-8a26-4e15-b05b-f3685d0e3244 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:34.586046 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4921a-05d6-444d-bfa6-c921134112a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:34.586644 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4921a-05d6-444d-bfa6-c921134112a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:34.586921 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4921a-05d6-444d-bfa6-c921134112a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:34.587824 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4921a-05d6-444d-bfa6-c921134112a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:34.589561 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-10e4921a-05d6-444d-bfa6-c921134112a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:34.601406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4921a-05d6-444d-bfa6-c921134112a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:34.602924 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4921a-05d6-444d-bfa6-c921134112a9 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:34.612373 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1057/2131] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:33:37.571762 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1dc90-aaf3-46c0-a75e-311d6a53f720 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:37.572267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1dc90-aaf3-46c0-a75e-311d6a53f720 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:37.572371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1dc90-aaf3-46c0-a75e-311d6a53f720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:37.591760 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-71e1dc90-aaf3-46c0-a75e-311d6a53f720 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:37.593000 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-71e1dc90-aaf3-46c0-a75e-311d6a53f720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:37.603727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1075/2132] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Oct 17 10:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:37.624336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4921a-05d6-444d-bfa6-c921134112a9 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:37.625797 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-10e4921a-05d6-444d-bfa6-c921134112a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:37.641704 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4921a-05d6-444d-bfa6-c921134112a9 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:37.648150 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829b556-b2c5-48a7-abd9-732f267a4e1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:37.648828 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829b556-b2c5-48a7-abd9-732f267a4e1a service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:37.649304 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829b556-b2c5-48a7-abd9-732f267a4e1a service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:37.650088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829b556-b2c5-48a7-abd9-732f267a4e1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:37.659377 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829b556-b2c5-48a7-abd9-732f267a4e1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:37.661241 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829b556-b2c5-48a7-abd9-732f267a4e1a service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:37.673602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1058/2133] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:37.680695 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1dc90-aaf3-46c0-a75e-311d6a53f720 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:37.682257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-71e1dc90-aaf3-46c0-a75e-311d6a53f720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:37.689242 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:37.696205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1dc90-aaf3-46c0-a75e-311d6a53f720 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:37.701891 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15844abb-4fd6-49ff-b03e-2f66c051e6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:37.702728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15844abb-4fd6-49ff-b03e-2f66c051e6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:37.703027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15844abb-4fd6-49ff-b03e-2f66c051e6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:37.703284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15844abb-4fd6-49ff-b03e-2f66c051e6d8 admin admin] PATH_INFO: `/v3/users/e0a58360f5f7435b91c3d5be02adc3cb` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:37.704466 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15844abb-4fd6-49ff-b03e-2f66c051e6d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a58360f5f7435b91c3d5be02adc3cb)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:37.706382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15844abb-4fd6-49ff-b03e-2f66c051e6d8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:37.761869 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-15844abb-4fd6-49ff-b03e-2f66c051e6d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a58360f5f7435b91c3d5be02adc3cb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:37.762545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-15844abb-4fd6-49ff-b03e-2f66c051e6d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a58360f5f7435b91c3d5be02adc3cb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:37.770199 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-15844abb-4fd6-49ff-b03e-2f66c051e6d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a58360f5f7435b91c3d5be02adc3cb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:37.770836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-15844abb-4fd6-49ff-b03e-2f66c051e6d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a58360f5f7435b91c3d5be02adc3cb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:37.778904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-15844abb-4fd6-49ff-b03e-2f66c051e6d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a58360f5f7435b91c3d5be02adc3cb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:37.804483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1076/2134] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:33:37 2022] DELETE /identity/v3/users/e0a58360f5f7435b91c3d5be02adc3cb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:37.842955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829b556-b2c5-48a7-abd9-732f267a4e1a service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:37.853497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829b556-b2c5-48a7-abd9-732f267a4e1a service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:37.906100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195f192-23d2-4620-bbed-12547de21c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:37.906708 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195f192-23d2-4620-bbed-12547de21c46 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:37.906985 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195f192-23d2-4620-bbed-12547de21c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:37.907252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195f192-23d2-4620-bbed-12547de21c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:37.909027 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e195f192-23d2-4620-bbed-12547de21c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:37.973991 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195f192-23d2-4620-bbed-12547de21c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:37.975480 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195f192-23d2-4620-bbed-12547de21c46 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:37.987957 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1059/2135] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:37.993146 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15844abb-4fd6-49ff-b03e-2f66c051e6d8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:37.994871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-15844abb-4fd6-49ff-b03e-2f66c051e6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:38.011538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15844abb-4fd6-49ff-b03e-2f66c051e6d8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:38.019066 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e0d6a-7d82-459c-a896-a07076c8a53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:38.020117 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e0d6a-7d82-459c-a896-a07076c8a53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:38.020596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e0d6a-7d82-459c-a896-a07076c8a53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:38.020970 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e0d6a-7d82-459c-a896-a07076c8a53e admin admin] PATH_INFO: `/v3/projects/d299c5b2aa8d43a684db07feb0f5fd8e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:38.022371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e0d6a-7d82-459c-a896-a07076c8a53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d299c5b2aa8d43a684db07feb0f5fd8e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:38.026027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e0d6a-7d82-459c-a896-a07076c8a53e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:38.091870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-467e0d6a-7d82-459c-a896-a07076c8a53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd299c5b2aa8d43a684db07feb0f5fd8e', 'request_id': 'req-467e0d6a-7d82-459c-a896-a07076c8a53e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:38.103212 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-467e0d6a-7d82-459c-a896-a07076c8a53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd299c5b2aa8d43a684db07feb0f5fd8e', 'request_id': 'req-467e0d6a-7d82-459c-a896-a07076c8a53e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:38.112153 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-467e0d6a-7d82-459c-a896-a07076c8a53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd299c5b2aa8d43a684db07feb0f5fd8e', 'request_id': 'req-467e0d6a-7d82-459c-a896-a07076c8a53e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:38.125021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-467e0d6a-7d82-459c-a896-a07076c8a53e admin admin] The token cache is being invalidate because project d299c5b2aa8d43a684db07feb0f5fd8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:33:38.125317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-467e0d6a-7d82-459c-a896-a07076c8a53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:38.126107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-467e0d6a-7d82-459c-a896-a07076c8a53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:38.131870 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1077/2136] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:33:37 2022] DELETE /identity/v3/projects/d299c5b2aa8d43a684db07feb0f5fd8e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:38.133614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d815a-a24b-4b6c-a601-97ba41d8f025 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:38.134680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d815a-a24b-4b6c-a601-97ba41d8f025 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:38.135118 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d815a-a24b-4b6c-a601-97ba41d8f025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:38.160328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-784d815a-a24b-4b6c-a601-97ba41d8f025 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:38.161927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-784d815a-a24b-4b6c-a601-97ba41d8f025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:38.206459 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:38.226363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1060/2137] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:38.235144 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8e9c2-2347-4616-971b-a1e25904f9c6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:38.235428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8e9c2-2347-4616-971b-a1e25904f9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:38.235702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8e9c2-2347-4616-971b-a1e25904f9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:38.257203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-87b8e9c2-2347-4616-971b-a1e25904f9c6 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:38.258426 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-87b8e9c2-2347-4616-971b-a1e25904f9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:38.266844 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1078/2138] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:33:38.271294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d815a-a24b-4b6c-a601-97ba41d8f025 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:38.281590 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d815a-a24b-4b6c-a601-97ba41d8f025 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:38.286389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3121c-3027-42ed-90bb-321dbc457b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:38.286993 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3121c-3027-42ed-90bb-321dbc457b06 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:38.287268 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3121c-3027-42ed-90bb-321dbc457b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:38.287537 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3121c-3027-42ed-90bb-321dbc457b06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:38.288222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3121c-3027-42ed-90bb-321dbc457b06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:33:38.288525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3121c-3027-42ed-90bb-321dbc457b06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:38.290686 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3121c-3027-42ed-90bb-321dbc457b06 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:38.302655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1061/2139] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:33:38.307641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8e9c2-2347-4616-971b-a1e25904f9c6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:38.317117 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8e9c2-2347-4616-971b-a1e25904f9c6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:38.322531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444f7dd-076e-41b3-9dac-bbe503719f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:38.323232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444f7dd-076e-41b3-9dac-bbe503719f66 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:38.323604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444f7dd-076e-41b3-9dac-bbe503719f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:38.323973 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444f7dd-076e-41b3-9dac-bbe503719f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:38.324786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444f7dd-076e-41b3-9dac-bbe503719f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:38.326842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444f7dd-076e-41b3-9dac-bbe503719f66 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:38.354852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1079/2140] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:33:38 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:38.358978 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3121c-3027-42ed-90bb-321dbc457b06 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:38.369650 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3121c-3027-42ed-90bb-321dbc457b06 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:38.427367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3070b15-c494-4a4c-ac1c-11d71a1a2d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:38.428173 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3070b15-c494-4a4c-ac1c-11d71a1a2d4a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:38.428454 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3070b15-c494-4a4c-ac1c-11d71a1a2d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:38.428724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3070b15-c494-4a4c-ac1c-11d71a1a2d4a admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:38.429354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3070b15-c494-4a4c-ac1c-11d71a1a2d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:38.431366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3070b15-c494-4a4c-ac1c-11d71a1a2d4a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:38.453657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1062/2141] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:33:38 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:38.457759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444f7dd-076e-41b3-9dac-bbe503719f66 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:38.468549 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444f7dd-076e-41b3-9dac-bbe503719f66 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:38.473177 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b66ce9-6d76-45c1-9f41-ea77d1b38561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:38.473775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b66ce9-6d76-45c1-9f41-ea77d1b38561 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:38.474054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b66ce9-6d76-45c1-9f41-ea77d1b38561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:38.474328 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b66ce9-6d76-45c1-9f41-ea77d1b38561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:38.474972 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b66ce9-6d76-45c1-9f41-ea77d1b38561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:38.476610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b66ce9-6d76-45c1-9f41-ea77d1b38561 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:38.487127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1080/2142] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:38.491206 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3070b15-c494-4a4c-ac1c-11d71a1a2d4a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:38.501380 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3070b15-c494-4a4c-ac1c-11d71a1a2d4a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:38.506298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2db83-39b6-461e-9d80-97f96069faa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:38.506896 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2db83-39b6-461e-9d80-97f96069faa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:38.507172 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2db83-39b6-461e-9d80-97f96069faa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:38.507442 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2db83-39b6-461e-9d80-97f96069faa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:38.508144 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2db83-39b6-461e-9d80-97f96069faa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:38.509773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2db83-39b6-461e-9d80-97f96069faa4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:38.520480 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1063/2143] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:38.524409 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b66ce9-6d76-45c1-9f41-ea77d1b38561 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:38.536922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b66ce9-6d76-45c1-9f41-ea77d1b38561 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:38.545080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323891a6-ae3c-4f21-97e3-8f288a48f9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:38.546186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323891a6-ae3c-4f21-97e3-8f288a48f9fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:38.546718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323891a6-ae3c-4f21-97e3-8f288a48f9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:38.547141 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323891a6-ae3c-4f21-97e3-8f288a48f9fb admin admin] PATH_INFO: `/v3/projects/40bc7a8c0b8d403482f78f0efaee5a12/users/dd38ddfdddc24a8196ec459b88c000d6/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:38.568315 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323891a6-ae3c-4f21-97e3-8f288a48f9fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=40bc7a8c0b8d403482f78f0efaee5a12, user_id=dd38ddfdddc24a8196ec459b88c000d6, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:38.571659 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323891a6-ae3c-4f21-97e3-8f288a48f9fb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:38.574046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:38.586347 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1081/2144] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:38 2022] PUT /identity/v3/projects/40bc7a8c0b8d403482f78f0efaee5a12/users/dd38ddfdddc24a8196ec459b88c000d6/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:38.598099 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bc647-3276-4235-b8b9-2f5ece7fafde None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:38.598379 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bc647-3276-4235-b8b9-2f5ece7fafde None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:38.598651 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bc647-3276-4235-b8b9-2f5ece7fafde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:38.626510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d69bc647-3276-4235-b8b9-2f5ece7fafde None None] MFA Rules not processed for user `dd38ddfdddc24a8196ec459b88c000d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:38.627854 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d69bc647-3276-4235-b8b9-2f5ece7fafde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:38.694312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1064/2145] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:38.705160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323891a6-ae3c-4f21-97e3-8f288a48f9fb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:38.706833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-323891a6-ae3c-4f21-97e3-8f288a48f9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:38.782019 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323891a6-ae3c-4f21-97e3-8f288a48f9fb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:38.788158 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd57e4-0b14-4a11-8812-ddcc64bd60f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:38.788778 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd57e4-0b14-4a11-8812-ddcc64bd60f0 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:38.789054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd57e4-0b14-4a11-8812-ddcc64bd60f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:38.789327 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd57e4-0b14-4a11-8812-ddcc64bd60f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:38.797472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd57e4-0b14-4a11-8812-ddcc64bd60f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:38.799064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd57e4-0b14-4a11-8812-ddcc64bd60f0 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:38.807968 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1082/2146] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:41.268026 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bc647-3276-4235-b8b9-2f5ece7fafde None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:41.269463 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d69bc647-3276-4235-b8b9-2f5ece7fafde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:41.318654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:41.343266 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bc647-3276-4235-b8b9-2f5ece7fafde None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:41.347847 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5db95-f371-4146-ba4b-50c8ec22dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:41.348641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5db95-f371-4146-ba4b-50c8ec22dc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:41.348919 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5db95-f371-4146-ba4b-50c8ec22dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:41.349192 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5db95-f371-4146-ba4b-50c8ec22dc8f admin admin] PATH_INFO: `/v3/users/38b48da35205469abf5aa714dacfe6cb` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:41.350326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5db95-f371-4146-ba4b-50c8ec22dc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b48da35205469abf5aa714dacfe6cb)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:41.352296 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5db95-f371-4146-ba4b-50c8ec22dc8f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:41.402073 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d8b5db95-f371-4146-ba4b-50c8ec22dc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b48da35205469abf5aa714dacfe6cb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:41.402721 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d8b5db95-f371-4146-ba4b-50c8ec22dc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b48da35205469abf5aa714dacfe6cb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:41.409499 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d8b5db95-f371-4146-ba4b-50c8ec22dc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b48da35205469abf5aa714dacfe6cb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:41.410119 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d8b5db95-f371-4146-ba4b-50c8ec22dc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b48da35205469abf5aa714dacfe6cb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:41.418149 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d8b5db95-f371-4146-ba4b-50c8ec22dc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b48da35205469abf5aa714dacfe6cb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:41.435001 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1065/2147] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:33:41 2022] DELETE /identity/v3/users/38b48da35205469abf5aa714dacfe6cb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:33:41.601643 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd57e4-0b14-4a11-8812-ddcc64bd60f0 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:41.618731 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd57e4-0b14-4a11-8812-ddcc64bd60f0 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:41.692421 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0c5bd-a660-4eed-9d73-9fafee3ea037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:41.693141 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0c5bd-a660-4eed-9d73-9fafee3ea037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:41.693418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0c5bd-a660-4eed-9d73-9fafee3ea037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:41.693857 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0c5bd-a660-4eed-9d73-9fafee3ea037 admin admin] PATH_INFO: `/v3/projects/829946736bde4f5ba6423ade7d086e60` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:41.695914 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0c5bd-a660-4eed-9d73-9fafee3ea037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=829946736bde4f5ba6423ade7d086e60)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:41.698051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0c5bd-a660-4eed-9d73-9fafee3ea037 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:41.760762 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c5f0c5bd-a660-4eed-9d73-9fafee3ea037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829946736bde4f5ba6423ade7d086e60', 'request_id': 'req-c5f0c5bd-a660-4eed-9d73-9fafee3ea037'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:41.772596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c5f0c5bd-a660-4eed-9d73-9fafee3ea037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829946736bde4f5ba6423ade7d086e60', 'request_id': 'req-c5f0c5bd-a660-4eed-9d73-9fafee3ea037'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:41.779784 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c5f0c5bd-a660-4eed-9d73-9fafee3ea037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829946736bde4f5ba6423ade7d086e60', 'request_id': 'req-c5f0c5bd-a660-4eed-9d73-9fafee3ea037'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:41.790294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c5f0c5bd-a660-4eed-9d73-9fafee3ea037 admin admin] The token cache is being invalidate because project 829946736bde4f5ba6423ade7d086e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:33:41.790576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c5f0c5bd-a660-4eed-9d73-9fafee3ea037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:41.791199 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c5f0c5bd-a660-4eed-9d73-9fafee3ea037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:41.792714 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1083/2148] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:33:41 2022] DELETE /identity/v3/projects/829946736bde4f5ba6423ade7d086e60 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:41.797731 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005886b-101e-4d86-b4b7-688253d76c91 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:41.798011 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005886b-101e-4d86-b4b7-688253d76c91 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:41.798279 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005886b-101e-4d86-b4b7-688253d76c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:41.815450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc656-0ec2-4406-bee0-7c892d1e29ff None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:41.815733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc656-0ec2-4406-bee0-7c892d1e29ff None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:41.816028 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc656-0ec2-4406-bee0-7c892d1e29ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:41.818189 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7005886b-101e-4d86-b4b7-688253d76c91 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:41.819462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7005886b-101e-4d86-b4b7-688253d76c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:41.837773 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f83bc656-0ec2-4406-bee0-7c892d1e29ff None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:41.838980 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f83bc656-0ec2-4406-bee0-7c892d1e29ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:41.843270 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:41.882943 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1066/2149] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:41.891264 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec02b46-4a9f-4587-a8a9-da54d3f03b7b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:41.891550 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec02b46-4a9f-4587-a8a9-da54d3f03b7b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:41.891824 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec02b46-4a9f-4587-a8a9-da54d3f03b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:41.903537 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1084/2150] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Oct 17 10:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:33:41.911461 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1ec02b46-4a9f-4587-a8a9-da54d3f03b7b None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:41.912690 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1ec02b46-4a9f-4587-a8a9-da54d3f03b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:41.920511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1067/2151] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:33:41.924509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bc656-0ec2-4406-bee0-7c892d1e29ff None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:41.924683 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec02b46-4a9f-4587-a8a9-da54d3f03b7b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:41.925906 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1ec02b46-4a9f-4587-a8a9-da54d3f03b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:41.934190 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bc656-0ec2-4406-bee0-7c892d1e29ff None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:41.938784 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ef6df-efb9-4e4e-818e-9aa922467a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:41.939379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ef6df-efb9-4e4e-818e-9aa922467a5b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:41.939655 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ef6df-efb9-4e4e-818e-9aa922467a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:41.939936 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ef6df-efb9-4e4e-818e-9aa922467a5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:41.940592 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ef6df-efb9-4e4e-818e-9aa922467a5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:33:41.940891 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ef6df-efb9-4e4e-818e-9aa922467a5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:41.942484 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ef6df-efb9-4e4e-818e-9aa922467a5b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:41.957944 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1085/2152] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:33:41.958976 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ef6df-efb9-4e4e-818e-9aa922467a5b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:41.969350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ef6df-efb9-4e4e-818e-9aa922467a5b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:41.974143 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dd945-6a47-4d37-9f36-f0ffb40bd49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:41.974723 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dd945-6a47-4d37-9f36-f0ffb40bd49d admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:41.975003 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dd945-6a47-4d37-9f36-f0ffb40bd49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:41.975408 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dd945-6a47-4d37-9f36-f0ffb40bd49d admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:41.976085 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dd945-6a47-4d37-9f36-f0ffb40bd49d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:41.978076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dd945-6a47-4d37-9f36-f0ffb40bd49d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:41.978515 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:42.003280 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec02b46-4a9f-4587-a8a9-da54d3f03b7b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:42.011056 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ec815-1efc-4675-9e5e-fadb30fdb36b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:42.011758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ec815-1efc-4675-9e5e-fadb30fdb36b service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:42.011896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1086/2153] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:33:41 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:33:42.014950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ec815-1efc-4675-9e5e-fadb30fdb36b service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:42.015841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ec815-1efc-4675-9e5e-fadb30fdb36b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:42.016012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dd945-6a47-4d37-9f36-f0ffb40bd49d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:42.026291 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ec815-1efc-4675-9e5e-fadb30fdb36b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:42.028024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ec815-1efc-4675-9e5e-fadb30fdb36b service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:42.039902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1068/2154] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:42.099308 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dd945-6a47-4d37-9f36-f0ffb40bd49d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:42.104760 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bddea-fc99-412e-a0fd-30734aef45e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:42.105383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bddea-fc99-412e-a0fd-30734aef45e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:42.105661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bddea-fc99-412e-a0fd-30734aef45e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:42.105913 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bddea-fc99-412e-a0fd-30734aef45e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:42.106606 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bddea-fc99-412e-a0fd-30734aef45e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:42.108562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bddea-fc99-412e-a0fd-30734aef45e7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:42.134597 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1087/2155] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:33:42 2022] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:42.138556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ec815-1efc-4675-9e5e-fadb30fdb36b service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:42.148396 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ec815-1efc-4675-9e5e-fadb30fdb36b service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:42.154489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b80d4-bb11-4569-b593-751d6161d56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:42.155296 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b80d4-bb11-4569-b593-751d6161d56a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:42.155730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b80d4-bb11-4569-b593-751d6161d56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:42.156191 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b80d4-bb11-4569-b593-751d6161d56a admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:42.156999 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b80d4-bb11-4569-b593-751d6161d56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:42.158773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b80d4-bb11-4569-b593-751d6161d56a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:42.173739 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1069/2156] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:42.175213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bddea-fc99-412e-a0fd-30734aef45e7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:42.187472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bddea-fc99-412e-a0fd-30734aef45e7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:42.192741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c4690-2424-4f2f-86ae-85fbac55f721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:42.193624 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4690-2424-4f2f-86ae-85fbac55f721 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:42.193968 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4690-2424-4f2f-86ae-85fbac55f721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:42.194367 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4690-2424-4f2f-86ae-85fbac55f721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:42.195192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c4690-2424-4f2f-86ae-85fbac55f721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:42.197667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c4690-2424-4f2f-86ae-85fbac55f721 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:42.208661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1088/2157] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:42.212834 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b80d4-bb11-4569-b593-751d6161d56a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:42.222886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b80d4-bb11-4569-b593-751d6161d56a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:42.227598 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2070c5-eb03-438e-85d8-21fd38692ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:42.228308 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2070c5-eb03-438e-85d8-21fd38692ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:42.228587 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2070c5-eb03-438e-85d8-21fd38692ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:42.228859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2070c5-eb03-438e-85d8-21fd38692ad9 admin admin] PATH_INFO: `/v3/projects/7ef3e907f49846d6b1e545b7e7ac3209/users/e3a7d0cde6c54f51ab2c52f5aede6844/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:42.243885 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2070c5-eb03-438e-85d8-21fd38692ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef3e907f49846d6b1e545b7e7ac3209, user_id=e3a7d0cde6c54f51ab2c52f5aede6844, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:42.246603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2070c5-eb03-438e-85d8-21fd38692ad9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:42.262281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1070/2158] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:42 2022] PUT /identity/v3/projects/7ef3e907f49846d6b1e545b7e7ac3209/users/e3a7d0cde6c54f51ab2c52f5aede6844/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:42.272463 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56a4b6-62e4-4127-a171-f76454643248 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:42.272753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56a4b6-62e4-4127-a171-f76454643248 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:42.273028 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56a4b6-62e4-4127-a171-f76454643248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:42.301740 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4c56a4b6-62e4-4127-a171-f76454643248 None None] MFA Rules not processed for user `e3a7d0cde6c54f51ab2c52f5aede6844`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:42.302961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4c56a4b6-62e4-4127-a171-f76454643248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:42.345464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:42.369340 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1089/2159] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:42.373983 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2070c5-eb03-438e-85d8-21fd38692ad9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:42.434835 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2070c5-eb03-438e-85d8-21fd38692ad9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:42.439385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e0eb2-f8b4-4f04-b1d4-171769a8d681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:42.439998 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e0eb2-f8b4-4f04-b1d4-171769a8d681 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:42.440306 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e0eb2-f8b4-4f04-b1d4-171769a8d681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:42.440573 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e0eb2-f8b4-4f04-b1d4-171769a8d681 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:42.441201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e0eb2-f8b4-4f04-b1d4-171769a8d681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:42.443091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e0eb2-f8b4-4f04-b1d4-171769a8d681 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:42.470721 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1071/2160] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:33:42 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:33:42.474854 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56a4b6-62e4-4127-a171-f76454643248 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:42.485693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56a4b6-62e4-4127-a171-f76454643248 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:42.540624 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f757d06-55c5-499d-9dc9-6fa9716086d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:42.541233 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f757d06-55c5-499d-9dc9-6fa9716086d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:42.541508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f757d06-55c5-499d-9dc9-6fa9716086d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:42.541775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f757d06-55c5-499d-9dc9-6fa9716086d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:42.542395 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f757d06-55c5-499d-9dc9-6fa9716086d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:42.544342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f757d06-55c5-499d-9dc9-6fa9716086d5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:42.566180 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1090/2161] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:33:42 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:42.570180 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e0eb2-f8b4-4f04-b1d4-171769a8d681 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:42.580386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e0eb2-f8b4-4f04-b1d4-171769a8d681 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:42.584987 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1043-f317-4125-a3bc-a28ed6216472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:42.585575 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1043-f317-4125-a3bc-a28ed6216472 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:42.585858 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1043-f317-4125-a3bc-a28ed6216472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:42.586131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1043-f317-4125-a3bc-a28ed6216472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:42.586778 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc1043-f317-4125-a3bc-a28ed6216472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:42.588403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc1043-f317-4125-a3bc-a28ed6216472 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:42.599560 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1072/2162] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:42.604422 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f757d06-55c5-499d-9dc9-6fa9716086d5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:42.614339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f757d06-55c5-499d-9dc9-6fa9716086d5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:42.619561 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5b221-13ce-4a82-970c-3016f1c62878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:42.620235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5b221-13ce-4a82-970c-3016f1c62878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:42.620516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5b221-13ce-4a82-970c-3016f1c62878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:42.620788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5b221-13ce-4a82-970c-3016f1c62878 admin admin] PATH_INFO: `/v3/projects/22c14dcff1554fa9bfc21e5f1c59bdef/users/b9373ed834424deebd11a3143cd204a8/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:42.635432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5b221-13ce-4a82-970c-3016f1c62878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c14dcff1554fa9bfc21e5f1c59bdef, user_id=b9373ed834424deebd11a3143cd204a8, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:42.638159 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5b221-13ce-4a82-970c-3016f1c62878 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:42.650702 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1091/2163] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:42 2022] PUT /identity/v3/projects/22c14dcff1554fa9bfc21e5f1c59bdef/users/b9373ed834424deebd11a3143cd204a8/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:42.654699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1043-f317-4125-a3bc-a28ed6216472 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:42.665680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1043-f317-4125-a3bc-a28ed6216472 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:42.720279 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdbfe8-faf6-4506-a0da-53a6df80f45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:42.720801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdbfe8-faf6-4506-a0da-53a6df80f45d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:42.721078 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdbfe8-faf6-4506-a0da-53a6df80f45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:42.721346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdbfe8-faf6-4506-a0da-53a6df80f45d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:42.721979 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdbfe8-faf6-4506-a0da-53a6df80f45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:42.723554 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdbfe8-faf6-4506-a0da-53a6df80f45d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:42.733645 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1073/2164] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:42.737727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5b221-13ce-4a82-970c-3016f1c62878 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:42.748344 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5b221-13ce-4a82-970c-3016f1c62878 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:42.753278 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a71f1-f854-43ff-8cb8-a0faac0c808a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:42.753927 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a71f1-f854-43ff-8cb8-a0faac0c808a admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:42.754207 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a71f1-f854-43ff-8cb8-a0faac0c808a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:42.754497 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a71f1-f854-43ff-8cb8-a0faac0c808a admin admin] PATH_INFO: `/v3/projects/22c14dcff1554fa9bfc21e5f1c59bdef/users/b9373ed834424deebd11a3143cd204a8/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:42.756703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a71f1-f854-43ff-8cb8-a0faac0c808a admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c14dcff1554fa9bfc21e5f1c59bdef, user_id=b9373ed834424deebd11a3143cd204a8, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:42.759382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a71f1-f854-43ff-8cb8-a0faac0c808a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:42.769627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1092/2165] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:42 2022] PUT /identity/v3/projects/22c14dcff1554fa9bfc21e5f1c59bdef/users/b9373ed834424deebd11a3143cd204a8/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:42.782641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bf048-5171-40e6-a999-b6aa4bef6ad3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:42.782927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bf048-5171-40e6-a999-b6aa4bef6ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:42.783196 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bf048-5171-40e6-a999-b6aa4bef6ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:42.812675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:42.820399 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-537bf048-5171-40e6-a999-b6aa4bef6ad3 None None] MFA Rules not processed for user `b9373ed834424deebd11a3143cd204a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:42.821638 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-537bf048-5171-40e6-a999-b6aa4bef6ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:42.901757 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1074/2166] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:42.912770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a71f1-f854-43ff-8cb8-a0faac0c808a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:42.914506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-918a71f1-f854-43ff-8cb8-a0faac0c808a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:43.005215 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a71f1-f854-43ff-8cb8-a0faac0c808a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:43.009380 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b1db1-e3ff-425a-ad43-ba2c734f1c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:43.010193 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b1db1-e3ff-425a-ad43-ba2c734f1c37 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:43.010468 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b1db1-e3ff-425a-ad43-ba2c734f1c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:43.010752 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b1db1-e3ff-425a-ad43-ba2c734f1c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:43.020570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b1db1-e3ff-425a-ad43-ba2c734f1c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:43.022076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b1db1-e3ff-425a-ad43-ba2c734f1c37 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:43.033027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1093/2167] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:43.118450 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bf048-5171-40e6-a999-b6aa4bef6ad3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:43.127873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bf048-5171-40e6-a999-b6aa4bef6ad3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:43.131719 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36b9a7-2aac-4aff-99b1-9d4983204d4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:43.132334 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36b9a7-2aac-4aff-99b1-9d4983204d4f service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:43.132611 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36b9a7-2aac-4aff-99b1-9d4983204d4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:43.132879 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36b9a7-2aac-4aff-99b1-9d4983204d4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:43.191851 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36b9a7-2aac-4aff-99b1-9d4983204d4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:43.193621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36b9a7-2aac-4aff-99b1-9d4983204d4f service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:43.202602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1075/2168] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:44.126450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b1db1-e3ff-425a-ad43-ba2c734f1c37 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:44.126874 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ac7b1db1-e3ff-425a-ad43-ba2c734f1c37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:44.146936 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:44.191785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b1db1-e3ff-425a-ad43-ba2c734f1c37 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:44.196881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433c05a-54e4-430a-aae7-e08f1ae58042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:44.197521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433c05a-54e4-430a-aae7-e08f1ae58042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:44.197801 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433c05a-54e4-430a-aae7-e08f1ae58042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:44.198073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433c05a-54e4-430a-aae7-e08f1ae58042 admin admin] PATH_INFO: `/v3/users/dd38ddfdddc24a8196ec459b88c000d6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:44.199188 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433c05a-54e4-430a-aae7-e08f1ae58042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd38ddfdddc24a8196ec459b88c000d6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:44.201131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433c05a-54e4-430a-aae7-e08f1ae58042 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:44.245744 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3433c05a-54e4-430a-aae7-e08f1ae58042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd38ddfdddc24a8196ec459b88c000d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:44.246396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3433c05a-54e4-430a-aae7-e08f1ae58042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd38ddfdddc24a8196ec459b88c000d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:44.253475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3433c05a-54e4-430a-aae7-e08f1ae58042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd38ddfdddc24a8196ec459b88c000d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:44.254093 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3433c05a-54e4-430a-aae7-e08f1ae58042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd38ddfdddc24a8196ec459b88c000d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:44.261210 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3433c05a-54e4-430a-aae7-e08f1ae58042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd38ddfdddc24a8196ec459b88c000d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:44.278805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1094/2169] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:33:44 2022] DELETE /identity/v3/users/dd38ddfdddc24a8196ec459b88c000d6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:44.283330 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdb978-624d-4197-8246-eefec35b1c94 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:44.283795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdb978-624d-4197-8246-eefec35b1c94 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:44.283891 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdb978-624d-4197-8246-eefec35b1c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:44.302385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a1cdb978-624d-4197-8246-eefec35b1c94 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:44.303571 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a1cdb978-624d-4197-8246-eefec35b1c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:44.367049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1076/2170] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:33:44.377595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433c05a-54e4-430a-aae7-e08f1ae58042 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:44.379451 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3433c05a-54e4-430a-aae7-e08f1ae58042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:44.438192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433c05a-54e4-430a-aae7-e08f1ae58042 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:44.441975 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30659571-49b2-485f-84a0-7569ec76e82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:44.442575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30659571-49b2-485f-84a0-7569ec76e82f service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:44.442854 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30659571-49b2-485f-84a0-7569ec76e82f service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:44.443125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30659571-49b2-485f-84a0-7569ec76e82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:44.452994 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30659571-49b2-485f-84a0-7569ec76e82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:44.454460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30659571-49b2-485f-84a0-7569ec76e82f service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:44.464518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1095/2171] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:44.777678 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdb978-624d-4197-8246-eefec35b1c94 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:44.779320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a1cdb978-624d-4197-8246-eefec35b1c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:44.792915 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdb978-624d-4197-8246-eefec35b1c94 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:44.797677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a52e2-d1e2-4615-a416-950339d68cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:44.798604 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a52e2-d1e2-4615-a416-950339d68cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:44.799046 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a52e2-d1e2-4615-a416-950339d68cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:44.799479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a52e2-d1e2-4615-a416-950339d68cde admin admin] PATH_INFO: `/v3/projects/40bc7a8c0b8d403482f78f0efaee5a12` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:44.800821 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a52e2-d1e2-4615-a416-950339d68cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=40bc7a8c0b8d403482f78f0efaee5a12)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:44.802927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a52e2-d1e2-4615-a416-950339d68cde admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:44.850884 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:44.866840 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-592a52e2-d1e2-4615-a416-950339d68cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40bc7a8c0b8d403482f78f0efaee5a12', 'request_id': 'req-592a52e2-d1e2-4615-a416-950339d68cde'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:44.876155 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-592a52e2-d1e2-4615-a416-950339d68cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40bc7a8c0b8d403482f78f0efaee5a12', 'request_id': 'req-592a52e2-d1e2-4615-a416-950339d68cde'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:44.883352 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-592a52e2-d1e2-4615-a416-950339d68cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40bc7a8c0b8d403482f78f0efaee5a12', 'request_id': 'req-592a52e2-d1e2-4615-a416-950339d68cde'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:44.895429 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-592a52e2-d1e2-4615-a416-950339d68cde admin admin] The token cache is being invalidate because project 40bc7a8c0b8d403482f78f0efaee5a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:33:44.895721 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-592a52e2-d1e2-4615-a416-950339d68cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:44.896441 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-592a52e2-d1e2-4615-a416-950339d68cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:44.898283 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1077/2172] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:33:44 2022] DELETE /identity/v3/projects/40bc7a8c0b8d403482f78f0efaee5a12 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:44.903698 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620506f-f579-4d45-bbeb-df3b55280f55 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:44.904012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620506f-f579-4d45-bbeb-df3b55280f55 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:44.904287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620506f-f579-4d45-bbeb-df3b55280f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:44.923582 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4620506f-f579-4d45-bbeb-df3b55280f55 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:44.924829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4620506f-f579-4d45-bbeb-df3b55280f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:44.965922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:44.993027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1096/2173] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:45.000694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290375-45ac-4bfa-9dca-db5bfab12d17 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:45.000974 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290375-45ac-4bfa-9dca-db5bfab12d17 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:45.001243 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290375-45ac-4bfa-9dca-db5bfab12d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:45.021400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-86290375-45ac-4bfa-9dca-db5bfab12d17 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:45.022578 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-86290375-45ac-4bfa-9dca-db5bfab12d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:45.031685 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1078/2174] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:45.035921 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620506f-f579-4d45-bbeb-df3b55280f55 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:45.045526 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620506f-f579-4d45-bbeb-df3b55280f55 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:45.050122 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6100b96-a7bb-4a17-b48e-4cdc67632f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:45.050714 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6100b96-a7bb-4a17-b48e-4cdc67632f26 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:45.050991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6100b96-a7bb-4a17-b48e-4cdc67632f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:45.051264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6100b96-a7bb-4a17-b48e-4cdc67632f26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:45.051907 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6100b96-a7bb-4a17-b48e-4cdc67632f26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:33:45.052237 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6100b96-a7bb-4a17-b48e-4cdc67632f26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:45.053885 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6100b96-a7bb-4a17-b48e-4cdc67632f26 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:45.057834 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb14b9-799c-44a4-b8df-a2ccf094e66d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:45.058189 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb14b9-799c-44a4-b8df-a2ccf094e66d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:45.058522 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb14b9-799c-44a4-b8df-a2ccf094e66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:45.066033 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1097/2175] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:33:45.070345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6100b96-a7bb-4a17-b48e-4cdc67632f26 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:45.080691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-49fb14b9-799c-44a4-b8df-a2ccf094e66d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:45.080880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6100b96-a7bb-4a17-b48e-4cdc67632f26 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:45.081887 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-49fb14b9-799c-44a4-b8df-a2ccf094e66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:45.085379 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f4a45-5ea1-4b3e-a205-8c5546a47aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:45.086021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f4a45-5ea1-4b3e-a205-8c5546a47aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:45.086300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f4a45-5ea1-4b3e-a205-8c5546a47aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:45.086572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f4a45-5ea1-4b3e-a205-8c5546a47aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:45.087806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f4a45-5ea1-4b3e-a205-8c5546a47aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:45.089745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f4a45-5ea1-4b3e-a205-8c5546a47aa4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:45.090308 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1079/2176] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Oct 17 10:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:45.111982 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb14b9-799c-44a4-b8df-a2ccf094e66d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:45.113544 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-49fb14b9-799c-44a4-b8df-a2ccf094e66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:45.116916 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1098/2177] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:33:45 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:45.121704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f4a45-5ea1-4b3e-a205-8c5546a47aa4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:45.183983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f4a45-5ea1-4b3e-a205-8c5546a47aa4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:45.188859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919aef3-b794-46d2-ba95-1d6606832000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:45.189473 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919aef3-b794-46d2-ba95-1d6606832000 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:45.189753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919aef3-b794-46d2-ba95-1d6606832000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:45.190029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919aef3-b794-46d2-ba95-1d6606832000 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:45.190676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919aef3-b794-46d2-ba95-1d6606832000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:45.191140 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb14b9-799c-44a4-b8df-a2ccf094e66d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:45.192720 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919aef3-b794-46d2-ba95-1d6606832000 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:45.216433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1099/2178] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:33:45 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:45.220392 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919aef3-b794-46d2-ba95-1d6606832000 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:45.232509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919aef3-b794-46d2-ba95-1d6606832000 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:45.237984 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb36e0e-9de7-45e5-8a28-7e533ed6bb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:45.238954 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb36e0e-9de7-45e5-8a28-7e533ed6bb57 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:45.239147 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb36e0e-9de7-45e5-8a28-7e533ed6bb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:45.239517 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb36e0e-9de7-45e5-8a28-7e533ed6bb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:45.240272 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb36e0e-9de7-45e5-8a28-7e533ed6bb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:45.241879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb36e0e-9de7-45e5-8a28-7e533ed6bb57 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:45.253952 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1100/2179] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:33:45.257951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb36e0e-9de7-45e5-8a28-7e533ed6bb57 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:45.267565 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f9e81-5ed7-469b-95c3-20860ab8037f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:45.267771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f9e81-5ed7-469b-95c3-20860ab8037f service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:45.268086 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f9e81-5ed7-469b-95c3-20860ab8037f service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:45.268380 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f9e81-5ed7-469b-95c3-20860ab8037f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:45.268488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb36e0e-9de7-45e5-8a28-7e533ed6bb57 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:45.273140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ac36a-e051-4526-9d40-7b463faad7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:45.273804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ac36a-e051-4526-9d40-7b463faad7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:45.274162 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ac36a-e051-4526-9d40-7b463faad7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:45.275048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ac36a-e051-4526-9d40-7b463faad7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:45.275879 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ac36a-e051-4526-9d40-7b463faad7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:45.277474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ac36a-e051-4526-9d40-7b463faad7c1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:45.277779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f9e81-5ed7-469b-95c3-20860ab8037f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:45.279351 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f9e81-5ed7-469b-95c3-20860ab8037f service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:45.289412 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1080/2180] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:45.293321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1101/2181] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:33:45.294563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f9e81-5ed7-469b-95c3-20860ab8037f service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:45.304628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f9e81-5ed7-469b-95c3-20860ab8037f service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:45.309456 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0e150-50f7-49c9-beb5-68c5543bc9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:45.310152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0e150-50f7-49c9-beb5-68c5543bc9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:45.310367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0e150-50f7-49c9-beb5-68c5543bc9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:45.310641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0e150-50f7-49c9-beb5-68c5543bc9ec admin admin] PATH_INFO: `/v3/projects/0072af6db1b84f55b094c46bb3ae7750/users/493e83881af54efeb8581e3fee732b66/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:45.327634 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0e150-50f7-49c9-beb5-68c5543bc9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0072af6db1b84f55b094c46bb3ae7750, user_id=493e83881af54efeb8581e3fee732b66, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:45.330501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0e150-50f7-49c9-beb5-68c5543bc9ec admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:45.347086 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1081/2182] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:45 2022] PUT /identity/v3/projects/0072af6db1b84f55b094c46bb3ae7750/users/493e83881af54efeb8581e3fee732b66/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:33:45.359957 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b7ea5-92ae-4aeb-b142-81b12f946d93 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:45.360318 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b7ea5-92ae-4aeb-b142-81b12f946d93 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:45.360595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b7ea5-92ae-4aeb-b142-81b12f946d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:45.391301 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cb7b7ea5-92ae-4aeb-b142-81b12f946d93 None None] MFA Rules not processed for user `493e83881af54efeb8581e3fee732b66`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:45.392605 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cb7b7ea5-92ae-4aeb-b142-81b12f946d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:45.461095 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1102/2183] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:45.473533 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0e150-50f7-49c9-beb5-68c5543bc9ec admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:45.475323 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f2b0e150-50f7-49c9-beb5-68c5543bc9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:45.487282 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:45.554192 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0e150-50f7-49c9-beb5-68c5543bc9ec admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:45.560090 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d0d42-8ca4-4527-96c1-18d5c86319cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:45.560420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d0d42-8ca4-4527-96c1-18d5c86319cc service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:45.560699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d0d42-8ca4-4527-96c1-18d5c86319cc service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:45.560971 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d0d42-8ca4-4527-96c1-18d5c86319cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:45.568992 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d0d42-8ca4-4527-96c1-18d5c86319cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:45.570578 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d0d42-8ca4-4527-96c1-18d5c86319cc service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:45.579856 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1082/2184] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:45.780644 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b7ea5-92ae-4aeb-b142-81b12f946d93 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:45.785115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:45.847098 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b7ea5-92ae-4aeb-b142-81b12f946d93 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:45.852183 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72dc37-9f6c-4ff1-a1c1-c5ebe3dab172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:45.852826 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72dc37-9f6c-4ff1-a1c1-c5ebe3dab172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:45.853113 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72dc37-9f6c-4ff1-a1c1-c5ebe3dab172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:45.853651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72dc37-9f6c-4ff1-a1c1-c5ebe3dab172 admin admin] PATH_INFO: `/v3/users/493e83881af54efeb8581e3fee732b66` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:45.854738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72dc37-9f6c-4ff1-a1c1-c5ebe3dab172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=493e83881af54efeb8581e3fee732b66)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:45.856721 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72dc37-9f6c-4ff1-a1c1-c5ebe3dab172 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:45.904736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea72dc37-9f6c-4ff1-a1c1-c5ebe3dab172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '493e83881af54efeb8581e3fee732b66'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:45.905391 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea72dc37-9f6c-4ff1-a1c1-c5ebe3dab172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '493e83881af54efeb8581e3fee732b66'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:45.913334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea72dc37-9f6c-4ff1-a1c1-c5ebe3dab172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '493e83881af54efeb8581e3fee732b66'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:45.913958 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea72dc37-9f6c-4ff1-a1c1-c5ebe3dab172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '493e83881af54efeb8581e3fee732b66'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:45.921664 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea72dc37-9f6c-4ff1-a1c1-c5ebe3dab172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '493e83881af54efeb8581e3fee732b66'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:45.943734 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1103/2185] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:33:45 2022] DELETE /identity/v3/users/493e83881af54efeb8581e3fee732b66 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:45.951251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b051a-f709-4460-aa63-dd928de3f1ad None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:45.951691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b051a-f709-4460-aa63-dd928de3f1ad None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:45.952395 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b051a-f709-4460-aa63-dd928de3f1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:45.977154 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a57b051a-f709-4460-aa63-dd928de3f1ad None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:45.978400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a57b051a-f709-4460-aa63-dd928de3f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:46.050400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1083/2186] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:46.061097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72dc37-9f6c-4ff1-a1c1-c5ebe3dab172 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:46.062510 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ea72dc37-9f6c-4ff1-a1c1-c5ebe3dab172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:46.130651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72dc37-9f6c-4ff1-a1c1-c5ebe3dab172 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:46.135261 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ae7e0-04e3-43ce-97c0-54ff9150074d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:46.135969 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ae7e0-04e3-43ce-97c0-54ff9150074d service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:46.136322 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ae7e0-04e3-43ce-97c0-54ff9150074d service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:46.136745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ae7e0-04e3-43ce-97c0-54ff9150074d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:46.148040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ae7e0-04e3-43ce-97c0-54ff9150074d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:46.150201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ae7e0-04e3-43ce-97c0-54ff9150074d service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:46.160990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1104/2187] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:46.442310 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b051a-f709-4460-aa63-dd928de3f1ad None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:46.443954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a57b051a-f709-4460-aa63-dd928de3f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:46.464905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b051a-f709-4460-aa63-dd928de3f1ad None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:46.476263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a267ea-da48-467c-8b67-a0ba5041eddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:46.477032 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a267ea-da48-467c-8b67-a0ba5041eddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:46.478470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a267ea-da48-467c-8b67-a0ba5041eddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:46.478783 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a267ea-da48-467c-8b67-a0ba5041eddb admin admin] PATH_INFO: `/v3/projects/0072af6db1b84f55b094c46bb3ae7750` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:46.480619 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a267ea-da48-467c-8b67-a0ba5041eddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0072af6db1b84f55b094c46bb3ae7750)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:46.482643 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a267ea-da48-467c-8b67-a0ba5041eddb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:46.534422 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-77a267ea-da48-467c-8b67-a0ba5041eddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0072af6db1b84f55b094c46bb3ae7750', 'request_id': 'req-77a267ea-da48-467c-8b67-a0ba5041eddb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:46.542228 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-77a267ea-da48-467c-8b67-a0ba5041eddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0072af6db1b84f55b094c46bb3ae7750', 'request_id': 'req-77a267ea-da48-467c-8b67-a0ba5041eddb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:46.548655 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-77a267ea-da48-467c-8b67-a0ba5041eddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0072af6db1b84f55b094c46bb3ae7750', 'request_id': 'req-77a267ea-da48-467c-8b67-a0ba5041eddb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:46.559207 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-77a267ea-da48-467c-8b67-a0ba5041eddb admin admin] The token cache is being invalidate because project 0072af6db1b84f55b094c46bb3ae7750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:33:46.559489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-77a267ea-da48-467c-8b67-a0ba5041eddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:46.560138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-77a267ea-da48-467c-8b67-a0ba5041eddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:46.561667 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1084/2188] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:33:46 2022] DELETE /identity/v3/projects/0072af6db1b84f55b094c46bb3ae7750 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:46.566543 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf645de7-0000-4961-9650-850624a1d7e1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:46.567004 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf645de7-0000-4961-9650-850624a1d7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:46.567095 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf645de7-0000-4961-9650-850624a1d7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:46.586085 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-bf645de7-0000-4961-9650-850624a1d7e1 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:46.587217 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bf645de7-0000-4961-9650-850624a1d7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:46.605667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:46.647155 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1105/2189] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:46.655401 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cacc32-d576-4b54-9b2d-4ca0df9eb2f2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:46.655689 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cacc32-d576-4b54-9b2d-4ca0df9eb2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:46.656000 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cacc32-d576-4b54-9b2d-4ca0df9eb2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:46.676006 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-63cacc32-d576-4b54-9b2d-4ca0df9eb2f2 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:46.677212 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-63cacc32-d576-4b54-9b2d-4ca0df9eb2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:46.685051 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1085/2190] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:46.689259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf645de7-0000-4961-9650-850624a1d7e1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:46.698787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf645de7-0000-4961-9650-850624a1d7e1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:46.703342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574d91f-7973-41c2-9507-f84eb6de40b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:46.703998 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574d91f-7973-41c2-9507-f84eb6de40b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:46.704279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574d91f-7973-41c2-9507-f84eb6de40b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:46.704551 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574d91f-7973-41c2-9507-f84eb6de40b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:46.705191 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574d91f-7973-41c2-9507-f84eb6de40b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:33:46.705493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574d91f-7973-41c2-9507-f84eb6de40b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:46.707087 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574d91f-7973-41c2-9507-f84eb6de40b2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:46.718759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1106/2191] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:33:46.722950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cacc32-d576-4b54-9b2d-4ca0df9eb2f2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:46.732622 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cacc32-d576-4b54-9b2d-4ca0df9eb2f2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:46.737187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf231ac-0d06-4ca0-bbdb-820598b70f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:46.737771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf231ac-0d06-4ca0-bbdb-820598b70f8d admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:46.738050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf231ac-0d06-4ca0-bbdb-820598b70f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:46.738318 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf231ac-0d06-4ca0-bbdb-820598b70f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:46.738937 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf231ac-0d06-4ca0-bbdb-820598b70f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:46.740854 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf231ac-0d06-4ca0-bbdb-820598b70f8d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:46.745984 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:46.771121 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1086/2192] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:33:46 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:33:46.777006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574d91f-7973-41c2-9507-f84eb6de40b2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:46.787786 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574d91f-7973-41c2-9507-f84eb6de40b2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:46.846035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33559b2f-bcc9-4298-b17b-2af86da76337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:46.846649 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33559b2f-bcc9-4298-b17b-2af86da76337 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:46.846931 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33559b2f-bcc9-4298-b17b-2af86da76337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:46.847203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33559b2f-bcc9-4298-b17b-2af86da76337 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:46.847835 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33559b2f-bcc9-4298-b17b-2af86da76337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:46.849836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33559b2f-bcc9-4298-b17b-2af86da76337 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:46.872426 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1107/2193] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:33:46 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:33:46.876569 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf231ac-0d06-4ca0-bbdb-820598b70f8d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:46.887944 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf231ac-0d06-4ca0-bbdb-820598b70f8d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:46.892802 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a4c04-c312-4733-b4c5-709a45f14f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:46.893420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a4c04-c312-4733-b4c5-709a45f14f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:46.893694 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a4c04-c312-4733-b4c5-709a45f14f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:46.893963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a4c04-c312-4733-b4c5-709a45f14f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:46.894611 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a4c04-c312-4733-b4c5-709a45f14f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:46.896248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a4c04-c312-4733-b4c5-709a45f14f40 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:46.907365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1087/2194] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:33:46.911321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33559b2f-bcc9-4298-b17b-2af86da76337 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:46.921962 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33559b2f-bcc9-4298-b17b-2af86da76337 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:46.926673 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2fe79-03b3-490a-8f9d-53f17cd75d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:46.927287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2fe79-03b3-490a-8f9d-53f17cd75d2d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:46.927565 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2fe79-03b3-490a-8f9d-53f17cd75d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:46.927830 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2fe79-03b3-490a-8f9d-53f17cd75d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:46.928537 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2fe79-03b3-490a-8f9d-53f17cd75d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:46.930143 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2fe79-03b3-490a-8f9d-53f17cd75d2d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:46.943354 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1108/2195] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:46.948276 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a4c04-c312-4733-b4c5-709a45f14f40 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:46.958636 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a4c04-c312-4733-b4c5-709a45f14f40 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:46.964813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95228cd4-308b-4e7b-86df-2de7bbf4be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:46.965492 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95228cd4-308b-4e7b-86df-2de7bbf4be95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:46.965762 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95228cd4-308b-4e7b-86df-2de7bbf4be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:46.966308 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95228cd4-308b-4e7b-86df-2de7bbf4be95 admin admin] PATH_INFO: `/v3/projects/81e3d7b42b79485993f64f07b1fa089a/users/5284d3f75013416e9f16f8fe96a5399c/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:46.983359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95228cd4-308b-4e7b-86df-2de7bbf4be95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e3d7b42b79485993f64f07b1fa089a, user_id=5284d3f75013416e9f16f8fe96a5399c, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:46.985862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95228cd4-308b-4e7b-86df-2de7bbf4be95 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:47.019741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1088/2196] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:46 2022] PUT /identity/v3/projects/81e3d7b42b79485993f64f07b1fa089a/users/5284d3f75013416e9f16f8fe96a5399c/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:33:47.030599 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e35d39-1dda-49f3-a327-e7f87aa517d4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:47.030886 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e35d39-1dda-49f3-a327-e7f87aa517d4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:47.031163 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e35d39-1dda-49f3-a327-e7f87aa517d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:47.066763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-32e35d39-1dda-49f3-a327-e7f87aa517d4 None None] MFA Rules not processed for user `5284d3f75013416e9f16f8fe96a5399c`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:47.068289 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-32e35d39-1dda-49f3-a327-e7f87aa517d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:47.136096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1109/2197] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:47 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:33:47.140868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95228cd4-308b-4e7b-86df-2de7bbf4be95 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:47.231103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95228cd4-308b-4e7b-86df-2de7bbf4be95 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:47.236313 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca40b97-eb9d-4f5e-a0d8-e8b8647a2574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:47.237213 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca40b97-eb9d-4f5e-a0d8-e8b8647a2574 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:47.237777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca40b97-eb9d-4f5e-a0d8-e8b8647a2574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:47.238345 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca40b97-eb9d-4f5e-a0d8-e8b8647a2574 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:47.239287 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca40b97-eb9d-4f5e-a0d8-e8b8647a2574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:47.241690 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca40b97-eb9d-4f5e-a0d8-e8b8647a2574 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:47.271978 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1089/2198] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:33:47 2022] POST /identity/v3/projects => generated 405 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:33:47.276095 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e35d39-1dda-49f3-a327-e7f87aa517d4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:47.288184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e35d39-1dda-49f3-a327-e7f87aa517d4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:47.308053 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:47.356218 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b84a5c-2e1e-4890-bf90-a1225e01c333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:47.356934 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b84a5c-2e1e-4890-bf90-a1225e01c333 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:47.357282 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b84a5c-2e1e-4890-bf90-a1225e01c333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:47.357622 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b84a5c-2e1e-4890-bf90-a1225e01c333 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:47.358351 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b84a5c-2e1e-4890-bf90-a1225e01c333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:47.360531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b84a5c-2e1e-4890-bf90-a1225e01c333 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:47.384700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1110/2199] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:33:47 2022] POST /identity/v3/users => generated 309 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:47.388332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca40b97-eb9d-4f5e-a0d8-e8b8647a2574 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:47.400297 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca40b97-eb9d-4f5e-a0d8-e8b8647a2574 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:47.407466 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1f175-7e06-41cf-a765-c41beb361e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:47.408383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1f175-7e06-41cf-a765-c41beb361e4f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:47.408807 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1f175-7e06-41cf-a765-c41beb361e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:47.409223 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1f175-7e06-41cf-a765-c41beb361e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:47.410132 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1f175-7e06-41cf-a765-c41beb361e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:47.411876 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1f175-7e06-41cf-a765-c41beb361e4f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:47.424706 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1090/2200] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:47.428983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b84a5c-2e1e-4890-bf90-a1225e01c333 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:47.439255 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b84a5c-2e1e-4890-bf90-a1225e01c333 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:47.444196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae774d45-f1c6-4308-ba26-09d6ea1ef274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:47.444903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae774d45-f1c6-4308-ba26-09d6ea1ef274 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:47.445185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae774d45-f1c6-4308-ba26-09d6ea1ef274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:47.445462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae774d45-f1c6-4308-ba26-09d6ea1ef274 admin admin] PATH_INFO: `/v3/projects/45bd22f7bd3246ce91dd9eab6da93c7b/users/52b02c96646f45c1aac0cb2e937d5344/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:47.461434 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae774d45-f1c6-4308-ba26-09d6ea1ef274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45bd22f7bd3246ce91dd9eab6da93c7b, user_id=52b02c96646f45c1aac0cb2e937d5344, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:47.464849 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae774d45-f1c6-4308-ba26-09d6ea1ef274 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:47.478326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1111/2201] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:47 2022] PUT /identity/v3/projects/45bd22f7bd3246ce91dd9eab6da93c7b/users/52b02c96646f45c1aac0cb2e937d5344/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:47.482185 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1f175-7e06-41cf-a765-c41beb361e4f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:47.493669 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1f175-7e06-41cf-a765-c41beb361e4f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:47.569050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aed038-109c-4660-9c99-147c99c1ac12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:47.569050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aed038-109c-4660-9c99-147c99c1ac12 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:47.569050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aed038-109c-4660-9c99-147c99c1ac12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:47.569050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aed038-109c-4660-9c99-147c99c1ac12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:47.569365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aed038-109c-4660-9c99-147c99c1ac12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:47.569365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aed038-109c-4660-9c99-147c99c1ac12 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:47.591976 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1091/2202] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:33:47.595347 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae774d45-f1c6-4308-ba26-09d6ea1ef274 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:47.607573 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae774d45-f1c6-4308-ba26-09d6ea1ef274 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:47.612792 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28839086-4d19-428c-ba98-436669b09739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:47.613163 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28839086-4d19-428c-ba98-436669b09739 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:47.613444 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28839086-4d19-428c-ba98-436669b09739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:47.613721 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28839086-4d19-428c-ba98-436669b09739 admin admin] PATH_INFO: `/v3/projects/45bd22f7bd3246ce91dd9eab6da93c7b/users/52b02c96646f45c1aac0cb2e937d5344/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:47.615706 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28839086-4d19-428c-ba98-436669b09739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45bd22f7bd3246ce91dd9eab6da93c7b, user_id=52b02c96646f45c1aac0cb2e937d5344, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:47.619194 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28839086-4d19-428c-ba98-436669b09739 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:47.635410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1112/2203] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:47 2022] PUT /identity/v3/projects/45bd22f7bd3246ce91dd9eab6da93c7b/users/52b02c96646f45c1aac0cb2e937d5344/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:47.647080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7731b-3548-4000-9ef5-64cb0a3cf311 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:47.647369 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7731b-3548-4000-9ef5-64cb0a3cf311 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:47.647569 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7731b-3548-4000-9ef5-64cb0a3cf311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:47.676740 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0cb7731b-3548-4000-9ef5-64cb0a3cf311 None None] MFA Rules not processed for user `52b02c96646f45c1aac0cb2e937d5344`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:47.677982 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0cb7731b-3548-4000-9ef5-64cb0a3cf311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:47.693296 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:47.786170 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1092/2204] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:47 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:47.794777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28839086-4d19-428c-ba98-436669b09739 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:47.797628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-28839086-4d19-428c-ba98-436669b09739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:47.872839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28839086-4d19-428c-ba98-436669b09739 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:47.886357 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a70e06-c44d-4af3-af18-76d3ec8d7f67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:47.886990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70e06-c44d-4af3-af18-76d3ec8d7f67 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:47.887266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70e06-c44d-4af3-af18-76d3ec8d7f67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:47.887536 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70e06-c44d-4af3-af18-76d3ec8d7f67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:47.898450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a70e06-c44d-4af3-af18-76d3ec8d7f67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:47.900954 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a70e06-c44d-4af3-af18-76d3ec8d7f67 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:47.916983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1113/2205] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:47 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:48.151419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7731b-3548-4000-9ef5-64cb0a3cf311 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:48.229964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7731b-3548-4000-9ef5-64cb0a3cf311 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:48.235352 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfa030-d541-4207-8517-25af3a58b2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:48.236311 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfa030-d541-4207-8517-25af3a58b2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:48.236598 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfa030-d541-4207-8517-25af3a58b2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:48.236877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfa030-d541-4207-8517-25af3a58b2c1 admin admin] PATH_INFO: `/v3/users/5284d3f75013416e9f16f8fe96a5399c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:48.238394 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfa030-d541-4207-8517-25af3a58b2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5284d3f75013416e9f16f8fe96a5399c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:48.240270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfa030-d541-4207-8517-25af3a58b2c1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:48.302452 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-13cfa030-d541-4207-8517-25af3a58b2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5284d3f75013416e9f16f8fe96a5399c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:48.303199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-13cfa030-d541-4207-8517-25af3a58b2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5284d3f75013416e9f16f8fe96a5399c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:48.311953 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-13cfa030-d541-4207-8517-25af3a58b2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5284d3f75013416e9f16f8fe96a5399c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:48.312633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-13cfa030-d541-4207-8517-25af3a58b2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5284d3f75013416e9f16f8fe96a5399c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:48.320901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-13cfa030-d541-4207-8517-25af3a58b2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5284d3f75013416e9f16f8fe96a5399c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:48.341980 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1093/2206] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:33:48 2022] DELETE /identity/v3/users/5284d3f75013416e9f16f8fe96a5399c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:48.346268 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092c19c-82de-4869-9cd2-78fd5afaf385 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:48.346555 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092c19c-82de-4869-9cd2-78fd5afaf385 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:48.346836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092c19c-82de-4869-9cd2-78fd5afaf385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:48.365863 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d092c19c-82de-4869-9cd2-78fd5afaf385 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:48.367083 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d092c19c-82de-4869-9cd2-78fd5afaf385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:48.440065 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1114/2207] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:48.450983 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfa030-d541-4207-8517-25af3a58b2c1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:48.453312 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-13cfa030-d541-4207-8517-25af3a58b2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:48.488672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:48.524485 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfa030-d541-4207-8517-25af3a58b2c1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:48.528897 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345209d-212b-4570-a26a-c3969c5d8959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:48.529574 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345209d-212b-4570-a26a-c3969c5d8959 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:48.529867 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345209d-212b-4570-a26a-c3969c5d8959 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:48.530288 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345209d-212b-4570-a26a-c3969c5d8959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:48.542782 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345209d-212b-4570-a26a-c3969c5d8959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:48.544342 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345209d-212b-4570-a26a-c3969c5d8959 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:48.556784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1094/2208] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:48.873625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092c19c-82de-4869-9cd2-78fd5afaf385 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:48.875080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d092c19c-82de-4869-9cd2-78fd5afaf385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:48.888221 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092c19c-82de-4869-9cd2-78fd5afaf385 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:48.895546 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:48.896416 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:48.896764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:48.897271 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7 admin admin] PATH_INFO: `/v3/projects/81e3d7b42b79485993f64f07b1fa089a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:48.898674 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81e3d7b42b79485993f64f07b1fa089a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:48.900913 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:48.913556 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:48.958884 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81e3d7b42b79485993f64f07b1fa089a', 'request_id': 'req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:48.966532 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81e3d7b42b79485993f64f07b1fa089a', 'request_id': 'req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:48.973986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81e3d7b42b79485993f64f07b1fa089a', 'request_id': 'req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:48.985147 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7 admin admin] The token cache is being invalidate because project 81e3d7b42b79485993f64f07b1fa089a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:33:48.985425 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:48.986079 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:48.987787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1115/2209] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:33:48 2022] DELETE /identity/v3/projects/81e3d7b42b79485993f64f07b1fa089a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:48.991596 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345209d-212b-4570-a26a-c3969c5d8959 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:49.002539 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345209d-212b-4570-a26a-c3969c5d8959 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:49.065137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad68454-b71f-4b18-9dc5-701f1212c1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:49.065780 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad68454-b71f-4b18-9dc5-701f1212c1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:49.066061 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad68454-b71f-4b18-9dc5-701f1212c1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:49.066464 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad68454-b71f-4b18-9dc5-701f1212c1a1 admin admin] PATH_INFO: `/v3/users/52b02c96646f45c1aac0cb2e937d5344` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:49.067608 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad68454-b71f-4b18-9dc5-701f1212c1a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b02c96646f45c1aac0cb2e937d5344)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:49.069592 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad68454-b71f-4b18-9dc5-701f1212c1a1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:49.123511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ad68454-b71f-4b18-9dc5-701f1212c1a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b02c96646f45c1aac0cb2e937d5344'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:49.123884 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ad68454-b71f-4b18-9dc5-701f1212c1a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b02c96646f45c1aac0cb2e937d5344'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:49.136134 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ad68454-b71f-4b18-9dc5-701f1212c1a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b02c96646f45c1aac0cb2e937d5344'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:49.136934 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ad68454-b71f-4b18-9dc5-701f1212c1a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b02c96646f45c1aac0cb2e937d5344'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:49.147156 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ad68454-b71f-4b18-9dc5-701f1212c1a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b02c96646f45c1aac0cb2e937d5344'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:49.176481 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1095/2210] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:33:48 2022] DELETE /identity/v3/users/52b02c96646f45c1aac0cb2e937d5344 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:49.541151 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:49.542749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:49.556410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4eb685-ef90-4146-adb8-aa438d4fb1a7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:49.630860 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91081446-489a-4198-b967-7dad6442491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:49.631519 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081446-489a-4198-b967-7dad6442491c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:49.631903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081446-489a-4198-b967-7dad6442491c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:49.632175 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081446-489a-4198-b967-7dad6442491c admin admin] PATH_INFO: `/v3/projects/45bd22f7bd3246ce91dd9eab6da93c7b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:49.633315 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91081446-489a-4198-b967-7dad6442491c admin admin] RBAC: Authorizing `identity:delete_project(project_id=45bd22f7bd3246ce91dd9eab6da93c7b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:49.636100 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91081446-489a-4198-b967-7dad6442491c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:49.695618 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-91081446-489a-4198-b967-7dad6442491c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45bd22f7bd3246ce91dd9eab6da93c7b', 'request_id': 'req-91081446-489a-4198-b967-7dad6442491c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:49.704291 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-91081446-489a-4198-b967-7dad6442491c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45bd22f7bd3246ce91dd9eab6da93c7b', 'request_id': 'req-91081446-489a-4198-b967-7dad6442491c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:49.710657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-91081446-489a-4198-b967-7dad6442491c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45bd22f7bd3246ce91dd9eab6da93c7b', 'request_id': 'req-91081446-489a-4198-b967-7dad6442491c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:49.721445 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-91081446-489a-4198-b967-7dad6442491c admin admin] The token cache is being invalidate because project 45bd22f7bd3246ce91dd9eab6da93c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:33:49.721728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-91081446-489a-4198-b967-7dad6442491c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:49.722370 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-91081446-489a-4198-b967-7dad6442491c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:49.723843 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1116/2211] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:33:49 2022] DELETE /identity/v3/projects/45bd22f7bd3246ce91dd9eab6da93c7b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:49.729040 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12511a93-e277-4da3-b0c1-309966a1c41e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:49.729533 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12511a93-e277-4da3-b0c1-309966a1c41e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:49.729785 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12511a93-e277-4da3-b0c1-309966a1c41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:49.750346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-12511a93-e277-4da3-b0c1-309966a1c41e None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:49.751582 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-12511a93-e277-4da3-b0c1-309966a1c41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:49.810528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:49.831063 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1096/2212] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:49.839240 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080bea-ee64-4909-a5a6-196994f7d17c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:49.839528 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080bea-ee64-4909-a5a6-196994f7d17c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:49.839792 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080bea-ee64-4909-a5a6-196994f7d17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:49.860463 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-89080bea-ee64-4909-a5a6-196994f7d17c None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:49.861687 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-89080bea-ee64-4909-a5a6-196994f7d17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:49.870119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1117/2213] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:49.874310 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12511a93-e277-4da3-b0c1-309966a1c41e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:49.884618 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12511a93-e277-4da3-b0c1-309966a1c41e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:49.900377 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3c91a-6c88-4443-aea0-bab15c3c68b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:49.900978 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3c91a-6c88-4443-aea0-bab15c3c68b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:49.901336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3c91a-6c88-4443-aea0-bab15c3c68b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:49.901607 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3c91a-6c88-4443-aea0-bab15c3c68b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:49.902269 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3c91a-6c88-4443-aea0-bab15c3c68b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:33:49.902584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3c91a-6c88-4443-aea0-bab15c3c68b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:49.904325 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3c91a-6c88-4443-aea0-bab15c3c68b0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:49.920016 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1097/2214] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:33:49.921004 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89080bea-ee64-4909-a5a6-196994f7d17c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:49.935980 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89080bea-ee64-4909-a5a6-196994f7d17c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:49.942079 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd69989-0d6c-47e2-a7f8-d360a6f3140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:49.942777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd69989-0d6c-47e2-a7f8-d360a6f3140e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:49.943227 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd69989-0d6c-47e2-a7f8-d360a6f3140e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:49.943599 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd69989-0d6c-47e2-a7f8-d360a6f3140e admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:49.944505 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd69989-0d6c-47e2-a7f8-d360a6f3140e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:49.946460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd69989-0d6c-47e2-a7f8-d360a6f3140e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:49.973299 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:49.983981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1118/2215] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:33:49 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:49.985566 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3c91a-6c88-4443-aea0-bab15c3c68b0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:49.997124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3c91a-6c88-4443-aea0-bab15c3c68b0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:50.074088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef198d-79d2-497a-bc11-b4de57b84d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:50.074723 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef198d-79d2-497a-bc11-b4de57b84d10 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:50.075006 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef198d-79d2-497a-bc11-b4de57b84d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:50.075284 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef198d-79d2-497a-bc11-b4de57b84d10 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:50.075955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef198d-79d2-497a-bc11-b4de57b84d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:50.077950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef198d-79d2-497a-bc11-b4de57b84d10 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:50.108001 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1098/2216] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:33:49 2022] POST /identity/v3/users => generated 282 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:33:50.109633 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd69989-0d6c-47e2-a7f8-d360a6f3140e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:50.123573 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd69989-0d6c-47e2-a7f8-d360a6f3140e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:50.129654 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a15f6-f78e-4a46-bcad-4c44fac83e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:50.130267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a15f6-f78e-4a46-bcad-4c44fac83e6a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:50.130545 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a15f6-f78e-4a46-bcad-4c44fac83e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:50.130813 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a15f6-f78e-4a46-bcad-4c44fac83e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:50.131462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a15f6-f78e-4a46-bcad-4c44fac83e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:50.133128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a15f6-f78e-4a46-bcad-4c44fac83e6a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:50.144421 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1119/2217] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:50.148468 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef198d-79d2-497a-bc11-b4de57b84d10 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:50.159419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef198d-79d2-497a-bc11-b4de57b84d10 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:50.164369 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4b98f-537a-4cd4-891b-0d3e4c4041c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:50.165280 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4b98f-537a-4cd4-891b-0d3e4c4041c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:50.165668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4b98f-537a-4cd4-891b-0d3e4c4041c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:50.166059 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4b98f-537a-4cd4-891b-0d3e4c4041c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:50.166811 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4b98f-537a-4cd4-891b-0d3e4c4041c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:50.168646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4b98f-537a-4cd4-891b-0d3e4c4041c5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:50.180908 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1099/2218] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:33:50.185072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a15f6-f78e-4a46-bcad-4c44fac83e6a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:50.195105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a15f6-f78e-4a46-bcad-4c44fac83e6a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:50.200193 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfe2b0-5495-4b17-b2de-3c1debe106f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:50.200829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfe2b0-5495-4b17-b2de-3c1debe106f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:50.201105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfe2b0-5495-4b17-b2de-3c1debe106f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:50.201375 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfe2b0-5495-4b17-b2de-3c1debe106f1 admin admin] PATH_INFO: `/v3/projects/dec23fe257244c14af8fe61295bd165d/users/c4ec8012b6a54d0ebe930b08d60eaacc/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:50.231019 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfe2b0-5495-4b17-b2de-3c1debe106f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec23fe257244c14af8fe61295bd165d, user_id=c4ec8012b6a54d0ebe930b08d60eaacc, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:50.233748 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfe2b0-5495-4b17-b2de-3c1debe106f1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:50.247325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1120/2219] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:50 2022] PUT /identity/v3/projects/dec23fe257244c14af8fe61295bd165d/users/c4ec8012b6a54d0ebe930b08d60eaacc/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:50.257748 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75a57e-1cc0-453c-bb01-722400d0eaf0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:50.258032 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75a57e-1cc0-453c-bb01-722400d0eaf0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:50.258305 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75a57e-1cc0-453c-bb01-722400d0eaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:50.288594 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ea75a57e-1cc0-453c-bb01-722400d0eaf0 None None] MFA Rules not processed for user `c4ec8012b6a54d0ebe930b08d60eaacc`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:50.289806 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ea75a57e-1cc0-453c-bb01-722400d0eaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:50.364559 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1100/2220] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:50.373095 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfe2b0-5495-4b17-b2de-3c1debe106f1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:50.451688 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfe2b0-5495-4b17-b2de-3c1debe106f1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:50.456511 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df24b6-6f30-4354-a6be-a0fd92673e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:50.457194 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df24b6-6f30-4354-a6be-a0fd92673e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:50.457478 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df24b6-6f30-4354-a6be-a0fd92673e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:50.457747 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df24b6-6f30-4354-a6be-a0fd92673e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:50.458650 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df24b6-6f30-4354-a6be-a0fd92673e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:50.460607 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df24b6-6f30-4354-a6be-a0fd92673e55 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:50.488121 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1121/2221] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:33:50 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:33:50.492548 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75a57e-1cc0-453c-bb01-722400d0eaf0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:50.504905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75a57e-1cc0-453c-bb01-722400d0eaf0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:50.551916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:50.579291 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f770769-b30f-4285-8857-f21f7cd39394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:50.579910 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f770769-b30f-4285-8857-f21f7cd39394 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:50.580530 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f770769-b30f-4285-8857-f21f7cd39394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:50.580815 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f770769-b30f-4285-8857-f21f7cd39394 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:50.581462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f770769-b30f-4285-8857-f21f7cd39394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:50.583427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f770769-b30f-4285-8857-f21f7cd39394 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:50.609234 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1101/2222] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:33:50 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:50.613794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df24b6-6f30-4354-a6be-a0fd92673e55 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:50.631242 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df24b6-6f30-4354-a6be-a0fd92673e55 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:50.637035 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af91f2-e0f9-4ece-9e7c-ea8af0dc3619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:50.637919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af91f2-e0f9-4ece-9e7c-ea8af0dc3619 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:50.638125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af91f2-e0f9-4ece-9e7c-ea8af0dc3619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:50.638402 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af91f2-e0f9-4ece-9e7c-ea8af0dc3619 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:50.639213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af91f2-e0f9-4ece-9e7c-ea8af0dc3619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:50.644218 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af91f2-e0f9-4ece-9e7c-ea8af0dc3619 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:50.659632 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1122/2223] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:50.660830 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f770769-b30f-4285-8857-f21f7cd39394 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:50.672466 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f770769-b30f-4285-8857-f21f7cd39394 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:50.677887 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb62a29-baf3-4106-9f70-7b5afb1c5685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:50.678742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb62a29-baf3-4106-9f70-7b5afb1c5685 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:50.679080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb62a29-baf3-4106-9f70-7b5afb1c5685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:50.679417 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb62a29-baf3-4106-9f70-7b5afb1c5685 admin admin] PATH_INFO: `/v3/projects/62ffacf42feb4cb88b46b40d21ec879c/users/0eb8e71de26c440eb279538da9ea6ca9/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:50.697497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb62a29-baf3-4106-9f70-7b5afb1c5685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ffacf42feb4cb88b46b40d21ec879c, user_id=0eb8e71de26c440eb279538da9ea6ca9, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:50.700858 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb62a29-baf3-4106-9f70-7b5afb1c5685 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:50.720331 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1102/2224] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:50 2022] PUT /identity/v3/projects/62ffacf42feb4cb88b46b40d21ec879c/users/0eb8e71de26c440eb279538da9ea6ca9/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:50.724046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af91f2-e0f9-4ece-9e7c-ea8af0dc3619 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:50.730771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb62a29-baf3-4106-9f70-7b5afb1c5685 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:50.733346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fcb62a29-baf3-4106-9f70-7b5afb1c5685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:50.736069 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af91f2-e0f9-4ece-9e7c-ea8af0dc3619 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:50.794354 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32a9f2-227f-42bb-8b5a-26b9111967f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:50.794983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32a9f2-227f-42bb-8b5a-26b9111967f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:50.795264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32a9f2-227f-42bb-8b5a-26b9111967f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:50.795530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32a9f2-227f-42bb-8b5a-26b9111967f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:50.796195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32a9f2-227f-42bb-8b5a-26b9111967f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:50.797782 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32a9f2-227f-42bb-8b5a-26b9111967f4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:50.808257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1123/2225] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:50.810671 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb62a29-baf3-4106-9f70-7b5afb1c5685 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:50.812281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32a9f2-227f-42bb-8b5a-26b9111967f4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:50.815341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37ded0-e6f4-4208-8a47-ad50554f25c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:50.815994 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37ded0-e6f4-4208-8a47-ad50554f25c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:50.816282 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37ded0-e6f4-4208-8a47-ad50554f25c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:50.816563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37ded0-e6f4-4208-8a47-ad50554f25c4 admin admin] PATH_INFO: `/v3/users/e3a7d0cde6c54f51ab2c52f5aede6844` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:50.818379 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37ded0-e6f4-4208-8a47-ad50554f25c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a7d0cde6c54f51ab2c52f5aede6844)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:50.820363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37ded0-e6f4-4208-8a47-ad50554f25c4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:50.821848 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32a9f2-227f-42bb-8b5a-26b9111967f4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:50.828163 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527f0ad-4756-4488-bba6-5289987959a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:50.828861 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527f0ad-4756-4488-bba6-5289987959a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:50.829138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527f0ad-4756-4488-bba6-5289987959a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:50.829532 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527f0ad-4756-4488-bba6-5289987959a1 admin admin] PATH_INFO: `/v3/projects/62ffacf42feb4cb88b46b40d21ec879c/users/0eb8e71de26c440eb279538da9ea6ca9/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:50.831618 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527f0ad-4756-4488-bba6-5289987959a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ffacf42feb4cb88b46b40d21ec879c, user_id=0eb8e71de26c440eb279538da9ea6ca9, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:50.834311 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527f0ad-4756-4488-bba6-5289987959a1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:50.844785 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1124/2226] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:50 2022] PUT /identity/v3/projects/62ffacf42feb4cb88b46b40d21ec879c/users/0eb8e71de26c440eb279538da9ea6ca9/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:33:50.857037 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca89d9-7c32-4b2b-9b6a-19eb5a50d8db None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:50.857319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca89d9-7c32-4b2b-9b6a-19eb5a50d8db None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:50.857592 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca89d9-7c32-4b2b-9b6a-19eb5a50d8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:50.873957 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0f37ded0-e6f4-4208-8a47-ad50554f25c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a7d0cde6c54f51ab2c52f5aede6844'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:50.874725 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0f37ded0-e6f4-4208-8a47-ad50554f25c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a7d0cde6c54f51ab2c52f5aede6844'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:50.884072 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0f37ded0-e6f4-4208-8a47-ad50554f25c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a7d0cde6c54f51ab2c52f5aede6844'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:50.884963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0f37ded0-e6f4-4208-8a47-ad50554f25c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a7d0cde6c54f51ab2c52f5aede6844'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:50.887134 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-deca89d9-7c32-4b2b-9b6a-19eb5a50d8db None None] MFA Rules not processed for user `0eb8e71de26c440eb279538da9ea6ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:50.888376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-deca89d9-7c32-4b2b-9b6a-19eb5a50d8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:50.893111 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0f37ded0-e6f4-4208-8a47-ad50554f25c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a7d0cde6c54f51ab2c52f5aede6844'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:50.898690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:50.911329 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1103/2227] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:33:50 2022] DELETE /identity/v3/users/e3a7d0cde6c54f51ab2c52f5aede6844 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:50.916270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8a9c8-1e4d-4c65-b667-a066017c993d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:50.916553 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8a9c8-1e4d-4c65-b667-a066017c993d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:50.916825 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8a9c8-1e4d-4c65-b667-a066017c993d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:50.937089 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-24c8a9c8-1e4d-4c65-b667-a066017c993d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:50.938282 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-24c8a9c8-1e4d-4c65-b667-a066017c993d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:50.959405 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1125/2228] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:33:50.962707 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:50.970769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca89d9-7c32-4b2b-9b6a-19eb5a50d8db None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:50.972411 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-deca89d9-7c32-4b2b-9b6a-19eb5a50d8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:51.001217 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1104/2229] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:33:51.010982 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8a9c8-1e4d-4c65-b667-a066017c993d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:51.012385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-24c8a9c8-1e4d-4c65-b667-a066017c993d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:51.030987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca89d9-7c32-4b2b-9b6a-19eb5a50d8db None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:51.070139 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8a9c8-1e4d-4c65-b667-a066017c993d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:51.074582 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879981e-00f0-411c-8432-735207aab9cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:51.075219 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879981e-00f0-411c-8432-735207aab9cf service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:51.075498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879981e-00f0-411c-8432-735207aab9cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:51.075790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879981e-00f0-411c-8432-735207aab9cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:51.084494 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c198536-bebd-413a-aa9c-078323dd8d46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:51.085102 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c198536-bebd-413a-aa9c-078323dd8d46 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:51.085207 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879981e-00f0-411c-8432-735207aab9cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:51.085495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c198536-bebd-413a-aa9c-078323dd8d46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:51.085777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c198536-bebd-413a-aa9c-078323dd8d46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:51.086684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879981e-00f0-411c-8432-735207aab9cf service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:51.096527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1105/2230] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:33:51.152955 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c198536-bebd-413a-aa9c-078323dd8d46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:51.154400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c198536-bebd-413a-aa9c-078323dd8d46 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:51.164850 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1126/2231] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:33:51.383800 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879981e-00f0-411c-8432-735207aab9cf service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:51.390609 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f879981e-00f0-411c-8432-735207aab9cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:51.398826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879981e-00f0-411c-8432-735207aab9cf service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:51.403939 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:51.404584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:51.404860 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:51.405316 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad admin admin] PATH_INFO: `/v3/projects/7ef3e907f49846d6b1e545b7e7ac3209` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:51.406425 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef3e907f49846d6b1e545b7e7ac3209)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:51.410212 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:51.471018 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef3e907f49846d6b1e545b7e7ac3209', 'request_id': 'req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:51.481921 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef3e907f49846d6b1e545b7e7ac3209', 'request_id': 'req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:51.492161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef3e907f49846d6b1e545b7e7ac3209', 'request_id': 'req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:51.507144 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad admin admin] The token cache is being invalidate because project 7ef3e907f49846d6b1e545b7e7ac3209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:33:51.507444 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:51.508191 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:51.510197 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1106/2232] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:33:51 2022] DELETE /identity/v3/projects/7ef3e907f49846d6b1e545b7e7ac3209 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:51.513902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c198536-bebd-413a-aa9c-078323dd8d46 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:51.526645 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c198536-bebd-413a-aa9c-078323dd8d46 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:51.539286 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:51.606372 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b6eb6-ff86-4e7f-99b0-b60d6825cd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:51.607186 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b6eb6-ff86-4e7f-99b0-b60d6825cd39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:51.607472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b6eb6-ff86-4e7f-99b0-b60d6825cd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:51.607750 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b6eb6-ff86-4e7f-99b0-b60d6825cd39 admin admin] PATH_INFO: `/v3/users/b9373ed834424deebd11a3143cd204a8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:51.609126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b6eb6-ff86-4e7f-99b0-b60d6825cd39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9373ed834424deebd11a3143cd204a8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:51.611125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b6eb6-ff86-4e7f-99b0-b60d6825cd39 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:51.634756 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:51.636757 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:51.656548 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f604fdf-e30f-49b3-8f69-1f72d1df5dad admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:51.662871 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b3d93-9a68-425c-81c0-cc0c38a02bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:51.663603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b3d93-9a68-425c-81c0-cc0c38a02bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:51.663970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b3d93-9a68-425c-81c0-cc0c38a02bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:51.664429 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b3d93-9a68-425c-81c0-cc0c38a02bd8 admin admin] PATH_INFO: `/v3/users/c4ec8012b6a54d0ebe930b08d60eaacc` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:51.666100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b3d93-9a68-425c-81c0-cc0c38a02bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ec8012b6a54d0ebe930b08d60eaacc)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:51.667990 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b3d93-9a68-425c-81c0-cc0c38a02bd8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:51.674232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-985b6eb6-ff86-4e7f-99b0-b60d6825cd39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9373ed834424deebd11a3143cd204a8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:51.674981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-985b6eb6-ff86-4e7f-99b0-b60d6825cd39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9373ed834424deebd11a3143cd204a8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:51.682095 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-985b6eb6-ff86-4e7f-99b0-b60d6825cd39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9373ed834424deebd11a3143cd204a8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:51.682738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-985b6eb6-ff86-4e7f-99b0-b60d6825cd39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9373ed834424deebd11a3143cd204a8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:51.690473 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-985b6eb6-ff86-4e7f-99b0-b60d6825cd39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9373ed834424deebd11a3143cd204a8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:51.711428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1127/2233] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:33:51 2022] DELETE /identity/v3/users/b9373ed834424deebd11a3143cd204a8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:51.725277 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c30b3d93-9a68-425c-81c0-cc0c38a02bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ec8012b6a54d0ebe930b08d60eaacc'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:51.725986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c30b3d93-9a68-425c-81c0-cc0c38a02bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ec8012b6a54d0ebe930b08d60eaacc'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:51.728243 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:51.734983 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c30b3d93-9a68-425c-81c0-cc0c38a02bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ec8012b6a54d0ebe930b08d60eaacc'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:51.736367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c30b3d93-9a68-425c-81c0-cc0c38a02bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ec8012b6a54d0ebe930b08d60eaacc'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:51.744588 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c30b3d93-9a68-425c-81c0-cc0c38a02bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ec8012b6a54d0ebe930b08d60eaacc'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:51.767859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1107/2234] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:33:51 2022] DELETE /identity/v3/users/c4ec8012b6a54d0ebe930b08d60eaacc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:33:51.772488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c27952-6e10-4641-9ed6-88a48629ae5d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:51.772801 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c27952-6e10-4641-9ed6-88a48629ae5d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:51.773097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c27952-6e10-4641-9ed6-88a48629ae5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:51.796342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-28c27952-6e10-4641-9ed6-88a48629ae5d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:51.797732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-28c27952-6e10-4641-9ed6-88a48629ae5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:51.877087 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1128/2235] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:33:51.896338 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b3d93-9a68-425c-81c0-cc0c38a02bd8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:51.897911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c30b3d93-9a68-425c-81c0-cc0c38a02bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:51.957376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b3d93-9a68-425c-81c0-cc0c38a02bd8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:51.961113 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d35f52-edeb-43fe-97a5-b66fff9f0d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:51.961721 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d35f52-edeb-43fe-97a5-b66fff9f0d4c service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:51.962527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d35f52-edeb-43fe-97a5-b66fff9f0d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:51.962810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d35f52-edeb-43fe-97a5-b66fff9f0d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:51.972463 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d35f52-edeb-43fe-97a5-b66fff9f0d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:51.973897 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d35f52-edeb-43fe-97a5-b66fff9f0d4c service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:51.984353 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1108/2236] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:52.108928 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c27952-6e10-4641-9ed6-88a48629ae5d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:52.110499 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-28c27952-6e10-4641-9ed6-88a48629ae5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:52.122578 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c27952-6e10-4641-9ed6-88a48629ae5d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:52.131329 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5b23c-6e9a-41de-947f-fd69d9cc3f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:52.132136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5b23c-6e9a-41de-947f-fd69d9cc3f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:52.132513 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5b23c-6e9a-41de-947f-fd69d9cc3f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:52.132892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5b23c-6e9a-41de-947f-fd69d9cc3f79 admin admin] PATH_INFO: `/v3/projects/22c14dcff1554fa9bfc21e5f1c59bdef` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:52.134543 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5b23c-6e9a-41de-947f-fd69d9cc3f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c14dcff1554fa9bfc21e5f1c59bdef)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:52.136813 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5b23c-6e9a-41de-947f-fd69d9cc3f79 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:52.174076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:52.191694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f4e5b23c-6e9a-41de-947f-fd69d9cc3f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c14dcff1554fa9bfc21e5f1c59bdef', 'request_id': 'req-f4e5b23c-6e9a-41de-947f-fd69d9cc3f79'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:52.201690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f4e5b23c-6e9a-41de-947f-fd69d9cc3f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c14dcff1554fa9bfc21e5f1c59bdef', 'request_id': 'req-f4e5b23c-6e9a-41de-947f-fd69d9cc3f79'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:52.209967 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f4e5b23c-6e9a-41de-947f-fd69d9cc3f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c14dcff1554fa9bfc21e5f1c59bdef', 'request_id': 'req-f4e5b23c-6e9a-41de-947f-fd69d9cc3f79'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:52.222741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f4e5b23c-6e9a-41de-947f-fd69d9cc3f79 admin admin] The token cache is being invalidate because project 22c14dcff1554fa9bfc21e5f1c59bdef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:33:52.223156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f4e5b23c-6e9a-41de-947f-fd69d9cc3f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:52.223876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f4e5b23c-6e9a-41de-947f-fd69d9cc3f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:52.225410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1129/2237] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:33:52 2022] DELETE /identity/v3/projects/22c14dcff1554fa9bfc21e5f1c59bdef => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:52.230872 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd1c51-9a20-4243-a80a-ed6e35fa33ed None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:52.231096 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd1c51-9a20-4243-a80a-ed6e35fa33ed None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:52.231374 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd1c51-9a20-4243-a80a-ed6e35fa33ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:52.251152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d7bd1c51-9a20-4243-a80a-ed6e35fa33ed None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:52.252441 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d7bd1c51-9a20-4243-a80a-ed6e35fa33ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:52.312541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1109/2238] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:52.320697 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939a8f6-3115-4b98-8090-3fbc1e28fd86 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:52.320980 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939a8f6-3115-4b98-8090-3fbc1e28fd86 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:52.321272 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939a8f6-3115-4b98-8090-3fbc1e28fd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:52.333036 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd1c51-9a20-4243-a80a-ed6e35fa33ed None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:52.334679 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d7bd1c51-9a20-4243-a80a-ed6e35fa33ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:52.343718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0939a8f6-3115-4b98-8090-3fbc1e28fd86 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:52.344939 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0939a8f6-3115-4b98-8090-3fbc1e28fd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:52.349957 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd1c51-9a20-4243-a80a-ed6e35fa33ed None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:52.353454 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1130/2239] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:52.356766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce250538-23a4-49e0-98a6-c55081aa6a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:52.357376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939a8f6-3115-4b98-8090-3fbc1e28fd86 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:52.357796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce250538-23a4-49e0-98a6-c55081aa6a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:52.358222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce250538-23a4-49e0-98a6-c55081aa6a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:52.358538 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce250538-23a4-49e0-98a6-c55081aa6a5f admin admin] PATH_INFO: `/v3/projects/dec23fe257244c14af8fe61295bd165d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:52.359682 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce250538-23a4-49e0-98a6-c55081aa6a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec23fe257244c14af8fe61295bd165d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:52.361863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce250538-23a4-49e0-98a6-c55081aa6a5f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:52.368732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939a8f6-3115-4b98-8090-3fbc1e28fd86 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:52.373555 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fee3c-980f-4ce9-9e28-ed5572366aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:52.374226 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fee3c-980f-4ce9-9e28-ed5572366aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:52.374498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fee3c-980f-4ce9-9e28-ed5572366aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:52.374770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fee3c-980f-4ce9-9e28-ed5572366aa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:52.375417 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fee3c-980f-4ce9-9e28-ed5572366aa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:33:52.375716 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fee3c-980f-4ce9-9e28-ed5572366aa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:52.377524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fee3c-980f-4ce9-9e28-ed5572366aa8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:52.390580 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1131/2240] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:33:52.395381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fee3c-980f-4ce9-9e28-ed5572366aa8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:52.405975 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fee3c-980f-4ce9-9e28-ed5572366aa8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:52.412428 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce250538-23a4-49e0-98a6-c55081aa6a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec23fe257244c14af8fe61295bd165d', 'request_id': 'req-ce250538-23a4-49e0-98a6-c55081aa6a5f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:52.420142 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce250538-23a4-49e0-98a6-c55081aa6a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec23fe257244c14af8fe61295bd165d', 'request_id': 'req-ce250538-23a4-49e0-98a6-c55081aa6a5f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:52.426805 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce250538-23a4-49e0-98a6-c55081aa6a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec23fe257244c14af8fe61295bd165d', 'request_id': 'req-ce250538-23a4-49e0-98a6-c55081aa6a5f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:52.431221 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:52.439418 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce250538-23a4-49e0-98a6-c55081aa6a5f admin admin] The token cache is being invalidate because project dec23fe257244c14af8fe61295bd165d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:33:52.440166 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce250538-23a4-49e0-98a6-c55081aa6a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:52.441188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ce250538-23a4-49e0-98a6-c55081aa6a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:52.442934 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1110/2241] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:33:52 2022] DELETE /identity/v3/projects/dec23fe257244c14af8fe61295bd165d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:33:52.447556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce250538-23a4-49e0-98a6-c55081aa6a5f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:52.449343 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ce250538-23a4-49e0-98a6-c55081aa6a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:52.464089 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5712e-1f24-42d1-8cd6-1a01645ac665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:52.464718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5712e-1f24-42d1-8cd6-1a01645ac665 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:52.465320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5712e-1f24-42d1-8cd6-1a01645ac665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:52.465320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5712e-1f24-42d1-8cd6-1a01645ac665 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:52.466152 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5712e-1f24-42d1-8cd6-1a01645ac665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:52.468241 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5712e-1f24-42d1-8cd6-1a01645ac665 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:52.501208 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1132/2242] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:33:52 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:33:52.502305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5712e-1f24-42d1-8cd6-1a01645ac665 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:52.504387 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d9a5712e-1f24-42d1-8cd6-1a01645ac665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:52.519900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce250538-23a4-49e0-98a6-c55081aa6a5f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:52.566521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5712e-1f24-42d1-8cd6-1a01645ac665 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:52.571242 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59911f5f-ec6b-4397-8355-1e985ae26081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:52.572023 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59911f5f-ec6b-4397-8355-1e985ae26081 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:52.572310 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59911f5f-ec6b-4397-8355-1e985ae26081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:52.572589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59911f5f-ec6b-4397-8355-1e985ae26081 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:52.573321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59911f5f-ec6b-4397-8355-1e985ae26081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:52.575271 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59911f5f-ec6b-4397-8355-1e985ae26081 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:52.577232 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec03f8-3f9b-4956-bbc8-dbaa322a2ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:52.577856 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec03f8-3f9b-4956-bbc8-dbaa322a2ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:52.578130 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec03f8-3f9b-4956-bbc8-dbaa322a2ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:52.578400 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec03f8-3f9b-4956-bbc8-dbaa322a2ad8 admin admin] PATH_INFO: `/v3/users/0eb8e71de26c440eb279538da9ea6ca9` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:52.579510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec03f8-3f9b-4956-bbc8-dbaa322a2ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eb8e71de26c440eb279538da9ea6ca9)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:52.581730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec03f8-3f9b-4956-bbc8-dbaa322a2ad8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:52.615043 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1133/2243] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:33:52 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:52.616083 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59911f5f-ec6b-4397-8355-1e985ae26081 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:52.626950 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59911f5f-ec6b-4397-8355-1e985ae26081 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:52.632291 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c7f70-1e39-4cfb-865d-1b1255cdab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:52.632889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c7f70-1e39-4cfb-865d-1b1255cdab65 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:52.633174 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c7f70-1e39-4cfb-865d-1b1255cdab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:52.633449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c7f70-1e39-4cfb-865d-1b1255cdab65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:52.634161 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c7f70-1e39-4cfb-865d-1b1255cdab65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:52.635740 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c7f70-1e39-4cfb-865d-1b1255cdab65 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:52.641228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:52.641389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-01ec03f8-3f9b-4956-bbc8-dbaa322a2ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb8e71de26c440eb279538da9ea6ca9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:52.641903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-01ec03f8-3f9b-4956-bbc8-dbaa322a2ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb8e71de26c440eb279538da9ea6ca9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:52.649472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1134/2244] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:33:52.650174 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-01ec03f8-3f9b-4956-bbc8-dbaa322a2ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb8e71de26c440eb279538da9ea6ca9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:52.650856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c7f70-1e39-4cfb-865d-1b1255cdab65 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:52.651185 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-01ec03f8-3f9b-4956-bbc8-dbaa322a2ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb8e71de26c440eb279538da9ea6ca9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:52.653170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d32c7f70-1e39-4cfb-865d-1b1255cdab65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:52.658272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-01ec03f8-3f9b-4956-bbc8-dbaa322a2ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb8e71de26c440eb279538da9ea6ca9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:52.667731 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c7f70-1e39-4cfb-865d-1b1255cdab65 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:52.678526 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1111/2245] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:33:52 2022] DELETE /identity/v3/users/0eb8e71de26c440eb279538da9ea6ca9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:52.680586 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ca614-b968-473a-adb3-8ca6e848bdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:52.681365 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ca614-b968-473a-adb3-8ca6e848bdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:52.681653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ca614-b968-473a-adb3-8ca6e848bdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:52.681975 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ca614-b968-473a-adb3-8ca6e848bdb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:52.682689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ca614-b968-473a-adb3-8ca6e848bdb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:52.684772 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ca614-b968-473a-adb3-8ca6e848bdb9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:52.698894 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1135/2246] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:52.702566 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec03f8-3f9b-4956-bbc8-dbaa322a2ad8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:52.726815 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:52.789434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec03f8-3f9b-4956-bbc8-dbaa322a2ad8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:52.789978 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ca614-b968-473a-adb3-8ca6e848bdb9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:52.792715 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-763ca614-b968-473a-adb3-8ca6e848bdb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:52.795821 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e4a2f-2f1d-47b6-82f8-f00864ab4bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:52.796791 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e4a2f-2f1d-47b6-82f8-f00864ab4bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:52.797159 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e4a2f-2f1d-47b6-82f8-f00864ab4bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:52.797506 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e4a2f-2f1d-47b6-82f8-f00864ab4bc5 admin admin] PATH_INFO: `/v3/projects/e0a439e5bd2d4897b7d6dc933f86fd2b/users/f487a625f4c04acbaf6286e5ce35af4f/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:52.816221 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e4a2f-2f1d-47b6-82f8-f00864ab4bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a439e5bd2d4897b7d6dc933f86fd2b, user_id=f487a625f4c04acbaf6286e5ce35af4f, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:52.818891 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e4a2f-2f1d-47b6-82f8-f00864ab4bc5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:52.838359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1112/2247] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:52 2022] PUT /identity/v3/projects/e0a439e5bd2d4897b7d6dc933f86fd2b/users/f487a625f4c04acbaf6286e5ce35af4f/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:52.849941 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59103926-5915-45e7-91c0-2600eb36ade6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:52.850231 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59103926-5915-45e7-91c0-2600eb36ade6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:52.850647 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59103926-5915-45e7-91c0-2600eb36ade6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:52.877395 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ca614-b968-473a-adb3-8ca6e848bdb9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:52.884740 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-59103926-5915-45e7-91c0-2600eb36ade6 None None] MFA Rules not processed for user `f487a625f4c04acbaf6286e5ce35af4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:52.885963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-59103926-5915-45e7-91c0-2600eb36ade6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:52.929876 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f16d9e-4edb-4459-af07-f9b801b59f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:52.930559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f16d9e-4edb-4459-af07-f9b801b59f0d service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:52.931530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f16d9e-4edb-4459-af07-f9b801b59f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:52.931868 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f16d9e-4edb-4459-af07-f9b801b59f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:52.933809 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-98f16d9e-4edb-4459-af07-f9b801b59f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:52.962094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1113/2248] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:52.966473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59103926-5915-45e7-91c0-2600eb36ade6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:53.001694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f16d9e-4edb-4459-af07-f9b801b59f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:53.005272 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f16d9e-4edb-4459-af07-f9b801b59f0d service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:53.018162 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1136/2249] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:53.018959 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f16d9e-4edb-4459-af07-f9b801b59f0d service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:53.020604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-98f16d9e-4edb-4459-af07-f9b801b59f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:53.035596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f16d9e-4edb-4459-af07-f9b801b59f0d service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:53.041640 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6e029-693e-41ab-a756-9afe18a32498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:53.042518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6e029-693e-41ab-a756-9afe18a32498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.042871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6e029-693e-41ab-a756-9afe18a32498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.043220 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6e029-693e-41ab-a756-9afe18a32498 admin admin] PATH_INFO: `/v3/projects/62ffacf42feb4cb88b46b40d21ec879c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.044465 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6e029-693e-41ab-a756-9afe18a32498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ffacf42feb4cb88b46b40d21ec879c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:53.046492 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6e029-693e-41ab-a756-9afe18a32498 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:53.049805 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59103926-5915-45e7-91c0-2600eb36ade6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:53.054894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ebd0f-6869-429b-a325-595d39f8b02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:53.055149 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ebd0f-6869-429b-a325-595d39f8b02d admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.055432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ebd0f-6869-429b-a325-595d39f8b02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.055706 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ebd0f-6869-429b-a325-595d39f8b02d admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.056943 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ebd0f-6869-429b-a325-595d39f8b02d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:53.059432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ebd0f-6869-429b-a325-595d39f8b02d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:53.105384 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cbe6e029-693e-41ab-a756-9afe18a32498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ffacf42feb4cb88b46b40d21ec879c', 'request_id': 'req-cbe6e029-693e-41ab-a756-9afe18a32498'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:53.107253 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:53.111294 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1114/2250] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:33:52 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:53.115192 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ebd0f-6869-429b-a325-595d39f8b02d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:53.120830 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cbe6e029-693e-41ab-a756-9afe18a32498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ffacf42feb4cb88b46b40d21ec879c', 'request_id': 'req-cbe6e029-693e-41ab-a756-9afe18a32498'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:53.135995 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cbe6e029-693e-41ab-a756-9afe18a32498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ffacf42feb4cb88b46b40d21ec879c', 'request_id': 'req-cbe6e029-693e-41ab-a756-9afe18a32498'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:53.144246 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:53.147813 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cbe6e029-693e-41ab-a756-9afe18a32498 admin admin] The token cache is being invalidate because project 62ffacf42feb4cb88b46b40d21ec879c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:33:53.148136 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cbe6e029-693e-41ab-a756-9afe18a32498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:53.148912 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cbe6e029-693e-41ab-a756-9afe18a32498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:53.150947 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1137/2251] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:33:53 2022] DELETE /identity/v3/projects/62ffacf42feb4cb88b46b40d21ec879c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:53.158563 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11015e-482e-4b73-8444-ad6f396f6aff None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.158911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11015e-482e-4b73-8444-ad6f396f6aff None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.159276 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11015e-482e-4b73-8444-ad6f396f6aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.188792 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ca11015e-482e-4b73-8444-ad6f396f6aff None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:53.190324 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ca11015e-482e-4b73-8444-ad6f396f6aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:53.228912 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ebd0f-6869-429b-a325-595d39f8b02d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:53.246837 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b69373-5fc0-4978-859a-393536d1516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:53.250439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b69373-5fc0-4978-859a-393536d1516f admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.250918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b69373-5fc0-4978-859a-393536d1516f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.251356 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b69373-5fc0-4978-859a-393536d1516f admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.252303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b69373-5fc0-4978-859a-393536d1516f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:53.254675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b69373-5fc0-4978-859a-393536d1516f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:53.279831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1115/2252] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:33:53 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:53.283627 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b69373-5fc0-4978-859a-393536d1516f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:53.284724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1138/2253] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:53.291310 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-92b69373-5fc0-4978-859a-393536d1516f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:53.292760 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3630b-0762-494a-a366-c295a9005032 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.293119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3630b-0762-494a-a366-c295a9005032 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.293405 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3630b-0762-494a-a366-c295a9005032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.306190 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b69373-5fc0-4978-859a-393536d1516f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:53.311844 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218370e0-3115-4a2f-8a40-feb9baa61ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:53.312555 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218370e0-3115-4a2f-8a40-feb9baa61ead admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.313036 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218370e0-3115-4a2f-8a40-feb9baa61ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.313381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218370e0-3115-4a2f-8a40-feb9baa61ead admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.313487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-84d3630b-0762-494a-a366-c295a9005032 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:53.314156 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218370e0-3115-4a2f-8a40-feb9baa61ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:53.314616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-84d3630b-0762-494a-a366-c295a9005032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:53.315873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218370e0-3115-4a2f-8a40-feb9baa61ead admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:53.323326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1139/2254] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:53.328172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3630b-0762-494a-a366-c295a9005032 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:53.329711 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1116/2255] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:33:53.333638 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218370e0-3115-4a2f-8a40-feb9baa61ead admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:53.341277 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3630b-0762-494a-a366-c295a9005032 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:53.344635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218370e0-3115-4a2f-8a40-feb9baa61ead admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:53.346052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b98b35-17bf-44aa-b5f4-030c40d25f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:53.346709 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b98b35-17bf-44aa-b5f4-030c40d25f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.346988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b98b35-17bf-44aa-b5f4-030c40d25f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.347256 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b98b35-17bf-44aa-b5f4-030c40d25f59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.347902 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b98b35-17bf-44aa-b5f4-030c40d25f59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:33:53.348411 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b98b35-17bf-44aa-b5f4-030c40d25f59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:53.350428 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa0a4e-14a6-4306-ad4a-eb647ab0984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:53.350590 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b98b35-17bf-44aa-b5f4-030c40d25f59 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:53.350937 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa0a4e-14a6-4306-ad4a-eb647ab0984a admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.351428 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa0a4e-14a6-4306-ad4a-eb647ab0984a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.351905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa0a4e-14a6-4306-ad4a-eb647ab0984a admin admin] PATH_INFO: `/v3/projects/7ff3c17350c0486883726fde71dca12b/users/519a42a773b34cb388db88e7cf70c78a/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.362059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1140/2256] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:33:53.366138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b98b35-17bf-44aa-b5f4-030c40d25f59 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:53.376692 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa0a4e-14a6-4306-ad4a-eb647ab0984a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff3c17350c0486883726fde71dca12b, user_id=519a42a773b34cb388db88e7cf70c78a, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:53.376899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b98b35-17bf-44aa-b5f4-030c40d25f59 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:53.379882 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa0a4e-14a6-4306-ad4a-eb647ab0984a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:53.382385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce31578-192b-450c-a70d-9846ff8fa046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:53.383032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce31578-192b-450c-a70d-9846ff8fa046 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.383311 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce31578-192b-450c-a70d-9846ff8fa046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.383705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce31578-192b-450c-a70d-9846ff8fa046 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.384940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce31578-192b-450c-a70d-9846ff8fa046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:53.386842 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce31578-192b-450c-a70d-9846ff8fa046 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:53.397427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1117/2257] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:53 2022] PUT /identity/v3/projects/7ff3c17350c0486883726fde71dca12b/users/519a42a773b34cb388db88e7cf70c78a/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:33:53.402207 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa0a4e-14a6-4306-ad4a-eb647ab0984a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:53.418292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1141/2258] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:33:53 2022] POST /identity/v3/projects => generated 355 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:53.422100 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce31578-192b-450c-a70d-9846ff8fa046 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:53.470245 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa0a4e-14a6-4306-ad4a-eb647ab0984a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:53.491669 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce31578-192b-450c-a70d-9846ff8fa046 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:53.498689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e88b37-d3bb-4ddc-baf1-1f4a1aaa40d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:53.499302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e88b37-d3bb-4ddc-baf1-1f4a1aaa40d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.499578 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e88b37-d3bb-4ddc-baf1-1f4a1aaa40d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.499880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e88b37-d3bb-4ddc-baf1-1f4a1aaa40d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.500539 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e88b37-d3bb-4ddc-baf1-1f4a1aaa40d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:53.502464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e88b37-d3bb-4ddc-baf1-1f4a1aaa40d5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:53.526936 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1142/2259] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:33:53 2022] POST /identity/v3/users => generated 278 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:33:53.531114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e88b37-d3bb-4ddc-baf1-1f4a1aaa40d5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:53.538746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d97ba0-cde8-41fc-8b53-7951cb7f973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:53.539364 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d97ba0-cde8-41fc-8b53-7951cb7f973d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.539643 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d97ba0-cde8-41fc-8b53-7951cb7f973d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.539916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d97ba0-cde8-41fc-8b53-7951cb7f973d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.540642 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d97ba0-cde8-41fc-8b53-7951cb7f973d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:53.541727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e88b37-d3bb-4ddc-baf1-1f4a1aaa40d5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:53.542259 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d97ba0-cde8-41fc-8b53-7951cb7f973d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:53.547211 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda08396-2a8f-49d4-b225-0a76afc34c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:53.548458 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08396-2a8f-49d4-b225-0a76afc34c74 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.548801 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08396-2a8f-49d4-b225-0a76afc34c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.549140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08396-2a8f-49d4-b225-0a76afc34c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.549851 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda08396-2a8f-49d4-b225-0a76afc34c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:53.551564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda08396-2a8f-49d4-b225-0a76afc34c74 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:53.555150 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1118/2260] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:53.559767 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d97ba0-cde8-41fc-8b53-7951cb7f973d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:53.562522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1143/2261] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:33:53.568034 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda08396-2a8f-49d4-b225-0a76afc34c74 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:53.572338 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d97ba0-cde8-41fc-8b53-7951cb7f973d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:53.577990 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cc0a7-b0a7-4ccc-8c48-4ab583c4ba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:53.578834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda08396-2a8f-49d4-b225-0a76afc34c74 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:53.579108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cc0a7-b0a7-4ccc-8c48-4ab583c4ba4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.579642 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cc0a7-b0a7-4ccc-8c48-4ab583c4ba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.580110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cc0a7-b0a7-4ccc-8c48-4ab583c4ba4a admin admin] PATH_INFO: `/v3/projects/7ff3c17350c0486883726fde71dca12b/users/519a42a773b34cb388db88e7cf70c78a/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.582585 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cc0a7-b0a7-4ccc-8c48-4ab583c4ba4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff3c17350c0486883726fde71dca12b, user_id=519a42a773b34cb388db88e7cf70c78a, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:53.583593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3639fb4-bc3e-4cc7-8344-12a7f7039d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:53.584205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3639fb4-bc3e-4cc7-8344-12a7f7039d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.584515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3639fb4-bc3e-4cc7-8344-12a7f7039d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.584784 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3639fb4-bc3e-4cc7-8344-12a7f7039d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.585422 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3639fb4-bc3e-4cc7-8344-12a7f7039d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:53.586862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cc0a7-b0a7-4ccc-8c48-4ab583c4ba4a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:53.587586 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3639fb4-bc3e-4cc7-8344-12a7f7039d62 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:53.598254 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1144/2262] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:53.601931 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1119/2263] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:53 2022] PUT /identity/v3/projects/7ff3c17350c0486883726fde71dca12b/users/519a42a773b34cb388db88e7cf70c78a/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:33:53.602661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3639fb4-bc3e-4cc7-8344-12a7f7039d62 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:53.610315 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:53.612395 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84929ba2-20e5-4718-8bba-9a4f898f1128 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.612679 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84929ba2-20e5-4718-8bba-9a4f898f1128 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.612952 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84929ba2-20e5-4718-8bba-9a4f898f1128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.620395 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3639fb4-bc3e-4cc7-8344-12a7f7039d62 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:53.625138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:53.650632 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-84929ba2-20e5-4718-8bba-9a4f898f1128 None None] MFA Rules not processed for user `519a42a773b34cb388db88e7cf70c78a`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:53.651850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-84929ba2-20e5-4718-8bba-9a4f898f1128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:53.680694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b8c35-1365-4735-8464-64db0db47473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:53.681988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b8c35-1365-4735-8464-64db0db47473 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.682330 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b8c35-1365-4735-8464-64db0db47473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.682668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b8c35-1365-4735-8464-64db0db47473 admin admin] PATH_INFO: `/v3/projects/840142de5b7e435d9cb813d6802e6dc4/users/a6bc5677a71f4dfa97f6885b1cea29ee/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.698458 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b8c35-1365-4735-8464-64db0db47473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=840142de5b7e435d9cb813d6802e6dc4, user_id=a6bc5677a71f4dfa97f6885b1cea29ee, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:53.701402 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b8c35-1365-4735-8464-64db0db47473 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:53.716273 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1145/2264] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:53 2022] PUT /identity/v3/projects/840142de5b7e435d9cb813d6802e6dc4/users/a6bc5677a71f4dfa97f6885b1cea29ee/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:53.727514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406202eb-da2c-4f15-9604-99c60ec44077 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.727832 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406202eb-da2c-4f15-9604-99c60ec44077 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.728738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406202eb-da2c-4f15-9604-99c60ec44077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.732844 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1120/2265] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:33:53.745229 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84929ba2-20e5-4718-8bba-9a4f898f1128 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:53.746684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-84929ba2-20e5-4718-8bba-9a4f898f1128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:53.764469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-406202eb-da2c-4f15-9604-99c60ec44077 None None] MFA Rules not processed for user `a6bc5677a71f4dfa97f6885b1cea29ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:53.765807 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-406202eb-da2c-4f15-9604-99c60ec44077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:53.819200 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84929ba2-20e5-4718-8bba-9a4f898f1128 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:53.842140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1146/2266] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:33:53.846513 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406202eb-da2c-4f15-9604-99c60ec44077 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:53.883673 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985978d9-1865-4b93-ab91-b5fd36837453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:53.884350 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985978d9-1865-4b93-ab91-b5fd36837453 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.884630 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985978d9-1865-4b93-ab91-b5fd36837453 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.884904 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985978d9-1865-4b93-ab91-b5fd36837453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.887824 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-985978d9-1865-4b93-ab91-b5fd36837453 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:53.916451 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406202eb-da2c-4f15-9604-99c60ec44077 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:53.922789 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412dc57-c848-4660-8077-1a69b8b566a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:53.923410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412dc57-c848-4660-8077-1a69b8b566a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:53.923740 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412dc57-c848-4660-8077-1a69b8b566a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:53.924261 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412dc57-c848-4660-8077-1a69b8b566a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:53.924900 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412dc57-c848-4660-8077-1a69b8b566a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:53.927010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412dc57-c848-4660-8077-1a69b8b566a8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:53.959817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985978d9-1865-4b93-ab91-b5fd36837453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:53.960606 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1147/2267] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:33:53 2022] POST /identity/v3/projects => generated 355 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:33:53.961571 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985978d9-1865-4b93-ab91-b5fd36837453 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:53.964739 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412dc57-c848-4660-8077-1a69b8b566a8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:53.965521 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:53.972296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:53.974866 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1121/2268] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:33:54.059154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412dc57-c848-4660-8077-1a69b8b566a8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:54.073633 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18c87b-f3c9-4377-9203-5db935db46c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:54.074180 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18c87b-f3c9-4377-9203-5db935db46c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:54.074459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18c87b-f3c9-4377-9203-5db935db46c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:54.074729 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18c87b-f3c9-4377-9203-5db935db46c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:54.075429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18c87b-f3c9-4377-9203-5db935db46c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:54.079184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18c87b-f3c9-4377-9203-5db935db46c9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:54.106610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1148/2269] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:33:53 2022] POST /identity/v3/users => generated 284 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:54.110706 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985978d9-1865-4b93-ab91-b5fd36837453 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:54.124731 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985978d9-1865-4b93-ab91-b5fd36837453 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:54.130434 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2f8a8-285c-4351-8454-a7ff6b7efa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:54.131055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2f8a8-285c-4351-8454-a7ff6b7efa23 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:54.131773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2f8a8-285c-4351-8454-a7ff6b7efa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:54.132086 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2f8a8-285c-4351-8454-a7ff6b7efa23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:54.132751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2f8a8-285c-4351-8454-a7ff6b7efa23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:54.136247 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2f8a8-285c-4351-8454-a7ff6b7efa23 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:54.150608 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1122/2270] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:54.156899 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18c87b-f3c9-4377-9203-5db935db46c9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:54.169792 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18c87b-f3c9-4377-9203-5db935db46c9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:54.175262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb91ad-c4e6-4346-ade5-5ef561842387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:54.176092 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb91ad-c4e6-4346-ade5-5ef561842387 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:54.176494 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb91ad-c4e6-4346-ade5-5ef561842387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:54.176868 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb91ad-c4e6-4346-ade5-5ef561842387 admin admin] PATH_INFO: `/v3/projects/8315918c70864433a9d2b614ada75edd/users/ba6b09b03ff145efb8b3de62076e2e33/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:54.197596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb91ad-c4e6-4346-ade5-5ef561842387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8315918c70864433a9d2b614ada75edd, user_id=ba6b09b03ff145efb8b3de62076e2e33, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:54.201326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb91ad-c4e6-4346-ade5-5ef561842387 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:54.220156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1149/2271] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:54 2022] PUT /identity/v3/projects/8315918c70864433a9d2b614ada75edd/users/ba6b09b03ff145efb8b3de62076e2e33/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:54.224392 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2f8a8-285c-4351-8454-a7ff6b7efa23 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:54.239731 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2f8a8-285c-4351-8454-a7ff6b7efa23 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:54.323409 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d29eaf-c585-4f21-8247-1464c48b1ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:54.324190 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d29eaf-c585-4f21-8247-1464c48b1ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:54.324483 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d29eaf-c585-4f21-8247-1464c48b1ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:54.324822 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d29eaf-c585-4f21-8247-1464c48b1ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:54.325528 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d29eaf-c585-4f21-8247-1464c48b1ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:54.327213 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d29eaf-c585-4f21-8247-1464c48b1ba6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:54.340630 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1123/2272] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:54.345052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb91ad-c4e6-4346-ade5-5ef561842387 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:54.358820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb91ad-c4e6-4346-ade5-5ef561842387 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:54.363887 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b88cf-e5fe-4acd-9ba6-e269960cceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:54.364635 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b88cf-e5fe-4acd-9ba6-e269960cceae admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:54.364913 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b88cf-e5fe-4acd-9ba6-e269960cceae admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:54.365187 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b88cf-e5fe-4acd-9ba6-e269960cceae admin admin] PATH_INFO: `/v3/projects/8315918c70864433a9d2b614ada75edd/users/ba6b09b03ff145efb8b3de62076e2e33/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:54.367413 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b88cf-e5fe-4acd-9ba6-e269960cceae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8315918c70864433a9d2b614ada75edd, user_id=ba6b09b03ff145efb8b3de62076e2e33, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:54.371767 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b88cf-e5fe-4acd-9ba6-e269960cceae admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:54.393726 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1150/2273] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:54 2022] PUT /identity/v3/projects/8315918c70864433a9d2b614ada75edd/users/ba6b09b03ff145efb8b3de62076e2e33/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:33:54.395612 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545dc4d-2ba1-445b-b784-a11911e39a29 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:54.395910 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545dc4d-2ba1-445b-b784-a11911e39a29 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:54.396208 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545dc4d-2ba1-445b-b784-a11911e39a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:54.432866 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a545dc4d-2ba1-445b-b784-a11911e39a29 None None] MFA Rules not processed for user `ba6b09b03ff145efb8b3de62076e2e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:54.432866 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a545dc4d-2ba1-445b-b784-a11911e39a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:54.514041 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1124/2274] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:54.535238 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b88cf-e5fe-4acd-9ba6-e269960cceae admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:54.622847 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b88cf-e5fe-4acd-9ba6-e269960cceae admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:54.626960 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e8f31-3191-4f0e-8042-b899daa175de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:54.627764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e8f31-3191-4f0e-8042-b899daa175de service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:54.628135 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e8f31-3191-4f0e-8042-b899daa175de service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:54.628739 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e8f31-3191-4f0e-8042-b899daa175de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:54.640841 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e8f31-3191-4f0e-8042-b899daa175de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:54.642329 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e8f31-3191-4f0e-8042-b899daa175de service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:54.652807 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1151/2275] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:54.755535 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545dc4d-2ba1-445b-b784-a11911e39a29 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:54.767803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545dc4d-2ba1-445b-b784-a11911e39a29 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:54.777355 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d239b-e35d-4e1e-91b6-3b708b77669c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:54.778450 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d239b-e35d-4e1e-91b6-3b708b77669c service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:54.779188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d239b-e35d-4e1e-91b6-3b708b77669c service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:54.779558 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d239b-e35d-4e1e-91b6-3b708b77669c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:54.864650 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d239b-e35d-4e1e-91b6-3b708b77669c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:54.866838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d239b-e35d-4e1e-91b6-3b708b77669c service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:54.879210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1125/2276] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:56.781741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e8f31-3191-4f0e-8042-b899daa175de service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:56.783438 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fb6e8f31-3191-4f0e-8042-b899daa175de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:56.809546 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e8f31-3191-4f0e-8042-b899daa175de service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:56.816713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c66a11-7663-4336-80b2-68a678fddbbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:56.817462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c66a11-7663-4336-80b2-68a678fddbbf service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:56.817799 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c66a11-7663-4336-80b2-68a678fddbbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:56.818296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c66a11-7663-4336-80b2-68a678fddbbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:56.896693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:56.919210 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c66a11-7663-4336-80b2-68a678fddbbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:56.920131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c66a11-7663-4336-80b2-68a678fddbbf service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:56.929571 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d239b-e35d-4e1e-91b6-3b708b77669c service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:56.936518 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9a7d239b-e35d-4e1e-91b6-3b708b77669c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:56.945655 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1152/2277] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:56.965251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:57.035554 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d239b-e35d-4e1e-91b6-3b708b77669c service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:57.047701 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f913e5-dadd-407d-8aad-f5329ff674f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:57.048469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f913e5-dadd-407d-8aad-f5329ff674f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:57.048943 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f913e5-dadd-407d-8aad-f5329ff674f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:57.049663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f913e5-dadd-407d-8aad-f5329ff674f4 admin admin] PATH_INFO: `/v3/users/9bc07aa85f5643cfb89280a136496619` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:57.051062 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f913e5-dadd-407d-8aad-f5329ff674f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bc07aa85f5643cfb89280a136496619)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:57.053514 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f913e5-dadd-407d-8aad-f5329ff674f4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:57.125128 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c0f913e5-dadd-407d-8aad-f5329ff674f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bc07aa85f5643cfb89280a136496619'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:57.125791 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c0f913e5-dadd-407d-8aad-f5329ff674f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bc07aa85f5643cfb89280a136496619'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:57.134275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c0f913e5-dadd-407d-8aad-f5329ff674f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bc07aa85f5643cfb89280a136496619'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:57.134948 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c0f913e5-dadd-407d-8aad-f5329ff674f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bc07aa85f5643cfb89280a136496619'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:57.144316 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c0f913e5-dadd-407d-8aad-f5329ff674f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bc07aa85f5643cfb89280a136496619'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:57.164920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1126/2278] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:33:56 2022] DELETE /identity/v3/users/9bc07aa85f5643cfb89280a136496619 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:57.352481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c66a11-7663-4336-80b2-68a678fddbbf service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:57.364503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c66a11-7663-4336-80b2-68a678fddbbf service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:57.421586 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ac4b0-1622-4b52-8812-ae8d6aa7062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:57.422228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ac4b0-1622-4b52-8812-ae8d6aa7062a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:57.422508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ac4b0-1622-4b52-8812-ae8d6aa7062a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:57.422779 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ac4b0-1622-4b52-8812-ae8d6aa7062a admin admin] PATH_INFO: `/v3/projects/eae04fd7301f41ed9d09665f8366752f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:57.423911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ac4b0-1622-4b52-8812-ae8d6aa7062a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eae04fd7301f41ed9d09665f8366752f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:57.425911 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ac4b0-1622-4b52-8812-ae8d6aa7062a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:57.473453 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d0ac4b0-1622-4b52-8812-ae8d6aa7062a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eae04fd7301f41ed9d09665f8366752f', 'request_id': 'req-2d0ac4b0-1622-4b52-8812-ae8d6aa7062a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:57.482679 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d0ac4b0-1622-4b52-8812-ae8d6aa7062a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eae04fd7301f41ed9d09665f8366752f', 'request_id': 'req-2d0ac4b0-1622-4b52-8812-ae8d6aa7062a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:57.489230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d0ac4b0-1622-4b52-8812-ae8d6aa7062a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eae04fd7301f41ed9d09665f8366752f', 'request_id': 'req-2d0ac4b0-1622-4b52-8812-ae8d6aa7062a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:57.499975 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d0ac4b0-1622-4b52-8812-ae8d6aa7062a admin admin] The token cache is being invalidate because project eae04fd7301f41ed9d09665f8366752f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:33:57.500385 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d0ac4b0-1622-4b52-8812-ae8d6aa7062a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:57.501127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d0ac4b0-1622-4b52-8812-ae8d6aa7062a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:33:57.502701 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1153/2279] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:33:57 2022] DELETE /identity/v3/projects/eae04fd7301f41ed9d09665f8366752f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:57.508169 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2de93-5332-4153-b6a1-99cec38c561a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:57.508452 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2de93-5332-4153-b6a1-99cec38c561a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:57.508727 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2de93-5332-4153-b6a1-99cec38c561a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:57.530014 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-52f2de93-5332-4153-b6a1-99cec38c561a None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:57.531219 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-52f2de93-5332-4153-b6a1-99cec38c561a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:57.598886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1127/2280] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:57.607822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d76a8a-50f5-4e3a-a272-d2408febdb49 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:57.608145 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d76a8a-50f5-4e3a-a272-d2408febdb49 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:57.608417 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d76a8a-50f5-4e3a-a272-d2408febdb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:57.629104 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-61d76a8a-50f5-4e3a-a272-d2408febdb49 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:57.630304 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-61d76a8a-50f5-4e3a-a272-d2408febdb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:57.645853 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1154/2281] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:57.651229 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2de93-5332-4153-b6a1-99cec38c561a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:57.662614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2de93-5332-4153-b6a1-99cec38c561a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:57.667670 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc16e5b-cb73-4222-aa9f-fe5f16fd115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:57.668500 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc16e5b-cb73-4222-aa9f-fe5f16fd115a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:57.668783 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc16e5b-cb73-4222-aa9f-fe5f16fd115a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:57.669055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc16e5b-cb73-4222-aa9f-fe5f16fd115a admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:57.669832 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc16e5b-cb73-4222-aa9f-fe5f16fd115a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:33:57.670180 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc16e5b-cb73-4222-aa9f-fe5f16fd115a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:57.672284 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc16e5b-cb73-4222-aa9f-fe5f16fd115a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:57.687972 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1128/2282] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:33:57.690191 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d76a8a-50f5-4e3a-a272-d2408febdb49 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:57.701971 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d76a8a-50f5-4e3a-a272-d2408febdb49 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:57.707728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfc6c7-b6dc-40e2-b30d-b91d5d2703dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:57.708419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfc6c7-b6dc-40e2-b30d-b91d5d2703dd admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:57.708771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfc6c7-b6dc-40e2-b30d-b91d5d2703dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:57.708983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfc6c7-b6dc-40e2-b30d-b91d5d2703dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:57.709793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfc6c7-b6dc-40e2-b30d-b91d5d2703dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:57.712665 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfc6c7-b6dc-40e2-b30d-b91d5d2703dd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:57.759957 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1155/2283] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:33:57 2022] POST /identity/v3/projects => generated 403 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:57.763835 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc16e5b-cb73-4222-aa9f-fe5f16fd115a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:57.777857 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc16e5b-cb73-4222-aa9f-fe5f16fd115a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:57.789477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:57.844405 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bd03f-5250-409b-b905-438e08bf9f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:57.845014 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bd03f-5250-409b-b905-438e08bf9f05 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:57.845293 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bd03f-5250-409b-b905-438e08bf9f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:57.845566 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bd03f-5250-409b-b905-438e08bf9f05 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:57.846201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bd03f-5250-409b-b905-438e08bf9f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:57.848129 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bd03f-5250-409b-b905-438e08bf9f05 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:57.869681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1129/2284] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:33:57 2022] POST /identity/v3/users => generated 302 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:57.873562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfc6c7-b6dc-40e2-b30d-b91d5d2703dd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:57.885319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfc6c7-b6dc-40e2-b30d-b91d5d2703dd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:57.890231 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a9cf7-1935-4a7f-ba0a-227658124b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:57.890828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a9cf7-1935-4a7f-ba0a-227658124b33 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:57.891105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a9cf7-1935-4a7f-ba0a-227658124b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:57.891377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a9cf7-1935-4a7f-ba0a-227658124b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:57.892049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a9cf7-1935-4a7f-ba0a-227658124b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:57.893653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a9cf7-1935-4a7f-ba0a-227658124b33 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:57.903642 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1156/2285] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:57.907444 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bd03f-5250-409b-b905-438e08bf9f05 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:57.917430 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bd03f-5250-409b-b905-438e08bf9f05 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:57.921988 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665c8f0-dd63-49aa-a2d3-4e35520d74ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:57.922570 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665c8f0-dd63-49aa-a2d3-4e35520d74ac admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:57.922842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665c8f0-dd63-49aa-a2d3-4e35520d74ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:57.923110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665c8f0-dd63-49aa-a2d3-4e35520d74ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:57.923742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665c8f0-dd63-49aa-a2d3-4e35520d74ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:57.925366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665c8f0-dd63-49aa-a2d3-4e35520d74ac admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:57.937453 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1130/2286] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:57.941654 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a9cf7-1935-4a7f-ba0a-227658124b33 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:57.952138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a9cf7-1935-4a7f-ba0a-227658124b33 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:57.956981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927769c-7d58-45af-851d-05d4327fc1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:57.957623 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927769c-7d58-45af-851d-05d4327fc1de admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:57.957906 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927769c-7d58-45af-851d-05d4327fc1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:57.958183 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927769c-7d58-45af-851d-05d4327fc1de admin admin] PATH_INFO: `/v3/projects/fa30bc1a24094fd0b6d8dae22782c013/users/b7842da174344a08b0dbe8754449eb88/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:57.972507 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927769c-7d58-45af-851d-05d4327fc1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa30bc1a24094fd0b6d8dae22782c013, user_id=b7842da174344a08b0dbe8754449eb88, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:57.975210 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927769c-7d58-45af-851d-05d4327fc1de admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:57.988340 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1157/2287] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:57 2022] PUT /identity/v3/projects/fa30bc1a24094fd0b6d8dae22782c013/users/b7842da174344a08b0dbe8754449eb88/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:57.993853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eef1b3-05f3-4703-a327-defb1710beab None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:57.994140 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eef1b3-05f3-4703-a327-defb1710beab None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:57.994412 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eef1b3-05f3-4703-a327-defb1710beab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:58.014044 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-77eef1b3-05f3-4703-a327-defb1710beab None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:58.015166 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-77eef1b3-05f3-4703-a327-defb1710beab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:58.078305 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1131/2288] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:33:58.088251 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927769c-7d58-45af-851d-05d4327fc1de admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:58.089938 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0927769c-7d58-45af-851d-05d4327fc1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:58.109880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:58.149121 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927769c-7d58-45af-851d-05d4327fc1de admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:58.153383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf72f8-d0d7-474e-9239-28db6b4ea352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:58.153990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf72f8-d0d7-474e-9239-28db6b4ea352 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:58.154269 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf72f8-d0d7-474e-9239-28db6b4ea352 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:58.154536 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf72f8-d0d7-474e-9239-28db6b4ea352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:58.163915 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf72f8-d0d7-474e-9239-28db6b4ea352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:58.165245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf72f8-d0d7-474e-9239-28db6b4ea352 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:58.175916 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1158/2289] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:33:58.805556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937bb06-cf64-41e2-add6-7bdf3a9cd3b7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:58.805843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937bb06-cf64-41e2-add6-7bdf3a9cd3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:58.806112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937bb06-cf64-41e2-add6-7bdf3a9cd3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:58.839017 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e937bb06-cf64-41e2-add6-7bdf3a9cd3b7 None None] MFA Rules not processed for user `b7842da174344a08b0dbe8754449eb88`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:33:58.841633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e937bb06-cf64-41e2-add6-7bdf3a9cd3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:33:58.929270 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1132/2290] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:33:58 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:33:58.930515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf72f8-d0d7-474e-9239-28db6b4ea352 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:58.942215 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf72f8-d0d7-474e-9239-28db6b4ea352 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:58.955459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897725e-89ab-4665-a143-a91aca98435e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:58.956143 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897725e-89ab-4665-a143-a91aca98435e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:58.956425 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897725e-89ab-4665-a143-a91aca98435e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:58.956695 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897725e-89ab-4665-a143-a91aca98435e admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:58.957541 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897725e-89ab-4665-a143-a91aca98435e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:58.959648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897725e-89ab-4665-a143-a91aca98435e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:59.003440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1159/2291] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:33:58 2022] POST /identity/v3/projects => generated 405 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:33:59.007835 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937bb06-cf64-41e2-add6-7bdf3a9cd3b7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:59.020131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937bb06-cf64-41e2-add6-7bdf3a9cd3b7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:59.045360 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:59.091275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5377c3d-3813-4363-90a0-22928a143d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:59.091886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5377c3d-3813-4363-90a0-22928a143d5b admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:59.092197 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5377c3d-3813-4363-90a0-22928a143d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:59.092472 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5377c3d-3813-4363-90a0-22928a143d5b admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:59.093176 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5377c3d-3813-4363-90a0-22928a143d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:59.095110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5377c3d-3813-4363-90a0-22928a143d5b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:59.116728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1133/2292] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:33:59 2022] POST /identity/v3/users => generated 309 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:33:59.120874 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897725e-89ab-4665-a143-a91aca98435e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:59.132561 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897725e-89ab-4665-a143-a91aca98435e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:59.138493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acb252-c99e-4632-954f-8198945a771d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:59.139080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acb252-c99e-4632-954f-8198945a771d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:59.139359 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acb252-c99e-4632-954f-8198945a771d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:59.139822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acb252-c99e-4632-954f-8198945a771d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:59.140371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23acb252-c99e-4632-954f-8198945a771d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:59.141962 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23acb252-c99e-4632-954f-8198945a771d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:59.154550 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1160/2293] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:59.158978 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5377c3d-3813-4363-90a0-22928a143d5b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:59.169052 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5377c3d-3813-4363-90a0-22928a143d5b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:59.173720 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542f668-3ef7-49e5-81bb-6727d1e69375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:59.174394 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542f668-3ef7-49e5-81bb-6727d1e69375 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:59.174672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542f668-3ef7-49e5-81bb-6727d1e69375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:59.174945 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542f668-3ef7-49e5-81bb-6727d1e69375 admin admin] PATH_INFO: `/v3/projects/5a5fdbd0e9bc4caea9061f1014928d1f/users/f9daae2efaf44d5ebbbaef35dae0d81a/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:59.189953 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542f668-3ef7-49e5-81bb-6727d1e69375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5fdbd0e9bc4caea9061f1014928d1f, user_id=f9daae2efaf44d5ebbbaef35dae0d81a, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:59.192702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542f668-3ef7-49e5-81bb-6727d1e69375 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:59.206633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1134/2294] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:59 2022] PUT /identity/v3/projects/5a5fdbd0e9bc4caea9061f1014928d1f/users/f9daae2efaf44d5ebbbaef35dae0d81a/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:33:59.210617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acb252-c99e-4632-954f-8198945a771d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:59.221349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acb252-c99e-4632-954f-8198945a771d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:59.278829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc9580-7231-44a4-ad2c-ce9a90060d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:59.279442 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc9580-7231-44a4-ad2c-ce9a90060d08 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:59.279799 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc9580-7231-44a4-ad2c-ce9a90060d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:59.280006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc9580-7231-44a4-ad2c-ce9a90060d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:59.280684 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc9580-7231-44a4-ad2c-ce9a90060d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:59.282271 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc9580-7231-44a4-ad2c-ce9a90060d08 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:59.292268 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1161/2295] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:33:59.296589 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542f668-3ef7-49e5-81bb-6727d1e69375 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:33:59.306968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542f668-3ef7-49e5-81bb-6727d1e69375 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:33:59.311672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ff3b7-1b72-4327-8f8a-4fc9eaec1f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:33:59.312337 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ff3b7-1b72-4327-8f8a-4fc9eaec1f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:33:59.312615 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ff3b7-1b72-4327-8f8a-4fc9eaec1f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:33:59.312894 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ff3b7-1b72-4327-8f8a-4fc9eaec1f5b admin admin] PATH_INFO: `/v3/projects/5a5fdbd0e9bc4caea9061f1014928d1f/users/f9daae2efaf44d5ebbbaef35dae0d81a/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:33:59.314804 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ff3b7-1b72-4327-8f8a-4fc9eaec1f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5fdbd0e9bc4caea9061f1014928d1f, user_id=f9daae2efaf44d5ebbbaef35dae0d81a, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:33:59.317504 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ff3b7-1b72-4327-8f8a-4fc9eaec1f5b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:33:59.328211 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1135/2296] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:33:59 2022] PUT /identity/v3/projects/5a5fdbd0e9bc4caea9061f1014928d1f/users/f9daae2efaf44d5ebbbaef35dae0d81a/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:00.027990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e21f-d066-482f-8394-3e4a774c1198 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:00.028542 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e21f-d066-482f-8394-3e4a774c1198 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:00.028641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e21f-d066-482f-8394-3e4a774c1198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:00.061313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2ae4e21f-d066-482f-8394-3e4a774c1198 None None] MFA Rules not processed for user `f9daae2efaf44d5ebbbaef35dae0d81a`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:00.061313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2ae4e21f-d066-482f-8394-3e4a774c1198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:00.135098 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1162/2297] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:00 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:00.666965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582393b7-a10c-4809-9420-aa025f1dc9b1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:00.667489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582393b7-a10c-4809-9420-aa025f1dc9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:00.667489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582393b7-a10c-4809-9420-aa025f1dc9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:00.687758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-582393b7-a10c-4809-9420-aa025f1dc9b1 None None] MFA Rules not processed for user `70a604c53c5947f1ba4bff590a18eb59`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:00.689030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-582393b7-a10c-4809-9420-aa025f1dc9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:00.747711 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1136/2298] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:01.291403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4e21f-d066-482f-8394-3e4a774c1198 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:01.301602 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:01.361285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4e21f-d066-482f-8394-3e4a774c1198 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:01.373013 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf605a-db1d-4b1e-959f-d48f1297ce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:01.373682 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf605a-db1d-4b1e-959f-d48f1297ce79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:01.373960 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf605a-db1d-4b1e-959f-d48f1297ce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:01.374239 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf605a-db1d-4b1e-959f-d48f1297ce79 admin admin] PATH_INFO: `/v3/users/b7842da174344a08b0dbe8754449eb88` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:01.375427 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf605a-db1d-4b1e-959f-d48f1297ce79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7842da174344a08b0dbe8754449eb88)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:01.377386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf605a-db1d-4b1e-959f-d48f1297ce79 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:01.440128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-94cf605a-db1d-4b1e-959f-d48f1297ce79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7842da174344a08b0dbe8754449eb88'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:01.440128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-94cf605a-db1d-4b1e-959f-d48f1297ce79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7842da174344a08b0dbe8754449eb88'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:01.441125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-94cf605a-db1d-4b1e-959f-d48f1297ce79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7842da174344a08b0dbe8754449eb88'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:01.441788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-94cf605a-db1d-4b1e-959f-d48f1297ce79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7842da174344a08b0dbe8754449eb88'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:01.450671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-94cf605a-db1d-4b1e-959f-d48f1297ce79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7842da174344a08b0dbe8754449eb88'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:01.471068 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1163/2299] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:01 2022] DELETE /identity/v3/users/b7842da174344a08b0dbe8754449eb88 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:01.912827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582393b7-a10c-4809-9420-aa025f1dc9b1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:01.933563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582393b7-a10c-4809-9420-aa025f1dc9b1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:02.001168 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324264a-25d7-48e4-bae0-d9f11a36e7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:02.001822 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324264a-25d7-48e4-bae0-d9f11a36e7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:02.002101 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324264a-25d7-48e4-bae0-d9f11a36e7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:02.002373 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324264a-25d7-48e4-bae0-d9f11a36e7aa admin admin] PATH_INFO: `/v3/projects/fa30bc1a24094fd0b6d8dae22782c013` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:02.003509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324264a-25d7-48e4-bae0-d9f11a36e7aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa30bc1a24094fd0b6d8dae22782c013)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:02.005720 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324264a-25d7-48e4-bae0-d9f11a36e7aa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:02.033510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:02.068981 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8324264a-25d7-48e4-bae0-d9f11a36e7aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa30bc1a24094fd0b6d8dae22782c013', 'request_id': 'req-8324264a-25d7-48e4-bae0-d9f11a36e7aa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:02.083194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8324264a-25d7-48e4-bae0-d9f11a36e7aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa30bc1a24094fd0b6d8dae22782c013', 'request_id': 'req-8324264a-25d7-48e4-bae0-d9f11a36e7aa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:02.100128 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8324264a-25d7-48e4-bae0-d9f11a36e7aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa30bc1a24094fd0b6d8dae22782c013', 'request_id': 'req-8324264a-25d7-48e4-bae0-d9f11a36e7aa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:02.120265 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8324264a-25d7-48e4-bae0-d9f11a36e7aa admin admin] The token cache is being invalidate because project fa30bc1a24094fd0b6d8dae22782c013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:02.120759 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8324264a-25d7-48e4-bae0-d9f11a36e7aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:02.121664 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8324264a-25d7-48e4-bae0-d9f11a36e7aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:02.126743 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1137/2300] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:01 2022] DELETE /identity/v3/projects/fa30bc1a24094fd0b6d8dae22782c013 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:02.128086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf605a-db1d-4b1e-959f-d48f1297ce79 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:02.130146 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-94cf605a-db1d-4b1e-959f-d48f1297ce79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:02.148304 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf605a-db1d-4b1e-959f-d48f1297ce79 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:02.213268 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5912ed-6b64-4de6-a223-0bc42e3da540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:02.213905 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5912ed-6b64-4de6-a223-0bc42e3da540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:02.214184 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5912ed-6b64-4de6-a223-0bc42e3da540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:02.214487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5912ed-6b64-4de6-a223-0bc42e3da540 admin admin] PATH_INFO: `/v3/users/f9daae2efaf44d5ebbbaef35dae0d81a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:02.215623 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5912ed-6b64-4de6-a223-0bc42e3da540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9daae2efaf44d5ebbbaef35dae0d81a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:02.217617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5912ed-6b64-4de6-a223-0bc42e3da540 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:02.252509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:02.269196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4f5912ed-6b64-4de6-a223-0bc42e3da540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9daae2efaf44d5ebbbaef35dae0d81a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:02.269877 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4f5912ed-6b64-4de6-a223-0bc42e3da540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9daae2efaf44d5ebbbaef35dae0d81a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:02.277415 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4f5912ed-6b64-4de6-a223-0bc42e3da540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9daae2efaf44d5ebbbaef35dae0d81a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:02.278056 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4f5912ed-6b64-4de6-a223-0bc42e3da540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9daae2efaf44d5ebbbaef35dae0d81a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:02.286629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4f5912ed-6b64-4de6-a223-0bc42e3da540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9daae2efaf44d5ebbbaef35dae0d81a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:02.304092 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1164/2301] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:02 2022] DELETE /identity/v3/users/f9daae2efaf44d5ebbbaef35dae0d81a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:02.544359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324264a-25d7-48e4-bae0-d9f11a36e7aa admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:02.552833 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8324264a-25d7-48e4-bae0-d9f11a36e7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:02.578614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324264a-25d7-48e4-bae0-d9f11a36e7aa admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:02.645992 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c5423-c2db-4748-b60b-2cd00c785d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:02.646628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c5423-c2db-4748-b60b-2cd00c785d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:02.646910 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c5423-c2db-4748-b60b-2cd00c785d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:02.647189 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c5423-c2db-4748-b60b-2cd00c785d09 admin admin] PATH_INFO: `/v3/projects/5a5fdbd0e9bc4caea9061f1014928d1f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:02.648369 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c5423-c2db-4748-b60b-2cd00c785d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a5fdbd0e9bc4caea9061f1014928d1f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:02.651165 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c5423-c2db-4748-b60b-2cd00c785d09 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:02.702674 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-531c5423-c2db-4748-b60b-2cd00c785d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a5fdbd0e9bc4caea9061f1014928d1f', 'request_id': 'req-531c5423-c2db-4748-b60b-2cd00c785d09'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:02.710368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-531c5423-c2db-4748-b60b-2cd00c785d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a5fdbd0e9bc4caea9061f1014928d1f', 'request_id': 'req-531c5423-c2db-4748-b60b-2cd00c785d09'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:02.718093 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-531c5423-c2db-4748-b60b-2cd00c785d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a5fdbd0e9bc4caea9061f1014928d1f', 'request_id': 'req-531c5423-c2db-4748-b60b-2cd00c785d09'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:02.729621 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-531c5423-c2db-4748-b60b-2cd00c785d09 admin admin] The token cache is being invalidate because project 5a5fdbd0e9bc4caea9061f1014928d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:02.730327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-531c5423-c2db-4748-b60b-2cd00c785d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:02.730689 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-531c5423-c2db-4748-b60b-2cd00c785d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:02.732422 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1138/2302] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:02 2022] DELETE /identity/v3/projects/5a5fdbd0e9bc4caea9061f1014928d1f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:02.737065 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79301e2e-ec0d-489b-ab0a-226d9406393c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:02.737423 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79301e2e-ec0d-489b-ab0a-226d9406393c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:02.737837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79301e2e-ec0d-489b-ab0a-226d9406393c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:02.758259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-79301e2e-ec0d-489b-ab0a-226d9406393c None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:02.760110 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-79301e2e-ec0d-489b-ab0a-226d9406393c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:02.821957 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1165/2303] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:02.830279 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2939f-763e-4a1b-baab-b72c1570e053 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:02.830615 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2939f-763e-4a1b-baab-b72c1570e053 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:02.830893 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2939f-763e-4a1b-baab-b72c1570e053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:02.851200 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e6d2939f-763e-4a1b-baab-b72c1570e053 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:02.852444 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e6d2939f-763e-4a1b-baab-b72c1570e053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:02.861203 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1139/2304] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:02.865562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79301e2e-ec0d-489b-ab0a-226d9406393c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:02.876484 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79301e2e-ec0d-489b-ab0a-226d9406393c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:02.881518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999ffb7-7a58-48b7-b868-463e57e16d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:02.882117 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999ffb7-7a58-48b7-b868-463e57e16d22 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:02.882402 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999ffb7-7a58-48b7-b868-463e57e16d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:02.882677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999ffb7-7a58-48b7-b868-463e57e16d22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:02.883403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999ffb7-7a58-48b7-b868-463e57e16d22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:34:02.883770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999ffb7-7a58-48b7-b868-463e57e16d22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:02.885440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999ffb7-7a58-48b7-b868-463e57e16d22 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:02.897021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1166/2305] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:34:02.901511 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2939f-763e-4a1b-baab-b72c1570e053 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:02.910796 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2939f-763e-4a1b-baab-b72c1570e053 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:02.916201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa111257-5a21-4794-b45b-b657c0fffdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:02.916845 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa111257-5a21-4794-b45b-b657c0fffdea admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:02.917071 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa111257-5a21-4794-b45b-b657c0fffdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:02.917342 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa111257-5a21-4794-b45b-b657c0fffdea admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:02.917976 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa111257-5a21-4794-b45b-b657c0fffdea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:02.919959 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa111257-5a21-4794-b45b-b657c0fffdea admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:02.951429 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1140/2306] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:02 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:02.952864 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999ffb7-7a58-48b7-b868-463e57e16d22 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:02.962965 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999ffb7-7a58-48b7-b868-463e57e16d22 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:03.021268 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e967ab-68d1-4ff2-8b00-1be69d944e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:03.021880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e967ab-68d1-4ff2-8b00-1be69d944e86 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:03.022158 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e967ab-68d1-4ff2-8b00-1be69d944e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:03.022490 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e967ab-68d1-4ff2-8b00-1be69d944e86 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:03.023168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e967ab-68d1-4ff2-8b00-1be69d944e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:03.025170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e967ab-68d1-4ff2-8b00-1be69d944e86 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:03.050806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1167/2307] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:02 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:34:03.052319 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa111257-5a21-4794-b45b-b657c0fffdea admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:03.064723 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa111257-5a21-4794-b45b-b657c0fffdea admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:03.073556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bcd94-e211-4f11-88e8-ba030ad3e4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:03.074138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bcd94-e211-4f11-88e8-ba030ad3e4ea admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:03.074422 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bcd94-e211-4f11-88e8-ba030ad3e4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:03.074743 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bcd94-e211-4f11-88e8-ba030ad3e4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:03.075413 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bcd94-e211-4f11-88e8-ba030ad3e4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:03.077055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bcd94-e211-4f11-88e8-ba030ad3e4ea admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:03.082683 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:03.096235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e967ab-68d1-4ff2-8b00-1be69d944e86 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:03.097820 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1141/2308] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:03.114607 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e967ab-68d1-4ff2-8b00-1be69d944e86 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:03.120588 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120454e-7c05-49ab-bde2-02dd80c2bf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:03.121211 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120454e-7c05-49ab-bde2-02dd80c2bf2b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:03.121491 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120454e-7c05-49ab-bde2-02dd80c2bf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:03.121767 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120454e-7c05-49ab-bde2-02dd80c2bf2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:03.122422 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120454e-7c05-49ab-bde2-02dd80c2bf2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:03.124279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120454e-7c05-49ab-bde2-02dd80c2bf2b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:03.136222 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1168/2309] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:03.140568 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bcd94-e211-4f11-88e8-ba030ad3e4ea admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:03.151403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bcd94-e211-4f11-88e8-ba030ad3e4ea admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:03.157085 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d036a-2833-403a-86b8-1de3aa73afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:03.157625 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d036a-2833-403a-86b8-1de3aa73afdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:03.157901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d036a-2833-403a-86b8-1de3aa73afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:03.158171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d036a-2833-403a-86b8-1de3aa73afdf admin admin] PATH_INFO: `/v3/projects/98541353e33a40dc9297538314899e36/users/698df7a562e54c32bd072693acf59617/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:03.175234 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d036a-2833-403a-86b8-1de3aa73afdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=98541353e33a40dc9297538314899e36, user_id=698df7a562e54c32bd072693acf59617, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:03.178272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d036a-2833-403a-86b8-1de3aa73afdf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:03.192758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1142/2310] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:03 2022] PUT /identity/v3/projects/98541353e33a40dc9297538314899e36/users/698df7a562e54c32bd072693acf59617/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:03.207600 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec4674-a147-47c4-a051-fedaa62c6cbc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:03.207896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec4674-a147-47c4-a051-fedaa62c6cbc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:03.208219 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec4674-a147-47c4-a051-fedaa62c6cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:03.236014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:03.239780 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-13ec4674-a147-47c4-a051-fedaa62c6cbc None None] MFA Rules not processed for user `698df7a562e54c32bd072693acf59617`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:03.241762 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-13ec4674-a147-47c4-a051-fedaa62c6cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:03.318130 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1169/2311] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:03.323457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d036a-2833-403a-86b8-1de3aa73afdf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:03.399342 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d036a-2833-403a-86b8-1de3aa73afdf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:03.405872 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b42f1-84c4-45d4-b569-f6fe8625d3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:03.406744 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b42f1-84c4-45d4-b569-f6fe8625d3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:03.407031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b42f1-84c4-45d4-b569-f6fe8625d3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:03.407308 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b42f1-84c4-45d4-b569-f6fe8625d3c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:03.408035 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b42f1-84c4-45d4-b569-f6fe8625d3c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:03.410126 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b42f1-84c4-45d4-b569-f6fe8625d3c5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:03.449781 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1143/2312] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:03 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:34:03.450903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec4674-a147-47c4-a051-fedaa62c6cbc None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:03.468425 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec4674-a147-47c4-a051-fedaa62c6cbc None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:03.568235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e90f84-f4ec-4a3f-b9d8-2d8c742393b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:03.568860 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e90f84-f4ec-4a3f-b9d8-2d8c742393b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:03.569139 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e90f84-f4ec-4a3f-b9d8-2d8c742393b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:03.569464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e90f84-f4ec-4a3f-b9d8-2d8c742393b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:03.579836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e90f84-f4ec-4a3f-b9d8-2d8c742393b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:03.579836 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e90f84-f4ec-4a3f-b9d8-2d8c742393b0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:03.638706 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1170/2313] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:03 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:03.642544 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b42f1-84c4-45d4-b569-f6fe8625d3c5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:03.655065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b42f1-84c4-45d4-b569-f6fe8625d3c5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:03.660741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b11fb-9076-40ff-ab44-02569c0f0042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:03.661291 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b11fb-9076-40ff-ab44-02569c0f0042 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:03.661578 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b11fb-9076-40ff-ab44-02569c0f0042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:03.661901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b11fb-9076-40ff-ab44-02569c0f0042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:03.662574 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b11fb-9076-40ff-ab44-02569c0f0042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:03.664330 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b11fb-9076-40ff-ab44-02569c0f0042 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:03.677981 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1144/2314] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:34:03.686334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e90f84-f4ec-4a3f-b9d8-2d8c742393b0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:03.700517 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e90f84-f4ec-4a3f-b9d8-2d8c742393b0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:03.706009 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5203653-ba18-4077-b44c-3a7b30f6e892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:03.706699 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5203653-ba18-4077-b44c-3a7b30f6e892 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:03.706975 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5203653-ba18-4077-b44c-3a7b30f6e892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:03.707773 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5203653-ba18-4077-b44c-3a7b30f6e892 admin admin] PATH_INFO: `/v3/projects/b53f5e91a15346459b3b4cccdd91a0af/users/9d4cc7ac2b1449b88d65a9337e853b2e/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:03.724181 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5203653-ba18-4077-b44c-3a7b30f6e892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b53f5e91a15346459b3b4cccdd91a0af, user_id=9d4cc7ac2b1449b88d65a9337e853b2e, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:03.726989 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5203653-ba18-4077-b44c-3a7b30f6e892 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:03.742301 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1171/2315] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:03 2022] PUT /identity/v3/projects/b53f5e91a15346459b3b4cccdd91a0af/users/9d4cc7ac2b1449b88d65a9337e853b2e/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:03.746260 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b11fb-9076-40ff-ab44-02569c0f0042 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:03.756635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b11fb-9076-40ff-ab44-02569c0f0042 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:03.815484 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318446f-8031-4de0-b285-71a0f115ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:03.816243 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318446f-8031-4de0-b285-71a0f115ceba admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:03.816522 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318446f-8031-4de0-b285-71a0f115ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:03.816792 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318446f-8031-4de0-b285-71a0f115ceba admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:03.817437 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1318446f-8031-4de0-b285-71a0f115ceba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:03.819013 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1318446f-8031-4de0-b285-71a0f115ceba admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:03.834984 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1145/2316] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:03.836745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5203653-ba18-4077-b44c-3a7b30f6e892 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:03.847827 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5203653-ba18-4077-b44c-3a7b30f6e892 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:03.852646 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd0913-1dbf-460c-91b9-dad40d69842d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:03.853487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd0913-1dbf-460c-91b9-dad40d69842d admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:03.853771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd0913-1dbf-460c-91b9-dad40d69842d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:03.854042 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd0913-1dbf-460c-91b9-dad40d69842d admin admin] PATH_INFO: `/v3/projects/b53f5e91a15346459b3b4cccdd91a0af/users/9d4cc7ac2b1449b88d65a9337e853b2e/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:03.856000 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd0913-1dbf-460c-91b9-dad40d69842d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b53f5e91a15346459b3b4cccdd91a0af, user_id=9d4cc7ac2b1449b88d65a9337e853b2e, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:03.859253 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd0913-1dbf-460c-91b9-dad40d69842d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:03.871219 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1172/2317] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:03 2022] PUT /identity/v3/projects/b53f5e91a15346459b3b4cccdd91a0af/users/9d4cc7ac2b1449b88d65a9337e853b2e/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:03.891423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a5828-4360-4ed7-8624-638907901ab9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:03.891423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a5828-4360-4ed7-8624-638907901ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:03.891423 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a5828-4360-4ed7-8624-638907901ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:03.912210 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-eb5a5828-4360-4ed7-8624-638907901ab9 None None] MFA Rules not processed for user `9d4cc7ac2b1449b88d65a9337e853b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:03.913418 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-eb5a5828-4360-4ed7-8624-638907901ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:03.947600 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:03.982967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1146/2318] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:03.994603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd0913-1dbf-460c-91b9-dad40d69842d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:03.996544 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-46fd0913-1dbf-460c-91b9-dad40d69842d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:04.055618 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd0913-1dbf-460c-91b9-dad40d69842d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:04.060513 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c9038-8ff1-46ec-a333-5b768c163e9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:04.061257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c9038-8ff1-46ec-a333-5b768c163e9a service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:04.063438 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c9038-8ff1-46ec-a333-5b768c163e9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:04.063438 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c9038-8ff1-46ec-a333-5b768c163e9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:04.080002 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c9038-8ff1-46ec-a333-5b768c163e9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:04.081612 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c9038-8ff1-46ec-a333-5b768c163e9a service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:04.091675 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:04.104145 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1173/2319] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:04.204023 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a5828-4360-4ed7-8624-638907901ab9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:04.213747 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a5828-4360-4ed7-8624-638907901ab9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:04.217584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3298f4b-f3f0-46e3-be80-4542c0c4b358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:04.218209 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3298f4b-f3f0-46e3-be80-4542c0c4b358 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:04.218504 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3298f4b-f3f0-46e3-be80-4542c0c4b358 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:04.218778 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3298f4b-f3f0-46e3-be80-4542c0c4b358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:04.280875 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3298f4b-f3f0-46e3-be80-4542c0c4b358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:04.282458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3298f4b-f3f0-46e3-be80-4542c0c4b358 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:04.291950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1147/2320] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:34:09.798928 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c9038-8ff1-46ec-a333-5b768c163e9a service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:09.800599 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-530c9038-8ff1-46ec-a333-5b768c163e9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:09.882419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c9038-8ff1-46ec-a333-5b768c163e9a service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:09.887078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61149e6-c2f7-41a9-85b3-6eaf9e5fa74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:09.887738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61149e6-c2f7-41a9-85b3-6eaf9e5fa74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:09.888057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61149e6-c2f7-41a9-85b3-6eaf9e5fa74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:09.888333 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61149e6-c2f7-41a9-85b3-6eaf9e5fa74f admin admin] PATH_INFO: `/v3/users/f487a625f4c04acbaf6286e5ce35af4f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:09.889561 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61149e6-c2f7-41a9-85b3-6eaf9e5fa74f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f487a625f4c04acbaf6286e5ce35af4f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:09.891577 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61149e6-c2f7-41a9-85b3-6eaf9e5fa74f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:09.939255 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a61149e6-c2f7-41a9-85b3-6eaf9e5fa74f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f487a625f4c04acbaf6286e5ce35af4f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:09.940064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a61149e6-c2f7-41a9-85b3-6eaf9e5fa74f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f487a625f4c04acbaf6286e5ce35af4f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:09.947205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a61149e6-c2f7-41a9-85b3-6eaf9e5fa74f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f487a625f4c04acbaf6286e5ce35af4f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:09.947894 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a61149e6-c2f7-41a9-85b3-6eaf9e5fa74f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f487a625f4c04acbaf6286e5ce35af4f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:09.956309 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a61149e6-c2f7-41a9-85b3-6eaf9e5fa74f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f487a625f4c04acbaf6286e5ce35af4f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:09.974377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1174/2321] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:09 2022] DELETE /identity/v3/users/f487a625f4c04acbaf6286e5ce35af4f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:09.978839 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead00126-82ca-4b80-83e6-9378093b3b28 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:09.979292 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead00126-82ca-4b80-83e6-9378093b3b28 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:09.979431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead00126-82ca-4b80-83e6-9378093b3b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:09.998494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ead00126-82ca-4b80-83e6-9378093b3b28 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:09.999671 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ead00126-82ca-4b80-83e6-9378093b3b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:10.068050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1148/2322] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:10.076273 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61149e6-c2f7-41a9-85b3-6eaf9e5fa74f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:10.077798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a61149e6-c2f7-41a9-85b3-6eaf9e5fa74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:10.140517 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61149e6-c2f7-41a9-85b3-6eaf9e5fa74f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:10.144746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370ea1d-b9d9-4eba-a903-30b43c239679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:10.145373 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370ea1d-b9d9-4eba-a903-30b43c239679 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:10.145638 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370ea1d-b9d9-4eba-a903-30b43c239679 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:10.145912 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370ea1d-b9d9-4eba-a903-30b43c239679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:10.155328 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370ea1d-b9d9-4eba-a903-30b43c239679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:10.156792 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370ea1d-b9d9-4eba-a903-30b43c239679 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:10.166524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1175/2323] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:10.466267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead00126-82ca-4b80-83e6-9378093b3b28 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:10.467685 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ead00126-82ca-4b80-83e6-9378093b3b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:10.483255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead00126-82ca-4b80-83e6-9378093b3b28 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:10.491001 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acee0b-5c3c-4209-a46f-c894dae69ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:10.491875 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acee0b-5c3c-4209-a46f-c894dae69ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:10.494613 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acee0b-5c3c-4209-a46f-c894dae69ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:10.494908 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acee0b-5c3c-4209-a46f-c894dae69ce8 admin admin] PATH_INFO: `/v3/projects/e0a439e5bd2d4897b7d6dc933f86fd2b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:10.498791 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acee0b-5c3c-4209-a46f-c894dae69ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a439e5bd2d4897b7d6dc933f86fd2b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:10.502535 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acee0b-5c3c-4209-a46f-c894dae69ce8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:10.521381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370ea1d-b9d9-4eba-a903-30b43c239679 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:10.522794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a370ea1d-b9d9-4eba-a903-30b43c239679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:10.536657 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370ea1d-b9d9-4eba-a903-30b43c239679 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:10.541867 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3d139-0653-4b25-90af-2bdccfd41e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:10.542520 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3d139-0653-4b25-90af-2bdccfd41e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:10.542806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3d139-0653-4b25-90af-2bdccfd41e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:10.543239 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3d139-0653-4b25-90af-2bdccfd41e61 admin admin] PATH_INFO: `/v3/users/a6bc5677a71f4dfa97f6885b1cea29ee` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:10.544858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3d139-0653-4b25-90af-2bdccfd41e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6bc5677a71f4dfa97f6885b1cea29ee)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:10.547531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3d139-0653-4b25-90af-2bdccfd41e61 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:10.563972 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:10.572219 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7acee0b-5c3c-4209-a46f-c894dae69ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a439e5bd2d4897b7d6dc933f86fd2b', 'request_id': 'req-a7acee0b-5c3c-4209-a46f-c894dae69ce8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:10.583974 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7acee0b-5c3c-4209-a46f-c894dae69ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a439e5bd2d4897b7d6dc933f86fd2b', 'request_id': 'req-a7acee0b-5c3c-4209-a46f-c894dae69ce8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:10.592886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7acee0b-5c3c-4209-a46f-c894dae69ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a439e5bd2d4897b7d6dc933f86fd2b', 'request_id': 'req-a7acee0b-5c3c-4209-a46f-c894dae69ce8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:10.597450 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:10.603332 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-01f3d139-0653-4b25-90af-2bdccfd41e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6bc5677a71f4dfa97f6885b1cea29ee'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:10.604296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-01f3d139-0653-4b25-90af-2bdccfd41e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6bc5677a71f4dfa97f6885b1cea29ee'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:10.608614 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7acee0b-5c3c-4209-a46f-c894dae69ce8 admin admin] The token cache is being invalidate because project e0a439e5bd2d4897b7d6dc933f86fd2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:10.608921 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7acee0b-5c3c-4209-a46f-c894dae69ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:10.609842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7acee0b-5c3c-4209-a46f-c894dae69ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:10.611965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1149/2324] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:10 2022] DELETE /identity/v3/projects/e0a439e5bd2d4897b7d6dc933f86fd2b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:10.615536 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-01f3d139-0653-4b25-90af-2bdccfd41e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6bc5677a71f4dfa97f6885b1cea29ee'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:10.615962 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acee0b-5c3c-4209-a46f-c894dae69ce8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:10.616530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-01f3d139-0653-4b25-90af-2bdccfd41e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6bc5677a71f4dfa97f6885b1cea29ee'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:10.617367 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a7acee0b-5c3c-4209-a46f-c894dae69ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:10.626012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-01f3d139-0653-4b25-90af-2bdccfd41e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6bc5677a71f4dfa97f6885b1cea29ee'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:10.653377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1176/2325] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:10 2022] DELETE /identity/v3/users/a6bc5677a71f4dfa97f6885b1cea29ee => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:10.658739 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039a859-2c97-4171-9275-b573f6e3e5a0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:10.665945 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039a859-2c97-4171-9275-b573f6e3e5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:10.666415 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039a859-2c97-4171-9275-b573f6e3e5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:10.692607 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0039a859-2c97-4171-9275-b573f6e3e5a0 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:10.694375 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acee0b-5c3c-4209-a46f-c894dae69ce8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:10.694878 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0039a859-2c97-4171-9275-b573f6e3e5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:10.756747 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d2292-417e-438e-8ed1-c02bf087a1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:10.757298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d2292-417e-438e-8ed1-c02bf087a1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:10.757577 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d2292-417e-438e-8ed1-c02bf087a1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:10.757873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d2292-417e-438e-8ed1-c02bf087a1a0 admin admin] PATH_INFO: `/v3/users/519a42a773b34cb388db88e7cf70c78a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:10.759047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d2292-417e-438e-8ed1-c02bf087a1a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=519a42a773b34cb388db88e7cf70c78a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:10.760943 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d2292-417e-438e-8ed1-c02bf087a1a0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:10.763095 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1177/2326] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:10.772858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039a859-2c97-4171-9275-b573f6e3e5a0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:10.774721 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0039a859-2c97-4171-9275-b573f6e3e5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:10.815316 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-649d2292-417e-438e-8ed1-c02bf087a1a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '519a42a773b34cb388db88e7cf70c78a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:10.816497 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-649d2292-417e-438e-8ed1-c02bf087a1a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '519a42a773b34cb388db88e7cf70c78a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:10.824678 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-649d2292-417e-438e-8ed1-c02bf087a1a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '519a42a773b34cb388db88e7cf70c78a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:10.825563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-649d2292-417e-438e-8ed1-c02bf087a1a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '519a42a773b34cb388db88e7cf70c78a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:10.834607 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-649d2292-417e-438e-8ed1-c02bf087a1a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '519a42a773b34cb388db88e7cf70c78a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:10.854478 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039a859-2c97-4171-9275-b573f6e3e5a0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:10.857246 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1150/2327] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:10 2022] DELETE /identity/v3/users/519a42a773b34cb388db88e7cf70c78a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:10.865044 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9acb7-6fb0-48ca-b2f6-130a2992d96f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:10.865935 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9acb7-6fb0-48ca-b2f6-130a2992d96f service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:10.866407 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9acb7-6fb0-48ca-b2f6-130a2992d96f service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:10.867047 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9acb7-6fb0-48ca-b2f6-130a2992d96f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:10.870667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-79b9acb7-6fb0-48ca-b2f6-130a2992d96f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:10.888351 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9acb7-6fb0-48ca-b2f6-130a2992d96f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:10.890044 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9acb7-6fb0-48ca-b2f6-130a2992d96f service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:10.906176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1178/2328] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:34:11.147069 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d2292-417e-438e-8ed1-c02bf087a1a0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:11.148779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-649d2292-417e-438e-8ed1-c02bf087a1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:11.176170 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:11.242736 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d2292-417e-438e-8ed1-c02bf087a1a0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:11.248271 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1672a-f24a-4ceb-b970-e51208d4bdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:11.249013 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1672a-f24a-4ceb-b970-e51208d4bdcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:11.249359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1672a-f24a-4ceb-b970-e51208d4bdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:11.249699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1672a-f24a-4ceb-b970-e51208d4bdcc admin admin] PATH_INFO: `/v3/projects/7ff3c17350c0486883726fde71dca12b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:11.251009 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1672a-f24a-4ceb-b970-e51208d4bdcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff3c17350c0486883726fde71dca12b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:11.253055 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1672a-f24a-4ceb-b970-e51208d4bdcc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:11.308250 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3fa1672a-f24a-4ceb-b970-e51208d4bdcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff3c17350c0486883726fde71dca12b', 'request_id': 'req-3fa1672a-f24a-4ceb-b970-e51208d4bdcc'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:11.321546 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3fa1672a-f24a-4ceb-b970-e51208d4bdcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff3c17350c0486883726fde71dca12b', 'request_id': 'req-3fa1672a-f24a-4ceb-b970-e51208d4bdcc'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:11.332354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3fa1672a-f24a-4ceb-b970-e51208d4bdcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff3c17350c0486883726fde71dca12b', 'request_id': 'req-3fa1672a-f24a-4ceb-b970-e51208d4bdcc'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:11.332689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9acb7-6fb0-48ca-b2f6-130a2992d96f service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:11.334215 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-79b9acb7-6fb0-48ca-b2f6-130a2992d96f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:11.346880 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9acb7-6fb0-48ca-b2f6-130a2992d96f service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:11.352268 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3fa1672a-f24a-4ceb-b970-e51208d4bdcc admin admin] The token cache is being invalidate because project 7ff3c17350c0486883726fde71dca12b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:11.352774 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3fa1672a-f24a-4ceb-b970-e51208d4bdcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:11.353654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3fa1672a-f24a-4ceb-b970-e51208d4bdcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:11.355719 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1151/2329] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:11 2022] DELETE /identity/v3/projects/7ff3c17350c0486883726fde71dca12b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:11.361834 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed71e95-e999-41ac-8d57-33deb30dee7e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:11.362128 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed71e95-e999-41ac-8d57-33deb30dee7e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:11.362457 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed71e95-e999-41ac-8d57-33deb30dee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:11.384380 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-aed71e95-e999-41ac-8d57-33deb30dee7e None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:11.385733 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aed71e95-e999-41ac-8d57-33deb30dee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:11.394605 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:11.424352 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:11.425130 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:11.425415 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:11.425691 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce admin admin] PATH_INFO: `/v3/projects/840142de5b7e435d9cb813d6802e6dc4` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:11.426914 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=840142de5b7e435d9cb813d6802e6dc4)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:11.429163 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:11.465867 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1152/2330] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:11.474447 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b72e97-1030-4107-b710-89bfdb675885 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:11.474923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b72e97-1030-4107-b710-89bfdb675885 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:11.475204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b72e97-1030-4107-b710-89bfdb675885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:11.492862 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '840142de5b7e435d9cb813d6802e6dc4', 'request_id': 'req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:11.503073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '840142de5b7e435d9cb813d6802e6dc4', 'request_id': 'req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:11.507189 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-27b72e97-1030-4107-b710-89bfdb675885 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:11.508808 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-27b72e97-1030-4107-b710-89bfdb675885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:11.514671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '840142de5b7e435d9cb813d6802e6dc4', 'request_id': 'req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:11.525552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce admin admin] The token cache is being invalidate because project 840142de5b7e435d9cb813d6802e6dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:11.525772 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:11.526431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:11.527948 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1179/2331] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:11 2022] DELETE /identity/v3/projects/840142de5b7e435d9cb813d6802e6dc4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:11.531705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:11.533024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:11.558587 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:11.575856 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1153/2332] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:11.580153 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b72e97-1030-4107-b710-89bfdb675885 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:11.589046 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b72e97-1030-4107-b710-89bfdb675885 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:11.593730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba66b16-cbc9-42ab-830d-22a88d24ebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:11.594311 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba66b16-cbc9-42ab-830d-22a88d24ebba admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:11.594592 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba66b16-cbc9-42ab-830d-22a88d24ebba admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:11.594867 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba66b16-cbc9-42ab-830d-22a88d24ebba admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:11.595509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba66b16-cbc9-42ab-830d-22a88d24ebba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:34:11.595867 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba66b16-cbc9-42ab-830d-22a88d24ebba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:11.596257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08cd5d-cb65-4755-b5d4-c7ada97229ce admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:11.597524 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba66b16-cbc9-42ab-830d-22a88d24ebba admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:11.602013 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbd41c-8db2-40f2-a8ee-cf3f0e918e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:11.602638 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbd41c-8db2-40f2-a8ee-cf3f0e918e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:11.602917 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbd41c-8db2-40f2-a8ee-cf3f0e918e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:11.603188 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbd41c-8db2-40f2-a8ee-cf3f0e918e0d admin admin] PATH_INFO: `/v3/users/ba6b09b03ff145efb8b3de62076e2e33` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:11.604325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbd41c-8db2-40f2-a8ee-cf3f0e918e0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba6b09b03ff145efb8b3de62076e2e33)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:11.606353 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbd41c-8db2-40f2-a8ee-cf3f0e918e0d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:11.609438 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1154/2333] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:34:11.613773 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba66b16-cbc9-42ab-830d-22a88d24ebba admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:11.624135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba66b16-cbc9-42ab-830d-22a88d24ebba admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:11.629376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa275d-49ad-433b-90d5-0a1080adac9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:11.630125 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa275d-49ad-433b-90d5-0a1080adac9f admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:11.630389 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa275d-49ad-433b-90d5-0a1080adac9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:11.630864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa275d-49ad-433b-90d5-0a1080adac9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:11.631491 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa275d-49ad-433b-90d5-0a1080adac9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:11.633593 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa275d-49ad-433b-90d5-0a1080adac9f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:11.655686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6ecbd41c-8db2-40f2-a8ee-cf3f0e918e0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba6b09b03ff145efb8b3de62076e2e33'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:11.656518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6ecbd41c-8db2-40f2-a8ee-cf3f0e918e0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba6b09b03ff145efb8b3de62076e2e33'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:11.661553 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1155/2334] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:11 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:34:11.663555 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6ecbd41c-8db2-40f2-a8ee-cf3f0e918e0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba6b09b03ff145efb8b3de62076e2e33'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:11.664247 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6ecbd41c-8db2-40f2-a8ee-cf3f0e918e0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba6b09b03ff145efb8b3de62076e2e33'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:11.665659 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa275d-49ad-433b-90d5-0a1080adac9f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:11.667914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3daa275d-49ad-433b-90d5-0a1080adac9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:11.673116 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6ecbd41c-8db2-40f2-a8ee-cf3f0e918e0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba6b09b03ff145efb8b3de62076e2e33'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:11.677794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:11.693327 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1180/2335] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:11 2022] DELETE /identity/v3/users/ba6b09b03ff145efb8b3de62076e2e33 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:11.745382 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa275d-49ad-433b-90d5-0a1080adac9f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:11.810303 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32973fd-ddde-4f39-9ddf-ebf27b5e176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:11.810919 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32973fd-ddde-4f39-9ddf-ebf27b5e176c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:11.811195 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32973fd-ddde-4f39-9ddf-ebf27b5e176c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:11.811463 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32973fd-ddde-4f39-9ddf-ebf27b5e176c admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:11.812137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32973fd-ddde-4f39-9ddf-ebf27b5e176c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:11.814060 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32973fd-ddde-4f39-9ddf-ebf27b5e176c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:11.839325 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1156/2336] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:11 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:11.844258 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbd41c-8db2-40f2-a8ee-cf3f0e918e0d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:11.855488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbd41c-8db2-40f2-a8ee-cf3f0e918e0d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:11.860734 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e3f21-d9bb-40d1-96ce-41a8b363e00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:11.861502 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e3f21-d9bb-40d1-96ce-41a8b363e00e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:11.861730 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e3f21-d9bb-40d1-96ce-41a8b363e00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:11.861918 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e3f21-d9bb-40d1-96ce-41a8b363e00e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:11.862570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e3f21-d9bb-40d1-96ce-41a8b363e00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:11.864423 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e3f21-d9bb-40d1-96ce-41a8b363e00e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:11.876079 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1181/2337] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:11.880895 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32973fd-ddde-4f39-9ddf-ebf27b5e176c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:11.893218 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32973fd-ddde-4f39-9ddf-ebf27b5e176c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:11.897982 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bfdaf-a300-4060-8961-b85570e9efeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:11.898576 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bfdaf-a300-4060-8961-b85570e9efeb admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:11.898849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bfdaf-a300-4060-8961-b85570e9efeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:11.899115 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bfdaf-a300-4060-8961-b85570e9efeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:11.899843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bfdaf-a300-4060-8961-b85570e9efeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:11.901354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bfdaf-a300-4060-8961-b85570e9efeb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:11.912523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1157/2338] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:34:11.916629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e3f21-d9bb-40d1-96ce-41a8b363e00e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:11.926788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e3f21-d9bb-40d1-96ce-41a8b363e00e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:11.931610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec538aa-afa7-4475-8f34-c5132593184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:11.932296 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec538aa-afa7-4475-8f34-c5132593184d admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:11.932580 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec538aa-afa7-4475-8f34-c5132593184d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:11.932858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec538aa-afa7-4475-8f34-c5132593184d admin admin] PATH_INFO: `/v3/projects/e643009e2c9041eb9dae8b9b8d1ca2c8/users/69d358d72da64db9b82473e282ea80d6/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:11.948457 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec538aa-afa7-4475-8f34-c5132593184d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e643009e2c9041eb9dae8b9b8d1ca2c8, user_id=69d358d72da64db9b82473e282ea80d6, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:11.951653 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec538aa-afa7-4475-8f34-c5132593184d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:11.966051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1182/2339] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:11 2022] PUT /identity/v3/projects/e643009e2c9041eb9dae8b9b8d1ca2c8/users/69d358d72da64db9b82473e282ea80d6/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:11.977445 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81947c-3edb-4aea-8dcb-df4febc1e7a0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:11.977725 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81947c-3edb-4aea-8dcb-df4febc1e7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:11.978086 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81947c-3edb-4aea-8dcb-df4febc1e7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:11.995135 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec538aa-afa7-4475-8f34-c5132593184d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:11.997520 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bec538aa-afa7-4475-8f34-c5132593184d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:12.011603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3d81947c-3edb-4aea-8dcb-df4febc1e7a0 None None] MFA Rules not processed for user `69d358d72da64db9b82473e282ea80d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:12.017600 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3d81947c-3edb-4aea-8dcb-df4febc1e7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:12.056983 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:12.083700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec538aa-afa7-4475-8f34-c5132593184d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:12.088474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213a4b6-d0af-4798-9fef-d50c42c05497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:12.089103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213a4b6-d0af-4798-9fef-d50c42c05497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.089386 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213a4b6-d0af-4798-9fef-d50c42c05497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.089661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213a4b6-d0af-4798-9fef-d50c42c05497 admin admin] PATH_INFO: `/v3/projects/8315918c70864433a9d2b614ada75edd` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.090831 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213a4b6-d0af-4798-9fef-d50c42c05497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8315918c70864433a9d2b614ada75edd)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:12.092795 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213a4b6-d0af-4798-9fef-d50c42c05497 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:12.111982 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1158/2340] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:12.116549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81947c-3edb-4aea-8dcb-df4febc1e7a0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:12.128285 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81947c-3edb-4aea-8dcb-df4febc1e7a0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:12.145166 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5213a4b6-d0af-4798-9fef-d50c42c05497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8315918c70864433a9d2b614ada75edd', 'request_id': 'req-5213a4b6-d0af-4798-9fef-d50c42c05497'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:12.145630 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4bcd-f750-4ba0-bc98-47b16efcae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:12.146936 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4bcd-f750-4ba0-bc98-47b16efcae20 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.147322 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4bcd-f750-4ba0-bc98-47b16efcae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.147850 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4bcd-f750-4ba0-bc98-47b16efcae20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.148454 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af4bcd-f750-4ba0-bc98-47b16efcae20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:12.150591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af4bcd-f750-4ba0-bc98-47b16efcae20 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:12.154354 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5213a4b6-d0af-4798-9fef-d50c42c05497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8315918c70864433a9d2b614ada75edd', 'request_id': 'req-5213a4b6-d0af-4798-9fef-d50c42c05497'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:12.161787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5213a4b6-d0af-4798-9fef-d50c42c05497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8315918c70864433a9d2b614ada75edd', 'request_id': 'req-5213a4b6-d0af-4798-9fef-d50c42c05497'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:12.174487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5213a4b6-d0af-4798-9fef-d50c42c05497 admin admin] The token cache is being invalidate because project 8315918c70864433a9d2b614ada75edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:12.175180 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5213a4b6-d0af-4798-9fef-d50c42c05497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:12.176105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5213a4b6-d0af-4798-9fef-d50c42c05497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:12.177848 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1183/2341] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:11 2022] DELETE /identity/v3/projects/8315918c70864433a9d2b614ada75edd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:12.181843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1159/2342] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:12 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:12.183271 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f1ede-9d5d-4054-a24c-3060fb51eb5c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.185789 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4bcd-f750-4ba0-bc98-47b16efcae20 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:12.186356 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f1ede-9d5d-4054-a24c-3060fb51eb5c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.186639 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f1ede-9d5d-4054-a24c-3060fb51eb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.187752 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-60af4bcd-f750-4ba0-bc98-47b16efcae20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:12.215169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-418f1ede-9d5d-4054-a24c-3060fb51eb5c None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:12.216956 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-418f1ede-9d5d-4054-a24c-3060fb51eb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:12.253361 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:12.265740 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4bcd-f750-4ba0-bc98-47b16efcae20 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:12.270828 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cf006-9654-4794-9345-c47ab3d8e819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:12.271440 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cf006-9654-4794-9345-c47ab3d8e819 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.271720 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cf006-9654-4794-9345-c47ab3d8e819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.272024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cf006-9654-4794-9345-c47ab3d8e819 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.272660 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cf006-9654-4794-9345-c47ab3d8e819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:12.274585 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cf006-9654-4794-9345-c47ab3d8e819 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:12.287675 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1184/2343] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:12.296293 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f7d75-4bb4-44a8-a0aa-7a92a7f2bb36 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.296570 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f7d75-4bb4-44a8-a0aa-7a92a7f2bb36 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.296845 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f7d75-4bb4-44a8-a0aa-7a92a7f2bb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.299626 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1160/2344] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:12 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:12.303372 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cf006-9654-4794-9345-c47ab3d8e819 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:12.315019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cf006-9654-4794-9345-c47ab3d8e819 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:12.320455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5c0a4-8e26-43c9-bbc3-45f2c62f52b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:12.321066 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5c0a4-8e26-43c9-bbc3-45f2c62f52b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.321350 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5c0a4-8e26-43c9-bbc3-45f2c62f52b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.321633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5c0a4-8e26-43c9-bbc3-45f2c62f52b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.321741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b21f7d75-4bb4-44a8-a0aa-7a92a7f2bb36 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:12.322281 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5c0a4-8e26-43c9-bbc3-45f2c62f52b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:12.322924 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b21f7d75-4bb4-44a8-a0aa-7a92a7f2bb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:12.323863 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5c0a4-8e26-43c9-bbc3-45f2c62f52b5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:12.337085 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1185/2345] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:12.337252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1161/2346] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:34:12.340247 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f7d75-4bb4-44a8-a0aa-7a92a7f2bb36 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:12.347541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5c0a4-8e26-43c9-bbc3-45f2c62f52b5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:12.350122 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f7d75-4bb4-44a8-a0aa-7a92a7f2bb36 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:12.354747 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eab47b-8505-4c5a-b61c-226ce52d3d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:12.355334 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eab47b-8505-4c5a-b61c-226ce52d3d45 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.355610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eab47b-8505-4c5a-b61c-226ce52d3d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.355882 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eab47b-8505-4c5a-b61c-226ce52d3d45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.356615 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eab47b-8505-4c5a-b61c-226ce52d3d45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:34:12.356912 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eab47b-8505-4c5a-b61c-226ce52d3d45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:12.358774 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eab47b-8505-4c5a-b61c-226ce52d3d45 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:12.358891 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5c0a4-8e26-43c9-bbc3-45f2c62f52b5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:12.363591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49942489-3865-4563-b130-26f4e4200b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:12.364395 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49942489-3865-4563-b130-26f4e4200b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.364703 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49942489-3865-4563-b130-26f4e4200b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.364984 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49942489-3865-4563-b130-26f4e4200b01 admin admin] PATH_INFO: `/v3/projects/b3189293b6e74abba3c1c335d78b4f35/users/7b8936db8ca645ab8eabd8b960042e3e/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.370218 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1186/2347] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:34:12.375028 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eab47b-8505-4c5a-b61c-226ce52d3d45 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:12.381043 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49942489-3865-4563-b130-26f4e4200b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3189293b6e74abba3c1c335d78b4f35, user_id=7b8936db8ca645ab8eabd8b960042e3e, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:12.383722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49942489-3865-4563-b130-26f4e4200b01 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:12.384974 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eab47b-8505-4c5a-b61c-226ce52d3d45 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:12.391081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ceed-bc76-4f73-8445-4c7a1e0ba9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:12.391753 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ceed-bc76-4f73-8445-4c7a1e0ba9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.392076 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ceed-bc76-4f73-8445-4c7a1e0ba9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.392348 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ceed-bc76-4f73-8445-4c7a1e0ba9d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.393014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7ceed-bc76-4f73-8445-4c7a1e0ba9d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:12.394955 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7ceed-bc76-4f73-8445-4c7a1e0ba9d4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:12.397404 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1162/2348] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:12 2022] PUT /identity/v3/projects/b3189293b6e74abba3c1c335d78b4f35/users/7b8936db8ca645ab8eabd8b960042e3e/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:12.400992 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49942489-3865-4563-b130-26f4e4200b01 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:12.426124 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1187/2349] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:12 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:34:12.427446 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ceed-bc76-4f73-8445-4c7a1e0ba9d4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:12.465066 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49942489-3865-4563-b130-26f4e4200b01 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:12.473986 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:12.492002 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ceed-bc76-4f73-8445-4c7a1e0ba9d4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:12.497935 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f2ce8-8687-458e-8a4e-df1b6586252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:12.498536 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f2ce8-8687-458e-8a4e-df1b6586252c admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.498811 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f2ce8-8687-458e-8a4e-df1b6586252c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.499083 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f2ce8-8687-458e-8a4e-df1b6586252c admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.499703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f2ce8-8687-458e-8a4e-df1b6586252c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:12.501643 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f2ce8-8687-458e-8a4e-df1b6586252c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:12.527579 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1188/2350] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:12 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:34:12.527881 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb35f3-9f66-47e6-a10e-a615883aab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:12.527881 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb35f3-9f66-47e6-a10e-a615883aab3e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.527881 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb35f3-9f66-47e6-a10e-a615883aab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.527881 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb35f3-9f66-47e6-a10e-a615883aab3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.528516 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb35f3-9f66-47e6-a10e-a615883aab3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:12.530034 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f2ce8-8687-458e-8a4e-df1b6586252c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:12.530145 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb35f3-9f66-47e6-a10e-a615883aab3e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:12.541314 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1163/2351] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:34:12.542340 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f2ce8-8687-458e-8a4e-df1b6586252c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:12.547689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9998c0-1f3f-4f55-90c8-95006928e258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:12.548319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9998c0-1f3f-4f55-90c8-95006928e258 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.548602 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9998c0-1f3f-4f55-90c8-95006928e258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.548886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb35f3-9f66-47e6-a10e-a615883aab3e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:12.549083 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9998c0-1f3f-4f55-90c8-95006928e258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.549893 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9998c0-1f3f-4f55-90c8-95006928e258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:12.552171 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9998c0-1f3f-4f55-90c8-95006928e258 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:12.559381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb35f3-9f66-47e6-a10e-a615883aab3e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:12.565623 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a79ada-6c7f-4c75-a19f-16cf213db44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:12.566307 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79ada-6c7f-4c75-a19f-16cf213db44a admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.566732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1189/2352] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:12.568031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79ada-6c7f-4c75-a19f-16cf213db44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.568361 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79ada-6c7f-4c75-a19f-16cf213db44a admin admin] PATH_INFO: `/v3/projects/b3189293b6e74abba3c1c335d78b4f35/users/7b8936db8ca645ab8eabd8b960042e3e/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.570526 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9998c0-1f3f-4f55-90c8-95006928e258 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:12.570666 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a79ada-6c7f-4c75-a19f-16cf213db44a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3189293b6e74abba3c1c335d78b4f35, user_id=7b8936db8ca645ab8eabd8b960042e3e, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:12.573710 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a79ada-6c7f-4c75-a19f-16cf213db44a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:12.584895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9998c0-1f3f-4f55-90c8-95006928e258 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:12.586668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1164/2353] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:12 2022] PUT /identity/v3/projects/b3189293b6e74abba3c1c335d78b4f35/users/7b8936db8ca645ab8eabd8b960042e3e/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:12.599557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab315b6a-43ae-4f67-99bb-64eae124953b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.600119 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab315b6a-43ae-4f67-99bb-64eae124953b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.600577 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab315b6a-43ae-4f67-99bb-64eae124953b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.633346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ab315b6a-43ae-4f67-99bb-64eae124953b None None] MFA Rules not processed for user `7b8936db8ca645ab8eabd8b960042e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:12.634737 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ab315b6a-43ae-4f67-99bb-64eae124953b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:12.658235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176aef1-c4e3-4e1f-a4c7-4aabf4ed28b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:12.659140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176aef1-c4e3-4e1f-a4c7-4aabf4ed28b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.659676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176aef1-c4e3-4e1f-a4c7-4aabf4ed28b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.660592 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176aef1-c4e3-4e1f-a4c7-4aabf4ed28b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.661322 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176aef1-c4e3-4e1f-a4c7-4aabf4ed28b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:12.663874 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176aef1-c4e3-4e1f-a4c7-4aabf4ed28b5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:12.680237 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1190/2354] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:34:12.684892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176aef1-c4e3-4e1f-a4c7-4aabf4ed28b5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:12.696125 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176aef1-c4e3-4e1f-a4c7-4aabf4ed28b5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:12.701230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2de72-f4c2-4d87-8418-b9f87ceb419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:12.702054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2de72-f4c2-4d87-8418-b9f87ceb419d admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.702623 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2de72-f4c2-4d87-8418-b9f87ceb419d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.702908 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2de72-f4c2-4d87-8418-b9f87ceb419d admin admin] PATH_INFO: `/v3/projects/e25c9874232b40f7af8121ad3caf998d/users/9850acf3946b4ee2ad326869cde4edf9/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.718097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:12.724600 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2de72-f4c2-4d87-8418-b9f87ceb419d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25c9874232b40f7af8121ad3caf998d, user_id=9850acf3946b4ee2ad326869cde4edf9, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:12.727848 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1165/2355] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:12.728077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2de72-f4c2-4d87-8418-b9f87ceb419d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:12.737085 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab315b6a-43ae-4f67-99bb-64eae124953b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:12.738680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ab315b6a-43ae-4f67-99bb-64eae124953b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:12.750307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1191/2356] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:12 2022] PUT /identity/v3/projects/e25c9874232b40f7af8121ad3caf998d/users/9850acf3946b4ee2ad326869cde4edf9/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:12.816830 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab315b6a-43ae-4f67-99bb-64eae124953b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:12.828337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd71930-8b54-44cb-8171-b0c290fe5c8a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.828892 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd71930-8b54-44cb-8171-b0c290fe5c8a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.829183 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd71930-8b54-44cb-8171-b0c290fe5c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.861665 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8cd71930-8b54-44cb-8171-b0c290fe5c8a None None] MFA Rules not processed for user `9850acf3946b4ee2ad326869cde4edf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:12.862891 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8cd71930-8b54-44cb-8171-b0c290fe5c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:12.866496 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:12.888297 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4864a7-9bac-46d4-bd5c-196a81899d07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:12.888904 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4864a7-9bac-46d4-bd5c-196a81899d07 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:12.889182 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4864a7-9bac-46d4-bd5c-196a81899d07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:12.889492 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4864a7-9bac-46d4-bd5c-196a81899d07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:12.936724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1192/2357] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:12.941509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd71930-8b54-44cb-8171-b0c290fe5c8a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:12.964333 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4864a7-9bac-46d4-bd5c-196a81899d07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:12.966559 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4864a7-9bac-46d4-bd5c-196a81899d07 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:12.976615 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1166/2358] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:13.012274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd71930-8b54-44cb-8171-b0c290fe5c8a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:13.017994 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb55b0-3757-4976-a90d-341a043b5112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:13.018765 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb55b0-3757-4976-a90d-341a043b5112 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:13.019089 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb55b0-3757-4976-a90d-341a043b5112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:13.019546 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb55b0-3757-4976-a90d-341a043b5112 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:13.020185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb55b0-3757-4976-a90d-341a043b5112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:13.022530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb55b0-3757-4976-a90d-341a043b5112 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:13.052998 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1193/2359] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:12 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:34:13.060810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4864a7-9bac-46d4-bd5c-196a81899d07 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:13.073336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4864a7-9bac-46d4-bd5c-196a81899d07 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:13.140968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1fafc-75a9-40a0-8e82-97f2a7eb21e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:13.140968 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1fafc-75a9-40a0-8e82-97f2a7eb21e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:13.141251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1fafc-75a9-40a0-8e82-97f2a7eb21e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:13.141527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1fafc-75a9-40a0-8e82-97f2a7eb21e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:13.142173 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1fafc-75a9-40a0-8e82-97f2a7eb21e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:13.144116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1fafc-75a9-40a0-8e82-97f2a7eb21e4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:13.169292 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1167/2360] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:13 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:34:13.170555 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb55b0-3757-4976-a90d-341a043b5112 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:13.181652 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb55b0-3757-4976-a90d-341a043b5112 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:13.186559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97df24e-b313-4ca3-855f-920a7f7cf617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:13.187171 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97df24e-b313-4ca3-855f-920a7f7cf617 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:13.187450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97df24e-b313-4ca3-855f-920a7f7cf617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:13.187725 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97df24e-b313-4ca3-855f-920a7f7cf617 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:13.188408 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97df24e-b313-4ca3-855f-920a7f7cf617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:13.190017 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97df24e-b313-4ca3-855f-920a7f7cf617 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:13.201634 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1194/2361] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:34:13.205485 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1fafc-75a9-40a0-8e82-97f2a7eb21e4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:13.220065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1fafc-75a9-40a0-8e82-97f2a7eb21e4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:13.224517 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8830f03-1b2c-431b-a222-605318e18b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:13.225173 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8830f03-1b2c-431b-a222-605318e18b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:13.225448 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8830f03-1b2c-431b-a222-605318e18b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:13.225717 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8830f03-1b2c-431b-a222-605318e18b8d admin admin] PATH_INFO: `/v3/projects/04717323397b4c93ae9fd9035217308b/users/06c55167d19f46428e003b4399eb2f99/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:13.240396 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8830f03-1b2c-431b-a222-605318e18b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=04717323397b4c93ae9fd9035217308b, user_id=06c55167d19f46428e003b4399eb2f99, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:13.243029 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8830f03-1b2c-431b-a222-605318e18b8d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:13.257315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1168/2362] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:13 2022] PUT /identity/v3/projects/04717323397b4c93ae9fd9035217308b/users/06c55167d19f46428e003b4399eb2f99/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:13.261649 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97df24e-b313-4ca3-855f-920a7f7cf617 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:13.272256 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97df24e-b313-4ca3-855f-920a7f7cf617 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:13.319807 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:13.330039 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedac81f-0fe0-4167-b581-c33565f5f288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:13.330585 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedac81f-0fe0-4167-b581-c33565f5f288 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:13.330871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedac81f-0fe0-4167-b581-c33565f5f288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:13.331146 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedac81f-0fe0-4167-b581-c33565f5f288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:13.331791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedac81f-0fe0-4167-b581-c33565f5f288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:13.333469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedac81f-0fe0-4167-b581-c33565f5f288 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:13.347557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1195/2363] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:13.351969 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8830f03-1b2c-431b-a222-605318e18b8d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:13.361975 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8830f03-1b2c-431b-a222-605318e18b8d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:13.366913 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37909132-d751-4c2d-a7f3-da30dc91ebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:13.367557 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37909132-d751-4c2d-a7f3-da30dc91ebab admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:13.367833 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37909132-d751-4c2d-a7f3-da30dc91ebab admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:13.368137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37909132-d751-4c2d-a7f3-da30dc91ebab admin admin] PATH_INFO: `/v3/projects/04717323397b4c93ae9fd9035217308b/users/06c55167d19f46428e003b4399eb2f99/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:13.370252 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37909132-d751-4c2d-a7f3-da30dc91ebab admin admin] RBAC: Authorizing `identity:create_grant(project_id=04717323397b4c93ae9fd9035217308b, user_id=06c55167d19f46428e003b4399eb2f99, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:13.373018 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37909132-d751-4c2d-a7f3-da30dc91ebab admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:13.384977 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1169/2364] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:13 2022] PUT /identity/v3/projects/04717323397b4c93ae9fd9035217308b/users/06c55167d19f46428e003b4399eb2f99/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:13.396367 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4e93f-1e47-4595-b997-e64c77ae9c2e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:13.396958 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4e93f-1e47-4595-b997-e64c77ae9c2e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:13.397478 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4e93f-1e47-4595-b997-e64c77ae9c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:13.437492 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-45b4e93f-1e47-4595-b997-e64c77ae9c2e None None] MFA Rules not processed for user `06c55167d19f46428e003b4399eb2f99`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:13.438787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-45b4e93f-1e47-4595-b997-e64c77ae9c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:13.533156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1196/2365] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:13.546180 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37909132-d751-4c2d-a7f3-da30dc91ebab admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:13.548276 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-37909132-d751-4c2d-a7f3-da30dc91ebab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:13.600393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:13.618220 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37909132-d751-4c2d-a7f3-da30dc91ebab admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:13.621927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d60245-0549-4927-a226-109e12f1b270 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:13.622597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d60245-0549-4927-a226-109e12f1b270 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:13.622909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d60245-0549-4927-a226-109e12f1b270 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:13.623180 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d60245-0549-4927-a226-109e12f1b270 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:13.633486 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d60245-0549-4927-a226-109e12f1b270 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:13.634927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d60245-0549-4927-a226-109e12f1b270 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:13.644326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4e93f-1e47-4595-b997-e64c77ae9c2e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:13.645592 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1170/2366] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:13.712639 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4e93f-1e47-4595-b997-e64c77ae9c2e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:13.718214 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795c33b-8e87-49d3-b598-e904cd9bdd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:13.718920 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795c33b-8e87-49d3-b598-e904cd9bdd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:13.719213 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795c33b-8e87-49d3-b598-e904cd9bdd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:13.719489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795c33b-8e87-49d3-b598-e904cd9bdd6d admin admin] PATH_INFO: `/v3/users/69d358d72da64db9b82473e282ea80d6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:13.720673 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795c33b-8e87-49d3-b598-e904cd9bdd6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=69d358d72da64db9b82473e282ea80d6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:13.722609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795c33b-8e87-49d3-b598-e904cd9bdd6d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:13.753231 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d60245-0549-4927-a226-109e12f1b270 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:13.762542 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d60245-0549-4927-a226-109e12f1b270 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:13.767741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff7e16-62d6-4176-8ac3-7d4836101237 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:13.768662 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff7e16-62d6-4176-8ac3-7d4836101237 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:13.768965 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff7e16-62d6-4176-8ac3-7d4836101237 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:13.769264 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff7e16-62d6-4176-8ac3-7d4836101237 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:13.781306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f795c33b-8e87-49d3-b598-e904cd9bdd6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69d358d72da64db9b82473e282ea80d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:13.782724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f795c33b-8e87-49d3-b598-e904cd9bdd6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69d358d72da64db9b82473e282ea80d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:13.790788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f795c33b-8e87-49d3-b598-e904cd9bdd6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69d358d72da64db9b82473e282ea80d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:13.791682 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f795c33b-8e87-49d3-b598-e904cd9bdd6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69d358d72da64db9b82473e282ea80d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:13.801530 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f795c33b-8e87-49d3-b598-e904cd9bdd6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69d358d72da64db9b82473e282ea80d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:13.818362 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:13.828922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1197/2367] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:13 2022] DELETE /identity/v3/users/69d358d72da64db9b82473e282ea80d6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:13.834005 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81774c14-14b8-4692-9a89-7e095f06b68c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:13.834304 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81774c14-14b8-4692-9a89-7e095f06b68c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:13.834611 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81774c14-14b8-4692-9a89-7e095f06b68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:13.839904 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff7e16-62d6-4176-8ac3-7d4836101237 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:13.841852 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff7e16-62d6-4176-8ac3-7d4836101237 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:13.853186 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1171/2368] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:34:13.861578 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-81774c14-14b8-4692-9a89-7e095f06b68c None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:13.863190 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-81774c14-14b8-4692-9a89-7e095f06b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:13.973033 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1198/2369] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:13.986234 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff7e16-62d6-4176-8ac3-7d4836101237 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:13.987919 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1eff7e16-62d6-4176-8ac3-7d4836101237 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:14.069370 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff7e16-62d6-4176-8ac3-7d4836101237 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:14.120862 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27c1d3-d9d9-421c-bc16-69eff9c934a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:14.121456 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27c1d3-d9d9-421c-bc16-69eff9c934a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:14.121758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27c1d3-d9d9-421c-bc16-69eff9c934a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:14.122033 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27c1d3-d9d9-421c-bc16-69eff9c934a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:14.135314 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27c1d3-d9d9-421c-bc16-69eff9c934a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:14.136846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27c1d3-d9d9-421c-bc16-69eff9c934a5 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:14.147772 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1172/2370] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:14.330023 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81774c14-14b8-4692-9a89-7e095f06b68c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:14.331485 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-81774c14-14b8-4692-9a89-7e095f06b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:14.343875 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81774c14-14b8-4692-9a89-7e095f06b68c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:14.348817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d3fa0-0a62-43ee-9854-5c5160aff809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:14.350081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d3fa0-0a62-43ee-9854-5c5160aff809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:14.350081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d3fa0-0a62-43ee-9854-5c5160aff809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:14.350280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d3fa0-0a62-43ee-9854-5c5160aff809 admin admin] PATH_INFO: `/v3/users/9850acf3946b4ee2ad326869cde4edf9` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:14.351752 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d3fa0-0a62-43ee-9854-5c5160aff809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9850acf3946b4ee2ad326869cde4edf9)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:14.354146 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d3fa0-0a62-43ee-9854-5c5160aff809 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:14.401910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d95d3fa0-0a62-43ee-9854-5c5160aff809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9850acf3946b4ee2ad326869cde4edf9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:14.402567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d95d3fa0-0a62-43ee-9854-5c5160aff809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9850acf3946b4ee2ad326869cde4edf9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:14.410105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d95d3fa0-0a62-43ee-9854-5c5160aff809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9850acf3946b4ee2ad326869cde4edf9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:14.410759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d95d3fa0-0a62-43ee-9854-5c5160aff809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9850acf3946b4ee2ad326869cde4edf9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:14.419271 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d95d3fa0-0a62-43ee-9854-5c5160aff809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9850acf3946b4ee2ad326869cde4edf9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:14.437449 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1199/2371] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:14 2022] DELETE /identity/v3/users/9850acf3946b4ee2ad326869cde4edf9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:14.442185 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235578b4-010c-43af-8ca6-23d2461e1c53 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:14.442658 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235578b4-010c-43af-8ca6-23d2461e1c53 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:14.442755 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235578b4-010c-43af-8ca6-23d2461e1c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:14.462713 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-235578b4-010c-43af-8ca6-23d2461e1c53 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:14.464006 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-235578b4-010c-43af-8ca6-23d2461e1c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:14.467871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d3fa0-0a62-43ee-9854-5c5160aff809 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:14.469326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d95d3fa0-0a62-43ee-9854-5c5160aff809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:14.502200 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:14.533613 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1173/2372] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:14.543454 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235578b4-010c-43af-8ca6-23d2461e1c53 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:14.545439 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-235578b4-010c-43af-8ca6-23d2461e1c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:14.551651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d3fa0-0a62-43ee-9854-5c5160aff809 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:14.556595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:14.557228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:14.557507 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:14.557780 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4 admin admin] PATH_INFO: `/v3/projects/e643009e2c9041eb9dae8b9b8d1ca2c8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:14.558915 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e643009e2c9041eb9dae8b9b8d1ca2c8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:14.560909 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:14.570173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:14.607810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235578b4-010c-43af-8ca6-23d2461e1c53 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:14.616097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e643009e2c9041eb9dae8b9b8d1ca2c8', 'request_id': 'req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:14.624160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e643009e2c9041eb9dae8b9b8d1ca2c8', 'request_id': 'req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:14.631636 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e643009e2c9041eb9dae8b9b8d1ca2c8', 'request_id': 'req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:14.642461 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4 admin admin] The token cache is being invalidate because project e643009e2c9041eb9dae8b9b8d1ca2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:14.642684 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:14.643345 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:14.644886 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1200/2373] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:14 2022] DELETE /identity/v3/projects/e643009e2c9041eb9dae8b9b8d1ca2c8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:14.648664 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:14.649966 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:14.659243 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15440d78-a363-4eea-b13a-fdbec33c0af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:14.659882 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15440d78-a363-4eea-b13a-fdbec33c0af7 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:14.660171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15440d78-a363-4eea-b13a-fdbec33c0af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:14.660437 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15440d78-a363-4eea-b13a-fdbec33c0af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:14.662160 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-15440d78-a363-4eea-b13a-fdbec33c0af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:14.719763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb1f4c-ffa0-40b5-bfd8-57afe08e54c4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:14.724890 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188ad15-4af3-4a64-a9ba-25376e7fe767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:14.725654 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188ad15-4af3-4a64-a9ba-25376e7fe767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:14.725932 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188ad15-4af3-4a64-a9ba-25376e7fe767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:14.726208 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188ad15-4af3-4a64-a9ba-25376e7fe767 admin admin] PATH_INFO: `/v3/users/7b8936db8ca645ab8eabd8b960042e3e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:14.727436 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188ad15-4af3-4a64-a9ba-25376e7fe767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b8936db8ca645ab8eabd8b960042e3e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:14.729617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188ad15-4af3-4a64-a9ba-25376e7fe767 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:14.733803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15440d78-a363-4eea-b13a-fdbec33c0af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:14.735335 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15440d78-a363-4eea-b13a-fdbec33c0af7 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:14.752877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1174/2374] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:34:14.781542 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d188ad15-4af3-4a64-a9ba-25376e7fe767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b8936db8ca645ab8eabd8b960042e3e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:14.782201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d188ad15-4af3-4a64-a9ba-25376e7fe767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b8936db8ca645ab8eabd8b960042e3e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:14.789419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d188ad15-4af3-4a64-a9ba-25376e7fe767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b8936db8ca645ab8eabd8b960042e3e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:14.790191 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d188ad15-4af3-4a64-a9ba-25376e7fe767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b8936db8ca645ab8eabd8b960042e3e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:14.798592 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d188ad15-4af3-4a64-a9ba-25376e7fe767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b8936db8ca645ab8eabd8b960042e3e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:14.819774 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1201/2375] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:14 2022] DELETE /identity/v3/users/7b8936db8ca645ab8eabd8b960042e3e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:15.037567 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15440d78-a363-4eea-b13a-fdbec33c0af7 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:15.039030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-15440d78-a363-4eea-b13a-fdbec33c0af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:15.057050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15440d78-a363-4eea-b13a-fdbec33c0af7 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:15.110784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:15.127824 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:15.128494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:15.128838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:15.129346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7 admin admin] PATH_INFO: `/v3/projects/e25c9874232b40f7af8121ad3caf998d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:15.130906 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25c9874232b40f7af8121ad3caf998d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:15.131555 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188ad15-4af3-4a64-a9ba-25376e7fe767 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:15.133852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d188ad15-4af3-4a64-a9ba-25376e7fe767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:15.141212 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:15.167407 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188ad15-4af3-4a64-a9ba-25376e7fe767 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:15.173866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007beb9-7a6a-4977-9a2b-a6948c680969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:15.174606 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007beb9-7a6a-4977-9a2b-a6948c680969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:15.175037 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007beb9-7a6a-4977-9a2b-a6948c680969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:15.175338 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007beb9-7a6a-4977-9a2b-a6948c680969 admin admin] PATH_INFO: `/v3/projects/b3189293b6e74abba3c1c335d78b4f35` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:15.177538 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007beb9-7a6a-4977-9a2b-a6948c680969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3189293b6e74abba3c1c335d78b4f35)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:15.180502 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007beb9-7a6a-4977-9a2b-a6948c680969 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:15.195536 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:15.205226 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25c9874232b40f7af8121ad3caf998d', 'request_id': 'req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:15.214981 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25c9874232b40f7af8121ad3caf998d', 'request_id': 'req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:15.225464 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25c9874232b40f7af8121ad3caf998d', 'request_id': 'req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:15.239038 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7 admin admin] The token cache is being invalidate because project e25c9874232b40f7af8121ad3caf998d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:15.239437 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:15.240550 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8007beb9-7a6a-4977-9a2b-a6948c680969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3189293b6e74abba3c1c335d78b4f35', 'request_id': 'req-8007beb9-7a6a-4977-9a2b-a6948c680969'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:15.240675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:15.242132 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1175/2376] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:15 2022] DELETE /identity/v3/projects/e25c9874232b40f7af8121ad3caf998d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:15.246047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:15.247672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:15.249536 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8007beb9-7a6a-4977-9a2b-a6948c680969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3189293b6e74abba3c1c335d78b4f35', 'request_id': 'req-8007beb9-7a6a-4977-9a2b-a6948c680969'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:15.256738 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8007beb9-7a6a-4977-9a2b-a6948c680969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3189293b6e74abba3c1c335d78b4f35', 'request_id': 'req-8007beb9-7a6a-4977-9a2b-a6948c680969'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:15.270188 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8007beb9-7a6a-4977-9a2b-a6948c680969 admin admin] The token cache is being invalidate because project b3189293b6e74abba3c1c335d78b4f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:15.270477 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8007beb9-7a6a-4977-9a2b-a6948c680969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:15.271135 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8007beb9-7a6a-4977-9a2b-a6948c680969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:15.272849 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1202/2377] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:15 2022] DELETE /identity/v3/projects/b3189293b6e74abba3c1c335d78b4f35 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:15.278629 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8090e7-ff5a-40bb-94b2-7a1795e1561d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:15.278922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8090e7-ff5a-40bb-94b2-7a1795e1561d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:15.279201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8090e7-ff5a-40bb-94b2-7a1795e1561d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:15.302768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6c8090e7-ff5a-40bb-94b2-7a1795e1561d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:15.304133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6c8090e7-ff5a-40bb-94b2-7a1795e1561d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:15.333559 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dff5b-c802-493b-b704-bcd24fdeb8d7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:15.377459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1203/2378] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:15.386220 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e66f9-9cc1-46ce-bc79-54aa28b6d916 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:15.386508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e66f9-9cc1-46ce-bc79-54aa28b6d916 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:15.386793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e66f9-9cc1-46ce-bc79-54aa28b6d916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:15.404519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e32b16-fa22-4441-9c9e-68107724fee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:15.405158 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e32b16-fa22-4441-9c9e-68107724fee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:15.405444 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e32b16-fa22-4441-9c9e-68107724fee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:15.405712 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e32b16-fa22-4441-9c9e-68107724fee1 admin admin] PATH_INFO: `/v3/users/06c55167d19f46428e003b4399eb2f99` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:15.406878 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e32b16-fa22-4441-9c9e-68107724fee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c55167d19f46428e003b4399eb2f99)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:15.408248 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e76e66f9-9cc1-46ce-bc79-54aa28b6d916 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:15.408993 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e32b16-fa22-4441-9c9e-68107724fee1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:15.409454 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e76e66f9-9cc1-46ce-bc79-54aa28b6d916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:15.417875 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1204/2379] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:15.422553 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e66f9-9cc1-46ce-bc79-54aa28b6d916 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:15.431759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e66f9-9cc1-46ce-bc79-54aa28b6d916 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:15.439581 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:15.441977 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e94b69-1c68-4226-8fbc-0d6897a6e5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:15.442612 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e94b69-1c68-4226-8fbc-0d6897a6e5ee admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:15.442895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e94b69-1c68-4226-8fbc-0d6897a6e5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:15.443171 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e94b69-1c68-4226-8fbc-0d6897a6e5ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:15.443828 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e94b69-1c68-4226-8fbc-0d6897a6e5ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:34:15.444169 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e94b69-1c68-4226-8fbc-0d6897a6e5ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:15.445810 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e94b69-1c68-4226-8fbc-0d6897a6e5ee admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:15.462064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1205/2380] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:34:15.465467 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e94b69-1c68-4226-8fbc-0d6897a6e5ee admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:15.477082 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-55e32b16-fa22-4441-9c9e-68107724fee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c55167d19f46428e003b4399eb2f99'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:15.477944 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-55e32b16-fa22-4441-9c9e-68107724fee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c55167d19f46428e003b4399eb2f99'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:15.478084 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e94b69-1c68-4226-8fbc-0d6897a6e5ee admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:15.482991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb5d82-4569-473c-ab38-fdb9a948c789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:15.483600 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb5d82-4569-473c-ab38-fdb9a948c789 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:15.483871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb5d82-4569-473c-ab38-fdb9a948c789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:15.484227 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb5d82-4569-473c-ab38-fdb9a948c789 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:15.484896 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb5d82-4569-473c-ab38-fdb9a948c789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:15.487201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb5d82-4569-473c-ab38-fdb9a948c789 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:15.488285 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-55e32b16-fa22-4441-9c9e-68107724fee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c55167d19f46428e003b4399eb2f99'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:15.489527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-55e32b16-fa22-4441-9c9e-68107724fee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c55167d19f46428e003b4399eb2f99'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:15.500310 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-55e32b16-fa22-4441-9c9e-68107724fee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c55167d19f46428e003b4399eb2f99'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:15.520940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1206/2381] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:15 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:15.522494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1176/2382] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:15 2022] DELETE /identity/v3/users/06c55167d19f46428e003b4399eb2f99 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:15.525240 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb5d82-4569-473c-ab38-fdb9a948c789 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:15.529982 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-58fb5d82-4569-473c-ab38-fdb9a948c789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:15.600250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:15.605194 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb5d82-4569-473c-ab38-fdb9a948c789 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:15.686809 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa9b1e-af7c-4058-a3c6-cc78e07ca21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:15.687732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa9b1e-af7c-4058-a3c6-cc78e07ca21f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:15.688774 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa9b1e-af7c-4058-a3c6-cc78e07ca21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:15.688774 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa9b1e-af7c-4058-a3c6-cc78e07ca21f admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:15.689559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa9b1e-af7c-4058-a3c6-cc78e07ca21f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:15.691805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa9b1e-af7c-4058-a3c6-cc78e07ca21f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:15.724567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1207/2383] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:15 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:34:15.725955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e32b16-fa22-4441-9c9e-68107724fee1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:15.744316 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e32b16-fa22-4441-9c9e-68107724fee1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:15.749512 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c06a85-b4e3-49e1-bb8b-96fde03f4faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:15.751048 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c06a85-b4e3-49e1-bb8b-96fde03f4faa admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:15.751348 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c06a85-b4e3-49e1-bb8b-96fde03f4faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:15.751615 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c06a85-b4e3-49e1-bb8b-96fde03f4faa admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:15.752290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c06a85-b4e3-49e1-bb8b-96fde03f4faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:15.754498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c06a85-b4e3-49e1-bb8b-96fde03f4faa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:15.766849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1177/2384] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:34:15.770859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa9b1e-af7c-4058-a3c6-cc78e07ca21f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:15.780906 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa9b1e-af7c-4058-a3c6-cc78e07ca21f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:15.785693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d2f40-33ce-4425-a145-44f014f07004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:15.786297 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d2f40-33ce-4425-a145-44f014f07004 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:15.786580 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d2f40-33ce-4425-a145-44f014f07004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:15.786863 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d2f40-33ce-4425-a145-44f014f07004 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:15.787503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d2f40-33ce-4425-a145-44f014f07004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:15.789156 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d2f40-33ce-4425-a145-44f014f07004 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:15.799713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1208/2385] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:15.804194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c06a85-b4e3-49e1-bb8b-96fde03f4faa admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:15.816320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c06a85-b4e3-49e1-bb8b-96fde03f4faa admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:15.821273 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563d7f7-34ff-4539-85b2-b605e9874f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:15.821922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563d7f7-34ff-4539-85b2-b605e9874f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:15.822198 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563d7f7-34ff-4539-85b2-b605e9874f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:15.822495 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563d7f7-34ff-4539-85b2-b605e9874f13 admin admin] PATH_INFO: `/v3/projects/c3c184bb282848a4b492079a5aae3baa/users/bbf0b4001bd04f99bcb48b2e64291399/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:15.845491 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563d7f7-34ff-4539-85b2-b605e9874f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c184bb282848a4b492079a5aae3baa, user_id=bbf0b4001bd04f99bcb48b2e64291399, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:15.848251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563d7f7-34ff-4539-85b2-b605e9874f13 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:15.852958 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d2f40-33ce-4425-a145-44f014f07004 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:15.854965 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f94d2f40-33ce-4425-a145-44f014f07004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:15.864779 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1178/2386] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:15 2022] PUT /identity/v3/projects/c3c184bb282848a4b492079a5aae3baa/users/bbf0b4001bd04f99bcb48b2e64291399/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:15.869348 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d2f40-33ce-4425-a145-44f014f07004 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:15.874846 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5056f-8254-4060-aff0-e241736c7dfa None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:15.875132 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5056f-8254-4060-aff0-e241736c7dfa None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:15.875394 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5056f-8254-4060-aff0-e241736c7dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:15.904601 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e8b5056f-8254-4060-aff0-e241736c7dfa None None] MFA Rules not processed for user `bbf0b4001bd04f99bcb48b2e64291399`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:15.905814 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e8b5056f-8254-4060-aff0-e241736c7dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:15.935261 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce33ea5-0786-4651-aa8a-f8cf107fd6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:15.936007 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce33ea5-0786-4651-aa8a-f8cf107fd6d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:15.936291 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce33ea5-0786-4651-aa8a-f8cf107fd6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:15.937023 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce33ea5-0786-4651-aa8a-f8cf107fd6d9 admin admin] PATH_INFO: `/v3/projects/04717323397b4c93ae9fd9035217308b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:15.938192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce33ea5-0786-4651-aa8a-f8cf107fd6d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04717323397b4c93ae9fd9035217308b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:15.940154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce33ea5-0786-4651-aa8a-f8cf107fd6d9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:15.971014 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1179/2387] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:15.983352 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5056f-8254-4060-aff0-e241736c7dfa None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:15.984739 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e8b5056f-8254-4060-aff0-e241736c7dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:15.988758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ce33ea5-0786-4651-aa8a-f8cf107fd6d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04717323397b4c93ae9fd9035217308b', 'request_id': 'req-5ce33ea5-0786-4651-aa8a-f8cf107fd6d9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:15.997708 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ce33ea5-0786-4651-aa8a-f8cf107fd6d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04717323397b4c93ae9fd9035217308b', 'request_id': 'req-5ce33ea5-0786-4651-aa8a-f8cf107fd6d9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:16.005910 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ce33ea5-0786-4651-aa8a-f8cf107fd6d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04717323397b4c93ae9fd9035217308b', 'request_id': 'req-5ce33ea5-0786-4651-aa8a-f8cf107fd6d9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:16.023198 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ce33ea5-0786-4651-aa8a-f8cf107fd6d9 admin admin] The token cache is being invalidate because project 04717323397b4c93ae9fd9035217308b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:16.023490 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ce33ea5-0786-4651-aa8a-f8cf107fd6d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:16.024192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ce33ea5-0786-4651-aa8a-f8cf107fd6d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:16.030721 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1209/2388] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:15 2022] DELETE /identity/v3/projects/04717323397b4c93ae9fd9035217308b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:16.032177 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd3df3-7313-4749-9a3e-2a4e74049f81 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:16.032462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd3df3-7313-4749-9a3e-2a4e74049f81 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:16.032737 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd3df3-7313-4749-9a3e-2a4e74049f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:16.055647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-dacd3df3-7313-4749-9a3e-2a4e74049f81 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:16.061710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dacd3df3-7313-4749-9a3e-2a4e74049f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:16.069853 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:16.074396 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5056f-8254-4060-aff0-e241736c7dfa None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:16.085767 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:16.128438 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1210/2389] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:16.137988 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6401b-7af7-4788-aee5-295e77834198 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:16.138741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6401b-7af7-4788-aee5-295e77834198 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:16.138741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6401b-7af7-4788-aee5-295e77834198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:16.139124 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d952bc-81a0-4e2a-a917-be1c7a154c1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:16.139789 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d952bc-81a0-4e2a-a917-be1c7a154c1e service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:16.140188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d952bc-81a0-4e2a-a917-be1c7a154c1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:16.140465 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d952bc-81a0-4e2a-a917-be1c7a154c1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:16.142295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e7d952bc-81a0-4e2a-a917-be1c7a154c1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:16.160760 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e7e6401b-7af7-4788-aee5-295e77834198 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:16.161975 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e7e6401b-7af7-4788-aee5-295e77834198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:16.172440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1211/2390] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:16.175721 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6401b-7af7-4788-aee5-295e77834198 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:16.186546 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6401b-7af7-4788-aee5-295e77834198 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:16.192077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87373c7-af34-4763-9c66-89541965cc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:16.192764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87373c7-af34-4763-9c66-89541965cc74 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:16.193674 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87373c7-af34-4763-9c66-89541965cc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:16.193674 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87373c7-af34-4763-9c66-89541965cc74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:16.194370 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87373c7-af34-4763-9c66-89541965cc74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:34:16.194584 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87373c7-af34-4763-9c66-89541965cc74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:16.196220 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87373c7-af34-4763-9c66-89541965cc74 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:16.209844 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1212/2391] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 10:34:16.214400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87373c7-af34-4763-9c66-89541965cc74 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:16.218591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d952bc-81a0-4e2a-a917-be1c7a154c1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:16.220073 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d952bc-81a0-4e2a-a917-be1c7a154c1e service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:16.225433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87373c7-af34-4763-9c66-89541965cc74 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:16.231273 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1f5d0-cdd4-448f-9f57-544138461269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:16.231881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1f5d0-cdd4-448f-9f57-544138461269 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:16.232209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1f5d0-cdd4-448f-9f57-544138461269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:16.232487 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1f5d0-cdd4-448f-9f57-544138461269 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:16.233159 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1f5d0-cdd4-448f-9f57-544138461269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:16.235086 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1f5d0-cdd4-448f-9f57-544138461269 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:16.238231 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1180/2392] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:34:16.259045 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d952bc-81a0-4e2a-a917-be1c7a154c1e service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:16.260736 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e7d952bc-81a0-4e2a-a917-be1c7a154c1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:16.277143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d952bc-81a0-4e2a-a917-be1c7a154c1e service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:16.281811 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b65c9-6478-4925-bc2a-65dfbd2e0ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:16.282498 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b65c9-6478-4925-bc2a-65dfbd2e0ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:16.282771 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b65c9-6478-4925-bc2a-65dfbd2e0ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:16.286686 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b65c9-6478-4925-bc2a-65dfbd2e0ba6 admin admin] PATH_INFO: `/v3/users/bbf0b4001bd04f99bcb48b2e64291399` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:16.286821 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1213/2393] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:16 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:16.286920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b65c9-6478-4925-bc2a-65dfbd2e0ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf0b4001bd04f99bcb48b2e64291399)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:16.286920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b65c9-6478-4925-bc2a-65dfbd2e0ba6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:16.287673 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1f5d0-cdd4-448f-9f57-544138461269 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:16.337867 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-603b65c9-6478-4925-bc2a-65dfbd2e0ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf0b4001bd04f99bcb48b2e64291399'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:16.338657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-603b65c9-6478-4925-bc2a-65dfbd2e0ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf0b4001bd04f99bcb48b2e64291399'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:16.346014 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-603b65c9-6478-4925-bc2a-65dfbd2e0ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf0b4001bd04f99bcb48b2e64291399'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:16.346602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-603b65c9-6478-4925-bc2a-65dfbd2e0ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf0b4001bd04f99bcb48b2e64291399'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:16.354618 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-603b65c9-6478-4925-bc2a-65dfbd2e0ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf0b4001bd04f99bcb48b2e64291399'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:16.358454 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1f5d0-cdd4-448f-9f57-544138461269 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:16.363922 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d5fc2-0d9b-43f7-a7c0-e04dcb268fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:16.364554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d5fc2-0d9b-43f7-a7c0-e04dcb268fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:16.364853 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d5fc2-0d9b-43f7-a7c0-e04dcb268fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:16.365106 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d5fc2-0d9b-43f7-a7c0-e04dcb268fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:16.365748 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d5fc2-0d9b-43f7-a7c0-e04dcb268fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:16.367661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d5fc2-0d9b-43f7-a7c0-e04dcb268fb2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:16.375058 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1181/2394] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:16 2022] DELETE /identity/v3/users/bbf0b4001bd04f99bcb48b2e64291399 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:16.380198 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c75f20-d78c-44a7-bf0b-517fc56adea8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:16.380589 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c75f20-d78c-44a7-bf0b-517fc56adea8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:16.380879 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c75f20-d78c-44a7-bf0b-517fc56adea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:16.393759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1214/2395] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:16 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:34:16.393759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f180-6fc6-433f-873d-40afd0798d14 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:16.393759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f180-6fc6-433f-873d-40afd0798d14 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:16.393759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f180-6fc6-433f-873d-40afd0798d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:16.401103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b4c75f20-d78c-44a7-bf0b-517fc56adea8 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:16.402315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b4c75f20-d78c-44a7-bf0b-517fc56adea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:16.411442 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3b20f180-6fc6-433f-873d-40afd0798d14 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:16.412642 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3b20f180-6fc6-433f-873d-40afd0798d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:16.436848 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:16.464981 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1182/2396] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:16.465824 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c75f20-d78c-44a7-bf0b-517fc56adea8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:16.469165 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b4c75f20-d78c-44a7-bf0b-517fc56adea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:16.480175 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1215/2397] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Oct 17 10:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:16.480653 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c75f20-d78c-44a7-bf0b-517fc56adea8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:16.482082 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20f180-6fc6-433f-873d-40afd0798d14 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:16.483331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3b20f180-6fc6-433f-873d-40afd0798d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:16.485950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf554e9-b67d-4f9b-986c-c7d67f966861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:16.486543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf554e9-b67d-4f9b-986c-c7d67f966861 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:16.486819 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf554e9-b67d-4f9b-986c-c7d67f966861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:16.487089 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf554e9-b67d-4f9b-986c-c7d67f966861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:16.487755 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf554e9-b67d-4f9b-986c-c7d67f966861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:16.488477 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:16.489583 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf554e9-b67d-4f9b-986c-c7d67f966861 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:16.504563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1183/2398] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:16.504563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf554e9-b67d-4f9b-986c-c7d67f966861 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:16.504563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aaf554e9-b67d-4f9b-986c-c7d67f966861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:16.542625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20f180-6fc6-433f-873d-40afd0798d14 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:16.546919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368eec2-13fa-4227-8835-564fe7ff8b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:16.547526 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368eec2-13fa-4227-8835-564fe7ff8b8e service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:16.547808 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368eec2-13fa-4227-8835-564fe7ff8b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:16.548187 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368eec2-13fa-4227-8835-564fe7ff8b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:16.557285 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368eec2-13fa-4227-8835-564fe7ff8b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:16.558724 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368eec2-13fa-4227-8835-564fe7ff8b8e service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:16.568989 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1216/2399] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:16.569773 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368eec2-13fa-4227-8835-564fe7ff8b8e service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:16.577633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf554e9-b67d-4f9b-986c-c7d67f966861 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:16.579073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368eec2-13fa-4227-8835-564fe7ff8b8e service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:16.583421 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf0f99-e526-4198-8f54-968e8439463b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:16.583581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cb7cb-8d3d-4148-9775-30f955bec6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:16.584097 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf0f99-e526-4198-8f54-968e8439463b service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:16.584232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cb7cb-8d3d-4148-9775-30f955bec6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:16.584337 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf0f99-e526-4198-8f54-968e8439463b service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:16.584443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cb7cb-8d3d-4148-9775-30f955bec6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:16.584631 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cb7cb-8d3d-4148-9775-30f955bec6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:16.584746 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf0f99-e526-4198-8f54-968e8439463b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:16.585271 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cb7cb-8d3d-4148-9775-30f955bec6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:16.586978 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cb7cb-8d3d-4148-9775-30f955bec6d5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:16.593810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf0f99-e526-4198-8f54-968e8439463b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:16.595425 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf0f99-e526-4198-8f54-968e8439463b service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:16.600097 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1217/2400] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:16.603111 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cb7cb-8d3d-4148-9775-30f955bec6d5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:16.606042 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1184/2401] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:16.613824 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cb7cb-8d3d-4148-9775-30f955bec6d5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:16.618558 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b6e59-c774-4152-b7c5-6d5e00d26814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:16.619215 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b6e59-c774-4152-b7c5-6d5e00d26814 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:16.619495 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b6e59-c774-4152-b7c5-6d5e00d26814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:16.619773 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b6e59-c774-4152-b7c5-6d5e00d26814 admin admin] PATH_INFO: `/v3/projects/b981090c54734257871a415708f0527c/users/1f8cfa7b547148299f9bbfc49f11c791/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:16.636808 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b6e59-c774-4152-b7c5-6d5e00d26814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b981090c54734257871a415708f0527c, user_id=1f8cfa7b547148299f9bbfc49f11c791, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:16.639518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b6e59-c774-4152-b7c5-6d5e00d26814 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:16.655239 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1218/2402] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:16 2022] PUT /identity/v3/projects/b981090c54734257871a415708f0527c/users/1f8cfa7b547148299f9bbfc49f11c791/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:16.665534 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf6e95-fa16-4a3d-afc9-72c1abcd52fd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:16.665900 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf6e95-fa16-4a3d-afc9-72c1abcd52fd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:16.666251 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf6e95-fa16-4a3d-afc9-72c1abcd52fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:16.701606 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c0cf6e95-fa16-4a3d-afc9-72c1abcd52fd None None] MFA Rules not processed for user `1f8cfa7b547148299f9bbfc49f11c791`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:16.703030 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c0cf6e95-fa16-4a3d-afc9-72c1abcd52fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:16.782622 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1185/2403] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:16.795387 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b6e59-c774-4152-b7c5-6d5e00d26814 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:16.797276 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4f9b6e59-c774-4152-b7c5-6d5e00d26814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:16.863750 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b6e59-c774-4152-b7c5-6d5e00d26814 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:16.867509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063d0ac-a971-47ad-ad45-28db287296c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:16.870088 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063d0ac-a971-47ad-ad45-28db287296c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:16.870387 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063d0ac-a971-47ad-ad45-28db287296c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:16.870647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063d0ac-a971-47ad-ad45-28db287296c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:16.879961 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063d0ac-a971-47ad-ad45-28db287296c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:16.881406 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063d0ac-a971-47ad-ad45-28db287296c5 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:16.893705 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf6e95-fa16-4a3d-afc9-72c1abcd52fd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:16.904770 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c0cf6e95-fa16-4a3d-afc9-72c1abcd52fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:16.908139 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1219/2404] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:16.972050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:16.995231 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf6e95-fa16-4a3d-afc9-72c1abcd52fd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:17.008396 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af50e7-d365-49fc-82d6-eca5a1936b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:17.009864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af50e7-d365-49fc-82d6-eca5a1936b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:17.013756 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af50e7-d365-49fc-82d6-eca5a1936b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:17.014309 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af50e7-d365-49fc-82d6-eca5a1936b9a admin admin] PATH_INFO: `/v3/projects/c3c184bb282848a4b492079a5aae3baa` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:17.016675 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af50e7-d365-49fc-82d6-eca5a1936b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c184bb282848a4b492079a5aae3baa)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:17.019108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af50e7-d365-49fc-82d6-eca5a1936b9a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:17.084462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b3af50e7-d365-49fc-82d6-eca5a1936b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c184bb282848a4b492079a5aae3baa', 'request_id': 'req-b3af50e7-d365-49fc-82d6-eca5a1936b9a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:17.094214 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b3af50e7-d365-49fc-82d6-eca5a1936b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c184bb282848a4b492079a5aae3baa', 'request_id': 'req-b3af50e7-d365-49fc-82d6-eca5a1936b9a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:17.102027 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b3af50e7-d365-49fc-82d6-eca5a1936b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c184bb282848a4b492079a5aae3baa', 'request_id': 'req-b3af50e7-d365-49fc-82d6-eca5a1936b9a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:17.117390 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b3af50e7-d365-49fc-82d6-eca5a1936b9a admin admin] The token cache is being invalidate because project c3c184bb282848a4b492079a5aae3baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:17.117945 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b3af50e7-d365-49fc-82d6-eca5a1936b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:17.118821 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b3af50e7-d365-49fc-82d6-eca5a1936b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:17.121359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1186/2405] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:16 2022] DELETE /identity/v3/projects/c3c184bb282848a4b492079a5aae3baa => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:17.126306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e89e22-05f0-4412-9719-2f158d0a783f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:17.126822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e89e22-05f0-4412-9719-2f158d0a783f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:17.127098 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e89e22-05f0-4412-9719-2f158d0a783f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:17.150116 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d9e89e22-05f0-4412-9719-2f158d0a783f None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:17.153605 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d9e89e22-05f0-4412-9719-2f158d0a783f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:17.266100 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1220/2406] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:17.274233 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092fa3b-ab58-446d-877c-23745b38ac91 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:17.274680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092fa3b-ab58-446d-877c-23745b38ac91 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:17.275245 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092fa3b-ab58-446d-877c-23745b38ac91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:17.300132 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9092fa3b-ab58-446d-877c-23745b38ac91 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:17.301561 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9092fa3b-ab58-446d-877c-23745b38ac91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:17.310763 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1187/2407] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:17.315343 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e89e22-05f0-4412-9719-2f158d0a783f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:17.325798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e89e22-05f0-4412-9719-2f158d0a783f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:17.330930 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf1edb-666d-4c9a-8247-b251f260047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:17.331562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf1edb-666d-4c9a-8247-b251f260047e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:17.331840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf1edb-666d-4c9a-8247-b251f260047e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:17.332142 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf1edb-666d-4c9a-8247-b251f260047e admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:17.332838 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf1edb-666d-4c9a-8247-b251f260047e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:34:17.333074 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf1edb-666d-4c9a-8247-b251f260047e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:17.334768 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf1edb-666d-4c9a-8247-b251f260047e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:17.344611 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:17.348691 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1221/2408] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:34:17.352777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092fa3b-ab58-446d-877c-23745b38ac91 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:17.362393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092fa3b-ab58-446d-877c-23745b38ac91 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:17.367053 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13fd30-4ba5-4559-a2ad-f48457a828e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:17.367648 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13fd30-4ba5-4559-a2ad-f48457a828e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:17.367950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13fd30-4ba5-4559-a2ad-f48457a828e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:17.368230 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13fd30-4ba5-4559-a2ad-f48457a828e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:17.368874 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13fd30-4ba5-4559-a2ad-f48457a828e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:17.370765 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13fd30-4ba5-4559-a2ad-f48457a828e7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:17.398372 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1188/2409] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:17 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:17.402514 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf1edb-666d-4c9a-8247-b251f260047e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:17.412312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf1edb-666d-4c9a-8247-b251f260047e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:17.468341 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9381d9-952e-4811-bc06-03a4a58708c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:17.468944 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9381d9-952e-4811-bc06-03a4a58708c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:17.469221 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9381d9-952e-4811-bc06-03a4a58708c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:17.469492 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9381d9-952e-4811-bc06-03a4a58708c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:17.470109 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9381d9-952e-4811-bc06-03a4a58708c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:17.472055 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9381d9-952e-4811-bc06-03a4a58708c3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:17.493264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1222/2410] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:17 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:17.497821 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13fd30-4ba5-4559-a2ad-f48457a828e7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:17.508456 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13fd30-4ba5-4559-a2ad-f48457a828e7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:17.513881 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce61639-f51e-47c3-b710-88ba6969ddf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:17.514473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce61639-f51e-47c3-b710-88ba6969ddf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:17.514807 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce61639-f51e-47c3-b710-88ba6969ddf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:17.515085 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce61639-f51e-47c3-b710-88ba6969ddf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:17.515716 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce61639-f51e-47c3-b710-88ba6969ddf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:17.517332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce61639-f51e-47c3-b710-88ba6969ddf6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:17.527344 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1189/2411] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:17.531355 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9381d9-952e-4811-bc06-03a4a58708c3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:17.541351 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9381d9-952e-4811-bc06-03a4a58708c3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:17.546063 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf02c90-8634-4d76-bc02-26d38a5c4f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:17.546651 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf02c90-8634-4d76-bc02-26d38a5c4f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:17.546930 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf02c90-8634-4d76-bc02-26d38a5c4f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:17.547203 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf02c90-8634-4d76-bc02-26d38a5c4f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:17.547844 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf02c90-8634-4d76-bc02-26d38a5c4f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:17.549460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf02c90-8634-4d76-bc02-26d38a5c4f12 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:17.560746 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1223/2412] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:17.564763 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce61639-f51e-47c3-b710-88ba6969ddf6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:17.574606 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce61639-f51e-47c3-b710-88ba6969ddf6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:17.579935 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d8a80-179d-430f-ac5a-a62fff417ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:17.580585 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d8a80-179d-430f-ac5a-a62fff417ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:17.580861 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d8a80-179d-430f-ac5a-a62fff417ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:17.581130 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d8a80-179d-430f-ac5a-a62fff417ae7 admin admin] PATH_INFO: `/v3/projects/6ac35f764fcf43f69f70d158a7e5ccd9/users/2b927c1239e14d08983cee755a8d1373/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:17.595187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d8a80-179d-430f-ac5a-a62fff417ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac35f764fcf43f69f70d158a7e5ccd9, user_id=2b927c1239e14d08983cee755a8d1373, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:17.597924 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d8a80-179d-430f-ac5a-a62fff417ae7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:17.610559 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1190/2413] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:17 2022] PUT /identity/v3/projects/6ac35f764fcf43f69f70d158a7e5ccd9/users/2b927c1239e14d08983cee755a8d1373/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:17.621376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cedd5-71b9-4ff7-bc07-efe2f83f3032 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:17.622168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cedd5-71b9-4ff7-bc07-efe2f83f3032 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:17.622440 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cedd5-71b9-4ff7-bc07-efe2f83f3032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:17.650943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-eb6cedd5-71b9-4ff7-bc07-efe2f83f3032 None None] MFA Rules not processed for user `2b927c1239e14d08983cee755a8d1373`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:17.652188 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-eb6cedd5-71b9-4ff7-bc07-efe2f83f3032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:17.713522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1224/2414] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:17.718217 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d8a80-179d-430f-ac5a-a62fff417ae7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:17.780649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d8a80-179d-430f-ac5a-a62fff417ae7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:17.785130 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a90f03-d4fc-4dba-aaa9-a940ea118530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:17.785723 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a90f03-d4fc-4dba-aaa9-a940ea118530 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:17.785998 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a90f03-d4fc-4dba-aaa9-a940ea118530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:17.786267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a90f03-d4fc-4dba-aaa9-a940ea118530 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:17.786884 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a90f03-d4fc-4dba-aaa9-a940ea118530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:17.788807 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a90f03-d4fc-4dba-aaa9-a940ea118530 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:17.803098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:17.816893 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1191/2415] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:17 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:34:17.820965 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cedd5-71b9-4ff7-bc07-efe2f83f3032 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:17.832595 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cedd5-71b9-4ff7-bc07-efe2f83f3032 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:17.889845 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60866f-4077-4580-9b2c-70faaeb36c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:17.890444 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60866f-4077-4580-9b2c-70faaeb36c45 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:17.890756 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60866f-4077-4580-9b2c-70faaeb36c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:17.891029 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60866f-4077-4580-9b2c-70faaeb36c45 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:17.891652 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60866f-4077-4580-9b2c-70faaeb36c45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:17.893619 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60866f-4077-4580-9b2c-70faaeb36c45 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:17.909119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:17.919593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1225/2416] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:17 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:17.920857 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a90f03-d4fc-4dba-aaa9-a940ea118530 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:17.931050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a90f03-d4fc-4dba-aaa9-a940ea118530 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:17.936692 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9676e-99d3-44bd-bf12-46ab681409b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:17.937274 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9676e-99d3-44bd-bf12-46ab681409b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:17.937549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9676e-99d3-44bd-bf12-46ab681409b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:17.937901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9676e-99d3-44bd-bf12-46ab681409b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:17.938608 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9676e-99d3-44bd-bf12-46ab681409b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:17.940222 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9676e-99d3-44bd-bf12-46ab681409b9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:17.950532 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1192/2417] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:17.954571 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60866f-4077-4580-9b2c-70faaeb36c45 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:17.964752 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60866f-4077-4580-9b2c-70faaeb36c45 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:17.969499 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a89488-9385-4c8a-b9ea-2e287245579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:17.970259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a89488-9385-4c8a-b9ea-2e287245579c admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:17.970616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a89488-9385-4c8a-b9ea-2e287245579c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:17.970757 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a89488-9385-4c8a-b9ea-2e287245579c admin admin] PATH_INFO: `/v3/projects/073e5102173840c28475e79bd7cc3d32/users/046f093ffad74f3d983a345fcb7eae20/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:17.985837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a89488-9385-4c8a-b9ea-2e287245579c admin admin] RBAC: Authorizing `identity:create_grant(project_id=073e5102173840c28475e79bd7cc3d32, user_id=046f093ffad74f3d983a345fcb7eae20, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:17.988603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a89488-9385-4c8a-b9ea-2e287245579c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:18.001861 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1226/2418] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:17 2022] PUT /identity/v3/projects/073e5102173840c28475e79bd7cc3d32/users/046f093ffad74f3d983a345fcb7eae20/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:18.006317 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9676e-99d3-44bd-bf12-46ab681409b9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:18.017015 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9676e-99d3-44bd-bf12-46ab681409b9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:18.083597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55600dc0-f3f2-4a0e-bc9b-3ae8a92b587b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:18.084246 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600dc0-f3f2-4a0e-bc9b-3ae8a92b587b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:18.084527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600dc0-f3f2-4a0e-bc9b-3ae8a92b587b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:18.084800 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600dc0-f3f2-4a0e-bc9b-3ae8a92b587b admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:18.085441 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55600dc0-f3f2-4a0e-bc9b-3ae8a92b587b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:18.087031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55600dc0-f3f2-4a0e-bc9b-3ae8a92b587b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:18.097506 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1193/2419] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:34:18.101728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a89488-9385-4c8a-b9ea-2e287245579c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:18.112750 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a89488-9385-4c8a-b9ea-2e287245579c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:18.117457 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837eedb-d9f8-4882-b748-58e31a7972ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:18.118102 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837eedb-d9f8-4882-b748-58e31a7972ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:18.118382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837eedb-d9f8-4882-b748-58e31a7972ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:18.118656 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837eedb-d9f8-4882-b748-58e31a7972ce admin admin] PATH_INFO: `/v3/projects/073e5102173840c28475e79bd7cc3d32/users/046f093ffad74f3d983a345fcb7eae20/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:18.120622 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837eedb-d9f8-4882-b748-58e31a7972ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=073e5102173840c28475e79bd7cc3d32, user_id=046f093ffad74f3d983a345fcb7eae20, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:18.123271 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837eedb-d9f8-4882-b748-58e31a7972ce admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:18.133643 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1227/2420] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:18 2022] PUT /identity/v3/projects/073e5102173840c28475e79bd7cc3d32/users/046f093ffad74f3d983a345fcb7eae20/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:18.143735 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa7336-9a5a-445b-ab73-2dc0722a8749 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:18.144149 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa7336-9a5a-445b-ab73-2dc0722a8749 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:18.144351 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa7336-9a5a-445b-ab73-2dc0722a8749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:18.172467 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-aafa7336-9a5a-445b-ab73-2dc0722a8749 None None] MFA Rules not processed for user `046f093ffad74f3d983a345fcb7eae20`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:18.173678 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aafa7336-9a5a-445b-ab73-2dc0722a8749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:18.240409 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1194/2421] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:18.251016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837eedb-d9f8-4882-b748-58e31a7972ce admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:18.252878 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9837eedb-d9f8-4882-b748-58e31a7972ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:18.312106 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837eedb-d9f8-4882-b748-58e31a7972ce admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:18.315866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84cf96-da16-4e18-8974-0d88f50dd5a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:18.316515 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84cf96-da16-4e18-8974-0d88f50dd5a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:18.316793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84cf96-da16-4e18-8974-0d88f50dd5a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:18.317061 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84cf96-da16-4e18-8974-0d88f50dd5a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:18.378989 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84cf96-da16-4e18-8974-0d88f50dd5a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:18.380741 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84cf96-da16-4e18-8974-0d88f50dd5a3 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:18.390115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1228/2422] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:19.723250 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e96602-9aa2-42d6-ac93-0acb3c4fd1e0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:19.723777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e96602-9aa2-42d6-ac93-0acb3c4fd1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:19.723777 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e96602-9aa2-42d6-ac93-0acb3c4fd1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:19.744191 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d5e96602-9aa2-42d6-ac93-0acb3c4fd1e0 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:19.745471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d5e96602-9aa2-42d6-ac93-0acb3c4fd1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:19.805103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1195/2423] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Oct 17 10:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:19.823877 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84cf96-da16-4e18-8974-0d88f50dd5a3 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:19.825335 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cd84cf96-da16-4e18-8974-0d88f50dd5a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:19.907853 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84cf96-da16-4e18-8974-0d88f50dd5a3 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:19.913454 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a457d6-3eb2-4de8-a5b5-e2b7035fb4de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:19.914210 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a457d6-3eb2-4de8-a5b5-e2b7035fb4de service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:19.914485 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a457d6-3eb2-4de8-a5b5-e2b7035fb4de service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:19.914755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a457d6-3eb2-4de8-a5b5-e2b7035fb4de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:19.924584 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a457d6-3eb2-4de8-a5b5-e2b7035fb4de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:19.926377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a457d6-3eb2-4de8-a5b5-e2b7035fb4de service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:19.931946 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:19.937516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1229/2424] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:20.975406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e96602-9aa2-42d6-ac93-0acb3c4fd1e0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:20.981553 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:20.985236 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e96602-9aa2-42d6-ac93-0acb3c4fd1e0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:20.990743 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40591b09-1bba-4539-b468-81f33f5b5804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:20.991358 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40591b09-1bba-4539-b468-81f33f5b5804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:20.991638 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40591b09-1bba-4539-b468-81f33f5b5804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:20.991953 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40591b09-1bba-4539-b468-81f33f5b5804 admin admin] PATH_INFO: `/v3/users/2b927c1239e14d08983cee755a8d1373` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:20.993082 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40591b09-1bba-4539-b468-81f33f5b5804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b927c1239e14d08983cee755a8d1373)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:20.995011 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40591b09-1bba-4539-b468-81f33f5b5804 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:21.041508 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-40591b09-1bba-4539-b468-81f33f5b5804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b927c1239e14d08983cee755a8d1373'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:21.042190 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-40591b09-1bba-4539-b468-81f33f5b5804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b927c1239e14d08983cee755a8d1373'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:21.049229 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-40591b09-1bba-4539-b468-81f33f5b5804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b927c1239e14d08983cee755a8d1373'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:21.049877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-40591b09-1bba-4539-b468-81f33f5b5804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b927c1239e14d08983cee755a8d1373'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:21.060818 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-40591b09-1bba-4539-b468-81f33f5b5804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b927c1239e14d08983cee755a8d1373'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:21.078787 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1196/2425] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:20 2022] DELETE /identity/v3/users/2b927c1239e14d08983cee755a8d1373 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:21.083472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f846e86-c369-483f-b4b5-1f7578907571 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:21.083955 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f846e86-c369-483f-b4b5-1f7578907571 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:21.084059 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f846e86-c369-483f-b4b5-1f7578907571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:21.102624 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8f846e86-c369-483f-b4b5-1f7578907571 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:21.103822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8f846e86-c369-483f-b4b5-1f7578907571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:21.162325 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1230/2426] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:21.171978 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40591b09-1bba-4539-b468-81f33f5b5804 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:21.173390 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-40591b09-1bba-4539-b468-81f33f5b5804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:21.231827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40591b09-1bba-4539-b468-81f33f5b5804 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:21.235492 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86198bc8-f84a-4797-af06-8d166d924332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:21.236199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86198bc8-f84a-4797-af06-8d166d924332 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:21.236481 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86198bc8-f84a-4797-af06-8d166d924332 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:21.236830 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86198bc8-f84a-4797-af06-8d166d924332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:21.245953 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86198bc8-f84a-4797-af06-8d166d924332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:21.247391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86198bc8-f84a-4797-af06-8d166d924332 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:21.257724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1197/2427] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:21.541569 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f846e86-c369-483f-b4b5-1f7578907571 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:21.542997 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8f846e86-c369-483f-b4b5-1f7578907571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:21.555635 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f846e86-c369-483f-b4b5-1f7578907571 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:21.561140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ca2c3-a61d-4228-a936-089ebddc1234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:21.561779 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ca2c3-a61d-4228-a936-089ebddc1234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:21.562057 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ca2c3-a61d-4228-a936-089ebddc1234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:21.562327 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ca2c3-a61d-4228-a936-089ebddc1234 admin admin] PATH_INFO: `/v3/projects/6ac35f764fcf43f69f70d158a7e5ccd9` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:21.563459 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ca2c3-a61d-4228-a936-089ebddc1234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ac35f764fcf43f69f70d158a7e5ccd9)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:21.565427 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ca2c3-a61d-4228-a936-089ebddc1234 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:21.616485 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d21ca2c3-a61d-4228-a936-089ebddc1234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac35f764fcf43f69f70d158a7e5ccd9', 'request_id': 'req-d21ca2c3-a61d-4228-a936-089ebddc1234'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:21.624564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d21ca2c3-a61d-4228-a936-089ebddc1234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac35f764fcf43f69f70d158a7e5ccd9', 'request_id': 'req-d21ca2c3-a61d-4228-a936-089ebddc1234'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:21.631176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d21ca2c3-a61d-4228-a936-089ebddc1234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac35f764fcf43f69f70d158a7e5ccd9', 'request_id': 'req-d21ca2c3-a61d-4228-a936-089ebddc1234'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:21.642290 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d21ca2c3-a61d-4228-a936-089ebddc1234 admin admin] The token cache is being invalidate because project 6ac35f764fcf43f69f70d158a7e5ccd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:21.642578 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d21ca2c3-a61d-4228-a936-089ebddc1234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:21.643239 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d21ca2c3-a61d-4228-a936-089ebddc1234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:21.644771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1231/2428] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:21 2022] DELETE /identity/v3/projects/6ac35f764fcf43f69f70d158a7e5ccd9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:21.648812 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86198bc8-f84a-4797-af06-8d166d924332 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:21.658411 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86198bc8-f84a-4797-af06-8d166d924332 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:21.714225 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51714e23-503f-435f-b9ca-7e03ba69e9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:21.714843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51714e23-503f-435f-b9ca-7e03ba69e9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:21.715131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51714e23-503f-435f-b9ca-7e03ba69e9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:21.715403 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51714e23-503f-435f-b9ca-7e03ba69e9d6 admin admin] PATH_INFO: `/v3/users/046f093ffad74f3d983a345fcb7eae20` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:21.716579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51714e23-503f-435f-b9ca-7e03ba69e9d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=046f093ffad74f3d983a345fcb7eae20)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:21.718496 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51714e23-503f-435f-b9ca-7e03ba69e9d6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:21.743091 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:21.771174 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-51714e23-503f-435f-b9ca-7e03ba69e9d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '046f093ffad74f3d983a345fcb7eae20'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:21.771831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-51714e23-503f-435f-b9ca-7e03ba69e9d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '046f093ffad74f3d983a345fcb7eae20'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:21.779391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-51714e23-503f-435f-b9ca-7e03ba69e9d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '046f093ffad74f3d983a345fcb7eae20'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:21.780108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-51714e23-503f-435f-b9ca-7e03ba69e9d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '046f093ffad74f3d983a345fcb7eae20'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:21.788206 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-51714e23-503f-435f-b9ca-7e03ba69e9d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '046f093ffad74f3d983a345fcb7eae20'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:21.827075 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1198/2429] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:21 2022] DELETE /identity/v3/users/046f093ffad74f3d983a345fcb7eae20 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:22.109142 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ca2c3-a61d-4228-a936-089ebddc1234 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:22.110586 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d21ca2c3-a61d-4228-a936-089ebddc1234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:22.123958 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ca2c3-a61d-4228-a936-089ebddc1234 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:22.181531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333d2b4-7bb9-4982-8635-e38a8c1192c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:22.182168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333d2b4-7bb9-4982-8635-e38a8c1192c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:22.182446 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333d2b4-7bb9-4982-8635-e38a8c1192c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:22.182719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333d2b4-7bb9-4982-8635-e38a8c1192c4 admin admin] PATH_INFO: `/v3/projects/073e5102173840c28475e79bd7cc3d32` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:22.183862 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333d2b4-7bb9-4982-8635-e38a8c1192c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=073e5102173840c28475e79bd7cc3d32)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:22.185830 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333d2b4-7bb9-4982-8635-e38a8c1192c4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:22.216300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:22.234129 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d333d2b4-7bb9-4982-8635-e38a8c1192c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073e5102173840c28475e79bd7cc3d32', 'request_id': 'req-d333d2b4-7bb9-4982-8635-e38a8c1192c4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:22.240871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d333d2b4-7bb9-4982-8635-e38a8c1192c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073e5102173840c28475e79bd7cc3d32', 'request_id': 'req-d333d2b4-7bb9-4982-8635-e38a8c1192c4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:22.247116 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d333d2b4-7bb9-4982-8635-e38a8c1192c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073e5102173840c28475e79bd7cc3d32', 'request_id': 'req-d333d2b4-7bb9-4982-8635-e38a8c1192c4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:22.257388 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d333d2b4-7bb9-4982-8635-e38a8c1192c4 admin admin] The token cache is being invalidate because project 073e5102173840c28475e79bd7cc3d32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:22.257671 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d333d2b4-7bb9-4982-8635-e38a8c1192c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:22.258307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d333d2b4-7bb9-4982-8635-e38a8c1192c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:22.259763 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1232/2430] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:22 2022] DELETE /identity/v3/projects/073e5102173840c28475e79bd7cc3d32 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:22.265353 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f186a-90fd-4495-9eb7-cd61c0ae041d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:22.265830 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f186a-90fd-4495-9eb7-cd61c0ae041d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:22.265927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f186a-90fd-4495-9eb7-cd61c0ae041d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:22.285753 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9d9f186a-90fd-4495-9eb7-cd61c0ae041d None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:22.286960 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9d9f186a-90fd-4495-9eb7-cd61c0ae041d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:22.346391 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1199/2431] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:22.354042 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769093c1-ae88-4c49-a15c-c2783d136ac6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:22.354331 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769093c1-ae88-4c49-a15c-c2783d136ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:22.354602 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769093c1-ae88-4c49-a15c-c2783d136ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:22.375043 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-769093c1-ae88-4c49-a15c-c2783d136ac6 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:22.376274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-769093c1-ae88-4c49-a15c-c2783d136ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:22.384432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1233/2432] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:22.388613 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f186a-90fd-4495-9eb7-cd61c0ae041d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:22.398301 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f186a-90fd-4495-9eb7-cd61c0ae041d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:22.403100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b45bbe-5694-4065-98ab-b3669ca6d920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:22.403695 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b45bbe-5694-4065-98ab-b3669ca6d920 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:22.404014 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b45bbe-5694-4065-98ab-b3669ca6d920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:22.404304 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b45bbe-5694-4065-98ab-b3669ca6d920 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:22.404953 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b45bbe-5694-4065-98ab-b3669ca6d920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:34:22.405256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b45bbe-5694-4065-98ab-b3669ca6d920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:22.406889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b45bbe-5694-4065-98ab-b3669ca6d920 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:22.419106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1200/2433] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:34:22.423822 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769093c1-ae88-4c49-a15c-c2783d136ac6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:22.433444 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769093c1-ae88-4c49-a15c-c2783d136ac6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:22.438805 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c95e4-dcd6-4ebd-8815-d39d7b131009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:22.439428 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c95e4-dcd6-4ebd-8815-d39d7b131009 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:22.439703 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c95e4-dcd6-4ebd-8815-d39d7b131009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:22.440001 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c95e4-dcd6-4ebd-8815-d39d7b131009 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:22.440668 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c95e4-dcd6-4ebd-8815-d39d7b131009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:22.442594 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c95e4-dcd6-4ebd-8815-d39d7b131009 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:22.474502 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1234/2434] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:22 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:22.475722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b45bbe-5694-4065-98ab-b3669ca6d920 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:22.487153 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b45bbe-5694-4065-98ab-b3669ca6d920 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:22.548657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d3774-59e7-4e81-b82f-5b12d90f36f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:22.549275 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3774-59e7-4e81-b82f-5b12d90f36f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:22.549597 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3774-59e7-4e81-b82f-5b12d90f36f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:22.549876 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3774-59e7-4e81-b82f-5b12d90f36f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:22.550585 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d3774-59e7-4e81-b82f-5b12d90f36f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:22.552677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d3774-59e7-4e81-b82f-5b12d90f36f6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:22.574273 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1201/2435] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:22 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:22.578529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c95e4-dcd6-4ebd-8815-d39d7b131009 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:22.589441 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c95e4-dcd6-4ebd-8815-d39d7b131009 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:22.596589 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1d77b-ed25-49ac-8a07-ee46e5fc8f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:22.597199 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1d77b-ed25-49ac-8a07-ee46e5fc8f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:22.597476 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1d77b-ed25-49ac-8a07-ee46e5fc8f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:22.597749 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1d77b-ed25-49ac-8a07-ee46e5fc8f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:22.598399 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1d77b-ed25-49ac-8a07-ee46e5fc8f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:22.600009 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1d77b-ed25-49ac-8a07-ee46e5fc8f83 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:22.611970 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1235/2436] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:34:22.615712 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d3774-59e7-4e81-b82f-5b12d90f36f6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:22.629726 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d3774-59e7-4e81-b82f-5b12d90f36f6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:22.639112 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e8f07-1116-4c0f-96dd-f6380881ac3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:22.639736 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e8f07-1116-4c0f-96dd-f6380881ac3d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:22.640054 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e8f07-1116-4c0f-96dd-f6380881ac3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:22.640333 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e8f07-1116-4c0f-96dd-f6380881ac3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:22.641065 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e8f07-1116-4c0f-96dd-f6380881ac3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:22.642901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e8f07-1116-4c0f-96dd-f6380881ac3d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:22.665820 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1202/2437] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:22.670205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1d77b-ed25-49ac-8a07-ee46e5fc8f83 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:22.681571 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1d77b-ed25-49ac-8a07-ee46e5fc8f83 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:22.686719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a723ef7-1704-484d-afb7-94a5e763ee4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:22.687381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a723ef7-1704-484d-afb7-94a5e763ee4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:22.687667 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a723ef7-1704-484d-afb7-94a5e763ee4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:22.687965 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a723ef7-1704-484d-afb7-94a5e763ee4e admin admin] PATH_INFO: `/v3/projects/dc51a09cbbf24b878bdd3455dce958a0/users/61774171311d4f06ac7178ac159a0505/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:22.704265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a723ef7-1704-484d-afb7-94a5e763ee4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc51a09cbbf24b878bdd3455dce958a0, user_id=61774171311d4f06ac7178ac159a0505, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:22.707142 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a723ef7-1704-484d-afb7-94a5e763ee4e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:22.722604 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1236/2438] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:22 2022] PUT /identity/v3/projects/dc51a09cbbf24b878bdd3455dce958a0/users/61774171311d4f06ac7178ac159a0505/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:22.788481 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00de8-6954-49da-b378-ec956c94e62d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:22.788696 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00de8-6954-49da-b378-ec956c94e62d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:22.788918 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00de8-6954-49da-b378-ec956c94e62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:22.797704 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:22.818758 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c4d00de8-6954-49da-b378-ec956c94e62d None None] MFA Rules not processed for user `61774171311d4f06ac7178ac159a0505`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:22.819998 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c4d00de8-6954-49da-b378-ec956c94e62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:22.884462 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1203/2439] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:22.889451 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a723ef7-1704-484d-afb7-94a5e763ee4e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:22.906266 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d308-bf68-4405-8945-7451b1ab1483 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:22.906552 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d308-bf68-4405-8945-7451b1ab1483 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:22.906853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d308-bf68-4405-8945-7451b1ab1483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:22.926496 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dfb9d308-bf68-4405-8945-7451b1ab1483 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:22.928291 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dfb9d308-bf68-4405-8945-7451b1ab1483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:22.964584 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a723ef7-1704-484d-afb7-94a5e763ee4e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:22.971825 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769608f-9cc1-4747-8e1c-826c6c9d4d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:22.972520 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769608f-9cc1-4747-8e1c-826c6c9d4d84 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:22.972807 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769608f-9cc1-4747-8e1c-826c6c9d4d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:22.973587 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769608f-9cc1-4747-8e1c-826c6c9d4d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:22.974240 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769608f-9cc1-4747-8e1c-826c6c9d4d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:22.976489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769608f-9cc1-4747-8e1c-826c6c9d4d84 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:22.994043 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1204/2440] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Oct 17 10:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:23.005465 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1237/2441] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:22 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:34:23.009363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9d308-bf68-4405-8945-7451b1ab1483 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:23.019823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9d308-bf68-4405-8945-7451b1ab1483 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:23.038432 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769608f-9cc1-4747-8e1c-826c6c9d4d84 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:23.040521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7769608f-9cc1-4747-8e1c-826c6c9d4d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:23.092382 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:23.095602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccd6a8-59b0-491c-9fab-c42359e92e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:23.096951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccd6a8-59b0-491c-9fab-c42359e92e63 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:23.097247 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccd6a8-59b0-491c-9fab-c42359e92e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:23.097526 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccd6a8-59b0-491c-9fab-c42359e92e63 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:23.098215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccd6a8-59b0-491c-9fab-c42359e92e63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:23.100194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccd6a8-59b0-491c-9fab-c42359e92e63 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:23.127425 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1205/2442] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:23 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:23.131353 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccd6a8-59b0-491c-9fab-c42359e92e63 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:23.143743 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccd6a8-59b0-491c-9fab-c42359e92e63 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:23.147160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769608f-9cc1-4747-8e1c-826c6c9d4d84 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:23.148914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff2632-4105-478c-b62c-21652e084c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:23.149523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff2632-4105-478c-b62c-21652e084c2a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:23.149793 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff2632-4105-478c-b62c-21652e084c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:23.150064 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff2632-4105-478c-b62c-21652e084c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:23.150709 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff2632-4105-478c-b62c-21652e084c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:23.152604 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff2632-4105-478c-b62c-21652e084c2a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:23.152945 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c800695-e4b9-48e2-adb7-c60c60bf23ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:23.153559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c800695-e4b9-48e2-adb7-c60c60bf23ea service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:23.153844 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c800695-e4b9-48e2-adb7-c60c60bf23ea service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:23.154676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c800695-e4b9-48e2-adb7-c60c60bf23ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:23.165664 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c800695-e4b9-48e2-adb7-c60c60bf23ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:23.166658 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1206/2443] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:34:23.168817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c800695-e4b9-48e2-adb7-c60c60bf23ea service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:23.173082 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff2632-4105-478c-b62c-21652e084c2a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:23.179520 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1238/2444] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:34:23.183624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff2632-4105-478c-b62c-21652e084c2a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:23.188770 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135250f4-4eea-475e-b93e-d19c998c63d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:23.189372 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135250f4-4eea-475e-b93e-d19c998c63d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:23.189649 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135250f4-4eea-475e-b93e-d19c998c63d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:23.189919 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135250f4-4eea-475e-b93e-d19c998c63d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:23.190556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135250f4-4eea-475e-b93e-d19c998c63d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:23.192165 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135250f4-4eea-475e-b93e-d19c998c63d9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:23.207304 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1207/2445] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:23.209341 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c800695-e4b9-48e2-adb7-c60c60bf23ea service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:23.223764 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c800695-e4b9-48e2-adb7-c60c60bf23ea service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:23.230559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d8874-5ee5-4eeb-9a08-346dba2f07fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:23.231647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d8874-5ee5-4eeb-9a08-346dba2f07fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:23.232438 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d8874-5ee5-4eeb-9a08-346dba2f07fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:23.232801 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d8874-5ee5-4eeb-9a08-346dba2f07fd admin admin] PATH_INFO: `/v3/projects/436d66dbfed747e6ba4f7f64ffc7028a/users/11eae589783145b2ba479325ca8fb69d/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:23.251652 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d8874-5ee5-4eeb-9a08-346dba2f07fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=436d66dbfed747e6ba4f7f64ffc7028a, user_id=11eae589783145b2ba479325ca8fb69d, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:23.255052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d8874-5ee5-4eeb-9a08-346dba2f07fd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:23.272628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1239/2446] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:23 2022] PUT /identity/v3/projects/436d66dbfed747e6ba4f7f64ffc7028a/users/11eae589783145b2ba479325ca8fb69d/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:23.283808 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e46ea-e023-4899-8a36-4e96f4ec5e80 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:23.284661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e46ea-e023-4899-8a36-4e96f4ec5e80 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:23.284661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e46ea-e023-4899-8a36-4e96f4ec5e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:23.291974 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:23.321187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4a8e46ea-e023-4899-8a36-4e96f4ec5e80 None None] MFA Rules not processed for user `11eae589783145b2ba479325ca8fb69d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:23.322825 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4a8e46ea-e023-4899-8a36-4e96f4ec5e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:23.394510 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1208/2447] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:23.398890 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d8874-5ee5-4eeb-9a08-346dba2f07fd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:23.459557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d8874-5ee5-4eeb-9a08-346dba2f07fd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:23.464376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9f66a-9eb7-4d7a-96eb-3e202d32b892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:23.464973 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9f66a-9eb7-4d7a-96eb-3e202d32b892 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:23.465257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9f66a-9eb7-4d7a-96eb-3e202d32b892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:23.465527 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9f66a-9eb7-4d7a-96eb-3e202d32b892 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:23.466165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9f66a-9eb7-4d7a-96eb-3e202d32b892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:23.468099 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9f66a-9eb7-4d7a-96eb-3e202d32b892 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:23.494077 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1240/2448] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:23 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:23.498647 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e46ea-e023-4899-8a36-4e96f4ec5e80 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:23.509544 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e46ea-e023-4899-8a36-4e96f4ec5e80 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:23.564841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e892d8-79ce-40ab-aee2-df57cf146a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:23.565379 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e892d8-79ce-40ab-aee2-df57cf146a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:23.565635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e892d8-79ce-40ab-aee2-df57cf146a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:23.565907 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e892d8-79ce-40ab-aee2-df57cf146a67 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:23.566519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e892d8-79ce-40ab-aee2-df57cf146a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:23.568446 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e892d8-79ce-40ab-aee2-df57cf146a67 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:23.589028 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1209/2449] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:23 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:23.592918 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9f66a-9eb7-4d7a-96eb-3e202d32b892 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:23.602810 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9f66a-9eb7-4d7a-96eb-3e202d32b892 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:23.607373 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d2271-7849-4f59-888f-c189213e5e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:23.607987 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d2271-7849-4f59-888f-c189213e5e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:23.608266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d2271-7849-4f59-888f-c189213e5e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:23.608533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d2271-7849-4f59-888f-c189213e5e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:23.609161 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d2271-7849-4f59-888f-c189213e5e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:23.610751 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d2271-7849-4f59-888f-c189213e5e30 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:23.620898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1241/2450] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:23.625206 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e892d8-79ce-40ab-aee2-df57cf146a67 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:23.635338 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e892d8-79ce-40ab-aee2-df57cf146a67 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:23.640661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22069e2c-97d6-4496-aac9-c558f192478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:23.641296 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22069e2c-97d6-4496-aac9-c558f192478e admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:23.641571 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22069e2c-97d6-4496-aac9-c558f192478e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:23.641842 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22069e2c-97d6-4496-aac9-c558f192478e admin admin] PATH_INFO: `/v3/projects/667c916aa9694c42965e6d33c147c4a2/users/46d4bf6f051c487d9868ace99279a87d/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:23.658216 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22069e2c-97d6-4496-aac9-c558f192478e admin admin] RBAC: Authorizing `identity:create_grant(project_id=667c916aa9694c42965e6d33c147c4a2, user_id=46d4bf6f051c487d9868ace99279a87d, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:23.661036 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22069e2c-97d6-4496-aac9-c558f192478e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:23.678479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1210/2451] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:23 2022] PUT /identity/v3/projects/667c916aa9694c42965e6d33c147c4a2/users/46d4bf6f051c487d9868ace99279a87d/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:23.684251 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d2271-7849-4f59-888f-c189213e5e30 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:23.711739 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d2271-7849-4f59-888f-c189213e5e30 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:23.774568 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb3c49-0226-4155-bccf-6a942ea412e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:23.775256 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb3c49-0226-4155-bccf-6a942ea412e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:23.775536 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb3c49-0226-4155-bccf-6a942ea412e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:23.775919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb3c49-0226-4155-bccf-6a942ea412e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:23.776482 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb3c49-0226-4155-bccf-6a942ea412e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:23.778072 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb3c49-0226-4155-bccf-6a942ea412e4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:23.788205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1242/2452] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:23.792360 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22069e2c-97d6-4496-aac9-c558f192478e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:23.802905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22069e2c-97d6-4496-aac9-c558f192478e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:23.807477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fae429-fd34-48b5-ac3d-8f2b17ce52bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:23.808151 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fae429-fd34-48b5-ac3d-8f2b17ce52bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:23.808430 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fae429-fd34-48b5-ac3d-8f2b17ce52bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:23.808730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fae429-fd34-48b5-ac3d-8f2b17ce52bc admin admin] PATH_INFO: `/v3/projects/667c916aa9694c42965e6d33c147c4a2/users/46d4bf6f051c487d9868ace99279a87d/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:23.811148 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fae429-fd34-48b5-ac3d-8f2b17ce52bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=667c916aa9694c42965e6d33c147c4a2, user_id=46d4bf6f051c487d9868ace99279a87d, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:23.813889 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fae429-fd34-48b5-ac3d-8f2b17ce52bc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:23.824324 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1211/2453] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:23 2022] PUT /identity/v3/projects/667c916aa9694c42965e6d33c147c4a2/users/46d4bf6f051c487d9868ace99279a87d/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:23.835713 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0fcb3-fd2e-4124-aa6c-9ba9d3397f68 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:23.836026 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0fcb3-fd2e-4124-aa6c-9ba9d3397f68 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:23.836300 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0fcb3-fd2e-4124-aa6c-9ba9d3397f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:23.849952 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:23.866110 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b3e0fcb3-fd2e-4124-aa6c-9ba9d3397f68 None None] MFA Rules not processed for user `46d4bf6f051c487d9868ace99279a87d`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:23.867326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b3e0fcb3-fd2e-4124-aa6c-9ba9d3397f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:23.948615 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1243/2454] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:23.959857 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fae429-fd34-48b5-ac3d-8f2b17ce52bc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:23.961768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-49fae429-fd34-48b5-ac3d-8f2b17ce52bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:24.018363 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:24.037661 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fae429-fd34-48b5-ac3d-8f2b17ce52bc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:24.044135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da7221-bb66-44be-9dc9-ed578023640b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:24.045565 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da7221-bb66-44be-9dc9-ed578023640b service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:24.045955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da7221-bb66-44be-9dc9-ed578023640b service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:24.046160 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da7221-bb66-44be-9dc9-ed578023640b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:24.114543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da7221-bb66-44be-9dc9-ed578023640b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:24.116036 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da7221-bb66-44be-9dc9-ed578023640b service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:24.125691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1212/2455] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:25.675663 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0fcb3-fd2e-4124-aa6c-9ba9d3397f68 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:25.685167 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0fcb3-fd2e-4124-aa6c-9ba9d3397f68 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:25.689025 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db379f-031f-4c1d-ae49-c3cbe25a5289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:25.689628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db379f-031f-4c1d-ae49-c3cbe25a5289 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:25.689905 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db379f-031f-4c1d-ae49-c3cbe25a5289 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:25.690176 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db379f-031f-4c1d-ae49-c3cbe25a5289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:25.746027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db379f-031f-4c1d-ae49-c3cbe25a5289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:25.747458 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db379f-031f-4c1d-ae49-c3cbe25a5289 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:25.757031 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1244/2456] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:25.943359 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c5af8-26af-4203-85fa-adbdc885aa99 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:25.943920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c5af8-26af-4203-85fa-adbdc885aa99 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:25.943920 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c5af8-26af-4203-85fa-adbdc885aa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:25.965122 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2f0c5af8-26af-4203-85fa-adbdc885aa99 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:25.966393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2f0c5af8-26af-4203-85fa-adbdc885aa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:26.030588 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1213/2457] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Oct 17 10:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:26.057773 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db379f-031f-4c1d-ae49-c3cbe25a5289 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:26.059435 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-73db379f-031f-4c1d-ae49-c3cbe25a5289 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:26.137018 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db379f-031f-4c1d-ae49-c3cbe25a5289 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:26.143522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b076ae-bbc1-40d5-b996-75ff31c0cb02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:26.144228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b076ae-bbc1-40d5-b996-75ff31c0cb02 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:26.144512 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b076ae-bbc1-40d5-b996-75ff31c0cb02 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:26.144788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b076ae-bbc1-40d5-b996-75ff31c0cb02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:26.153525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b076ae-bbc1-40d5-b996-75ff31c0cb02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:26.155294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b076ae-bbc1-40d5-b996-75ff31c0cb02 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:26.166593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1245/2458] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:26.345173 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c5af8-26af-4203-85fa-adbdc885aa99 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:26.354563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c5af8-26af-4203-85fa-adbdc885aa99 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:26.358298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de6dd3-37b9-4630-87d9-fee625e1168e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:26.359492 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de6dd3-37b9-4630-87d9-fee625e1168e service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:26.359770 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de6dd3-37b9-4630-87d9-fee625e1168e service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:26.360070 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de6dd3-37b9-4630-87d9-fee625e1168e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:26.368879 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de6dd3-37b9-4630-87d9-fee625e1168e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:26.370385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de6dd3-37b9-4630-87d9-fee625e1168e service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:26.379854 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1214/2459] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:30.146568 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0947d79-8182-4135-81b1-5e4864885bfa None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:30.147115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0947d79-8182-4135-81b1-5e4864885bfa None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:30.147115 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0947d79-8182-4135-81b1-5e4864885bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:30.168215 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d0947d79-8182-4135-81b1-5e4864885bfa None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:30.169444 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d0947d79-8182-4135-81b1-5e4864885bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:30.177500 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1246/2460] 10.222.0.40 () {58 vars in 1016 bytes} [Mon Oct 17 10:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:30.200821 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de6dd3-37b9-4630-87d9-fee625e1168e service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:30.214416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de6dd3-37b9-4630-87d9-fee625e1168e service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:30.220644 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc30467-d894-4c6a-bb29-36b6a57c359b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:30.221248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc30467-d894-4c6a-bb29-36b6a57c359b service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:30.221525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc30467-d894-4c6a-bb29-36b6a57c359b service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:30.221820 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc30467-d894-4c6a-bb29-36b6a57c359b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:30.230658 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc30467-d894-4c6a-bb29-36b6a57c359b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:30.232286 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc30467-d894-4c6a-bb29-36b6a57c359b service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:30.243179 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1215/2461] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:30.265305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0947d79-8182-4135-81b1-5e4864885bfa None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:30.275038 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0947d79-8182-4135-81b1-5e4864885bfa None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:30.280121 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdabd44-9207-42c4-96bd-61e34c81773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:30.280758 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdabd44-9207-42c4-96bd-61e34c81773e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:30.281046 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdabd44-9207-42c4-96bd-61e34c81773e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:30.281322 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdabd44-9207-42c4-96bd-61e34c81773e admin admin] PATH_INFO: `/v3/users/61774171311d4f06ac7178ac159a0505` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:30.282509 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdabd44-9207-42c4-96bd-61e34c81773e admin admin] RBAC: Authorizing `identity:delete_user(user_id=61774171311d4f06ac7178ac159a0505)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:30.284614 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdabd44-9207-42c4-96bd-61e34c81773e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:30.287337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:30.332290 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ebdabd44-9207-42c4-96bd-61e34c81773e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61774171311d4f06ac7178ac159a0505'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:30.333090 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ebdabd44-9207-42c4-96bd-61e34c81773e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61774171311d4f06ac7178ac159a0505'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:30.340460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ebdabd44-9207-42c4-96bd-61e34c81773e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61774171311d4f06ac7178ac159a0505'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:30.341204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ebdabd44-9207-42c4-96bd-61e34c81773e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61774171311d4f06ac7178ac159a0505'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:30.351542 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ebdabd44-9207-42c4-96bd-61e34c81773e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61774171311d4f06ac7178ac159a0505'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:30.369599 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1247/2462] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:30 2022] DELETE /identity/v3/users/61774171311d4f06ac7178ac159a0505 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:30.374191 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04502-39ae-4fa4-b329-7185b540d231 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:30.374479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04502-39ae-4fa4-b329-7185b540d231 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:30.374754 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04502-39ae-4fa4-b329-7185b540d231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:30.394520 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-29e04502-39ae-4fa4-b329-7185b540d231 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:30.395718 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-29e04502-39ae-4fa4-b329-7185b540d231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:30.463339 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1216/2463] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:30.473857 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdabd44-9207-42c4-96bd-61e34c81773e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:30.477209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ebdabd44-9207-42c4-96bd-61e34c81773e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:30.534909 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdabd44-9207-42c4-96bd-61e34c81773e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:30.538625 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7562bed-1565-4892-ba1c-131931113d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:30.539233 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7562bed-1565-4892-ba1c-131931113d68 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:30.539516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7562bed-1565-4892-ba1c-131931113d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:30.539797 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7562bed-1565-4892-ba1c-131931113d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:30.549364 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7562bed-1565-4892-ba1c-131931113d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:30.550823 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7562bed-1565-4892-ba1c-131931113d68 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:30.560461 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1248/2464] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:30.834772 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e04502-39ae-4fa4-b329-7185b540d231 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:30.836636 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-29e04502-39ae-4fa4-b329-7185b540d231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:30.850473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e04502-39ae-4fa4-b329-7185b540d231 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:30.856575 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86b483-038d-4181-9700-c1d3e6f4ec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:30.857215 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86b483-038d-4181-9700-c1d3e6f4ec1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:30.857500 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86b483-038d-4181-9700-c1d3e6f4ec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:30.858213 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86b483-038d-4181-9700-c1d3e6f4ec1e admin admin] PATH_INFO: `/v3/projects/dc51a09cbbf24b878bdd3455dce958a0` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:30.859869 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86b483-038d-4181-9700-c1d3e6f4ec1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc51a09cbbf24b878bdd3455dce958a0)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:30.862085 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86b483-038d-4181-9700-c1d3e6f4ec1e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:30.871975 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:30.919486 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9c86b483-038d-4181-9700-c1d3e6f4ec1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc51a09cbbf24b878bdd3455dce958a0', 'request_id': 'req-9c86b483-038d-4181-9700-c1d3e6f4ec1e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:30.928333 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9c86b483-038d-4181-9700-c1d3e6f4ec1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc51a09cbbf24b878bdd3455dce958a0', 'request_id': 'req-9c86b483-038d-4181-9700-c1d3e6f4ec1e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:30.935342 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9c86b483-038d-4181-9700-c1d3e6f4ec1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc51a09cbbf24b878bdd3455dce958a0', 'request_id': 'req-9c86b483-038d-4181-9700-c1d3e6f4ec1e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:30.950547 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9c86b483-038d-4181-9700-c1d3e6f4ec1e admin admin] The token cache is being invalidate because project dc51a09cbbf24b878bdd3455dce958a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:30.950847 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9c86b483-038d-4181-9700-c1d3e6f4ec1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:30.951909 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9c86b483-038d-4181-9700-c1d3e6f4ec1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:30.954103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1217/2465] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:30 2022] DELETE /identity/v3/projects/dc51a09cbbf24b878bdd3455dce958a0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:30.958082 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7562bed-1565-4892-ba1c-131931113d68 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:30.967781 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7562bed-1565-4892-ba1c-131931113d68 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:31.030634 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cf0c7-9ac7-4610-9242-7fc31ac32fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:31.031281 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cf0c7-9ac7-4610-9242-7fc31ac32fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:31.031564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cf0c7-9ac7-4610-9242-7fc31ac32fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:31.031904 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cf0c7-9ac7-4610-9242-7fc31ac32fb6 admin admin] PATH_INFO: `/v3/users/11eae589783145b2ba479325ca8fb69d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:31.033128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6cf0c7-9ac7-4610-9242-7fc31ac32fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11eae589783145b2ba479325ca8fb69d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:31.035129 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6cf0c7-9ac7-4610-9242-7fc31ac32fb6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:31.075990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:31.099819 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ce6cf0c7-9ac7-4610-9242-7fc31ac32fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11eae589783145b2ba479325ca8fb69d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:31.100500 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ce6cf0c7-9ac7-4610-9242-7fc31ac32fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11eae589783145b2ba479325ca8fb69d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:31.107613 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ce6cf0c7-9ac7-4610-9242-7fc31ac32fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11eae589783145b2ba479325ca8fb69d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:31.108742 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ce6cf0c7-9ac7-4610-9242-7fc31ac32fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11eae589783145b2ba479325ca8fb69d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:31.117609 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ce6cf0c7-9ac7-4610-9242-7fc31ac32fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11eae589783145b2ba479325ca8fb69d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:31.140585 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1249/2466] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:30 2022] DELETE /identity/v3/users/11eae589783145b2ba479325ca8fb69d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:31.432688 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86b483-038d-4181-9700-c1d3e6f4ec1e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:31.434147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9c86b483-038d-4181-9700-c1d3e6f4ec1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:31.448309 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86b483-038d-4181-9700-c1d3e6f4ec1e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:31.512149 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14315192-4f8b-488b-987f-68e1693d4cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:31.512784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14315192-4f8b-488b-987f-68e1693d4cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:31.513096 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14315192-4f8b-488b-987f-68e1693d4cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:31.513374 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14315192-4f8b-488b-987f-68e1693d4cc8 admin admin] PATH_INFO: `/v3/projects/436d66dbfed747e6ba4f7f64ffc7028a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:31.514514 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14315192-4f8b-488b-987f-68e1693d4cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=436d66dbfed747e6ba4f7f64ffc7028a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:31.516494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14315192-4f8b-488b-987f-68e1693d4cc8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:31.575152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-14315192-4f8b-488b-987f-68e1693d4cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436d66dbfed747e6ba4f7f64ffc7028a', 'request_id': 'req-14315192-4f8b-488b-987f-68e1693d4cc8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:31.582240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-14315192-4f8b-488b-987f-68e1693d4cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436d66dbfed747e6ba4f7f64ffc7028a', 'request_id': 'req-14315192-4f8b-488b-987f-68e1693d4cc8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:31.589125 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-14315192-4f8b-488b-987f-68e1693d4cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436d66dbfed747e6ba4f7f64ffc7028a', 'request_id': 'req-14315192-4f8b-488b-987f-68e1693d4cc8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:31.600897 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-14315192-4f8b-488b-987f-68e1693d4cc8 admin admin] The token cache is being invalidate because project 436d66dbfed747e6ba4f7f64ffc7028a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:31.601088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-14315192-4f8b-488b-987f-68e1693d4cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:31.601748 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-14315192-4f8b-488b-987f-68e1693d4cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:31.603306 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1218/2467] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:31 2022] DELETE /identity/v3/projects/436d66dbfed747e6ba4f7f64ffc7028a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:31.607528 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cf0c7-9ac7-4610-9242-7fc31ac32fb6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:31.609731 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ce6cf0c7-9ac7-4610-9242-7fc31ac32fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:31.627064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cf0c7-9ac7-4610-9242-7fc31ac32fb6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:31.685032 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e1d9d-1887-43b5-a80d-c59eed9bb6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:31.685686 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e1d9d-1887-43b5-a80d-c59eed9bb6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:31.685962 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e1d9d-1887-43b5-a80d-c59eed9bb6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:31.686232 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e1d9d-1887-43b5-a80d-c59eed9bb6f3 admin admin] PATH_INFO: `/v3/users/46d4bf6f051c487d9868ace99279a87d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:31.688469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e1d9d-1887-43b5-a80d-c59eed9bb6f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d4bf6f051c487d9868ace99279a87d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:31.689575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e1d9d-1887-43b5-a80d-c59eed9bb6f3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:31.741140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8f4e1d9d-1887-43b5-a80d-c59eed9bb6f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d4bf6f051c487d9868ace99279a87d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:31.741837 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8f4e1d9d-1887-43b5-a80d-c59eed9bb6f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d4bf6f051c487d9868ace99279a87d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:31.748783 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8f4e1d9d-1887-43b5-a80d-c59eed9bb6f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d4bf6f051c487d9868ace99279a87d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:31.749450 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8f4e1d9d-1887-43b5-a80d-c59eed9bb6f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d4bf6f051c487d9868ace99279a87d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:31.756890 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8f4e1d9d-1887-43b5-a80d-c59eed9bb6f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d4bf6f051c487d9868ace99279a87d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:31.776567 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1250/2468] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:31 2022] DELETE /identity/v3/users/46d4bf6f051c487d9868ace99279a87d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:32.067216 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14315192-4f8b-488b-987f-68e1693d4cc8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:32.068695 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-14315192-4f8b-488b-987f-68e1693d4cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:32.086533 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14315192-4f8b-488b-987f-68e1693d4cc8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:32.114507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:32.150047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43273b-3250-490f-b608-f12a5e8d4012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:32.156333 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43273b-3250-490f-b608-f12a5e8d4012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:32.156333 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43273b-3250-490f-b608-f12a5e8d4012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:32.156333 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43273b-3250-490f-b608-f12a5e8d4012 admin admin] PATH_INFO: `/v3/projects/667c916aa9694c42965e6d33c147c4a2` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:32.157424 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43273b-3250-490f-b608-f12a5e8d4012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=667c916aa9694c42965e6d33c147c4a2)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:32.159023 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43273b-3250-490f-b608-f12a5e8d4012 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:32.213904 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dc43273b-3250-490f-b608-f12a5e8d4012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '667c916aa9694c42965e6d33c147c4a2', 'request_id': 'req-dc43273b-3250-490f-b608-f12a5e8d4012'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:32.223190 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dc43273b-3250-490f-b608-f12a5e8d4012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '667c916aa9694c42965e6d33c147c4a2', 'request_id': 'req-dc43273b-3250-490f-b608-f12a5e8d4012'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:32.231458 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dc43273b-3250-490f-b608-f12a5e8d4012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '667c916aa9694c42965e6d33c147c4a2', 'request_id': 'req-dc43273b-3250-490f-b608-f12a5e8d4012'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:32.243430 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dc43273b-3250-490f-b608-f12a5e8d4012 admin admin] The token cache is being invalidate because project 667c916aa9694c42965e6d33c147c4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:32.243615 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dc43273b-3250-490f-b608-f12a5e8d4012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:32.244293 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-dc43273b-3250-490f-b608-f12a5e8d4012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:32.245880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1219/2469] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:32 2022] DELETE /identity/v3/projects/667c916aa9694c42965e6d33c147c4a2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:32.251418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d097e1e-964c-43a7-987e-79f908b02ae4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:32.251704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d097e1e-964c-43a7-987e-79f908b02ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:32.252080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d097e1e-964c-43a7-987e-79f908b02ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:32.275895 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5d097e1e-964c-43a7-987e-79f908b02ae4 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:32.277140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5d097e1e-964c-43a7-987e-79f908b02ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:32.297970 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:32.354422 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1251/2470] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:32.363022 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465a6f6-0dcb-4368-b5ea-24994626b3ff None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:32.363552 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465a6f6-0dcb-4368-b5ea-24994626b3ff None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:32.364069 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465a6f6-0dcb-4368-b5ea-24994626b3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:32.388681 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0465a6f6-0dcb-4368-b5ea-24994626b3ff None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:32.389963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0465a6f6-0dcb-4368-b5ea-24994626b3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:32.399502 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1220/2471] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:32.403757 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d097e1e-964c-43a7-987e-79f908b02ae4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:32.414709 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d097e1e-964c-43a7-987e-79f908b02ae4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:32.419783 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325a7e4-4cf0-4df5-8053-e0a12f890d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:32.420456 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325a7e4-4cf0-4df5-8053-e0a12f890d4b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:32.421410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325a7e4-4cf0-4df5-8053-e0a12f890d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:32.421684 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325a7e4-4cf0-4df5-8053-e0a12f890d4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:32.422339 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325a7e4-4cf0-4df5-8053-e0a12f890d4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:34:32.422639 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325a7e4-4cf0-4df5-8053-e0a12f890d4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:32.424321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325a7e4-4cf0-4df5-8053-e0a12f890d4b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:32.436979 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1252/2472] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:34:32.441386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465a6f6-0dcb-4368-b5ea-24994626b3ff None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:32.450851 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465a6f6-0dcb-4368-b5ea-24994626b3ff None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:32.455466 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad38cf-415c-4e51-8c60-181d7570ab00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:32.456101 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad38cf-415c-4e51-8c60-181d7570ab00 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:32.456385 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad38cf-415c-4e51-8c60-181d7570ab00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:32.456652 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad38cf-415c-4e51-8c60-181d7570ab00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:32.457368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad38cf-415c-4e51-8c60-181d7570ab00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:32.459728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad38cf-415c-4e51-8c60-181d7570ab00 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:32.493138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1221/2473] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:32 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:34:32.494730 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325a7e4-4cf0-4df5-8053-e0a12f890d4b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:32.505493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325a7e4-4cf0-4df5-8053-e0a12f890d4b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:32.565982 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd1fa7-1ae5-42f6-af2b-f700a82facf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:32.566610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd1fa7-1ae5-42f6-af2b-f700a82facf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:32.566889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd1fa7-1ae5-42f6-af2b-f700a82facf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:32.567167 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd1fa7-1ae5-42f6-af2b-f700a82facf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:32.567845 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd1fa7-1ae5-42f6-af2b-f700a82facf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:32.569859 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd1fa7-1ae5-42f6-af2b-f700a82facf7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:32.592529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1253/2474] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:32 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:32.596652 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad38cf-415c-4e51-8c60-181d7570ab00 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:32.607526 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad38cf-415c-4e51-8c60-181d7570ab00 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:32.612858 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbb8b9-cee5-4f86-b620-b44c9c601e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:32.613460 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbb8b9-cee5-4f86-b620-b44c9c601e5c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:32.613740 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbb8b9-cee5-4f86-b620-b44c9c601e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:32.614012 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbb8b9-cee5-4f86-b620-b44c9c601e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:32.614664 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbb8b9-cee5-4f86-b620-b44c9c601e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:32.616291 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbb8b9-cee5-4f86-b620-b44c9c601e5c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:32.627242 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1222/2475] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:32.632627 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd1fa7-1ae5-42f6-af2b-f700a82facf7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:32.642969 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd1fa7-1ae5-42f6-af2b-f700a82facf7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:32.647524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed105be6-f876-4327-bc43-45006e817453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:32.648208 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed105be6-f876-4327-bc43-45006e817453 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:32.648426 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed105be6-f876-4327-bc43-45006e817453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:32.648699 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed105be6-f876-4327-bc43-45006e817453 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:32.649414 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed105be6-f876-4327-bc43-45006e817453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:32.650919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed105be6-f876-4327-bc43-45006e817453 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:32.661499 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1254/2476] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:32.666372 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbb8b9-cee5-4f86-b620-b44c9c601e5c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:32.677368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbb8b9-cee5-4f86-b620-b44c9c601e5c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:32.682069 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cacf9a-1bd1-40f2-a99f-60b96d4c6d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:32.682717 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cacf9a-1bd1-40f2-a99f-60b96d4c6d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:32.683031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cacf9a-1bd1-40f2-a99f-60b96d4c6d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:32.683309 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cacf9a-1bd1-40f2-a99f-60b96d4c6d1f admin admin] PATH_INFO: `/v3/projects/b6996e3820de4963824244cf652c273a/users/f7cb18580f5a420daac972dbe8258e5a/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:32.698599 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cacf9a-1bd1-40f2-a99f-60b96d4c6d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6996e3820de4963824244cf652c273a, user_id=f7cb18580f5a420daac972dbe8258e5a, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:32.701320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cacf9a-1bd1-40f2-a99f-60b96d4c6d1f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:32.714304 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1223/2477] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:32 2022] PUT /identity/v3/projects/b6996e3820de4963824244cf652c273a/users/f7cb18580f5a420daac972dbe8258e5a/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:32.724593 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3b070-6e5a-4b36-98c9-40793f52b6b5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:32.724909 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3b070-6e5a-4b36-98c9-40793f52b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:32.725188 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3b070-6e5a-4b36-98c9-40793f52b6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:32.753798 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-31f3b070-6e5a-4b36-98c9-40793f52b6b5 None None] MFA Rules not processed for user `f7cb18580f5a420daac972dbe8258e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:32.755280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-31f3b070-6e5a-4b36-98c9-40793f52b6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:32.818993 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1255/2478] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:32 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:32.831370 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cacf9a-1bd1-40f2-a99f-60b96d4c6d1f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:32.833036 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-47cacf9a-1bd1-40f2-a99f-60b96d4c6d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:32.890523 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cacf9a-1bd1-40f2-a99f-60b96d4c6d1f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:32.894383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f96db2-633b-4bd5-8da3-40df55987578 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:32.894927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f96db2-633b-4bd5-8da3-40df55987578 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:32.895203 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f96db2-633b-4bd5-8da3-40df55987578 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:32.895470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f96db2-633b-4bd5-8da3-40df55987578 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:32.901668 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:32.904406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f96db2-633b-4bd5-8da3-40df55987578 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:32.906364 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f96db2-633b-4bd5-8da3-40df55987578 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:32.917421 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1224/2479] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:32 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:34.296462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3b070-6e5a-4b36-98c9-40793f52b6b5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:34.297852 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-31f3b070-6e5a-4b36-98c9-40793f52b6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:34.309732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3b070-6e5a-4b36-98c9-40793f52b6b5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:34.313900 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab54b5-108b-41e4-9b95-48d837d40b0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:34.314540 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab54b5-108b-41e4-9b95-48d837d40b0e service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:34.314817 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab54b5-108b-41e4-9b95-48d837d40b0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:34.315085 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab54b5-108b-41e4-9b95-48d837d40b0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:34.317019 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d1ab54b5-108b-41e4-9b95-48d837d40b0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:34.330851 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:34.392027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab54b5-108b-41e4-9b95-48d837d40b0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:34.393575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab54b5-108b-41e4-9b95-48d837d40b0e service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:34.405049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1256/2480] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:35.228912 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f96db2-633b-4bd5-8da3-40df55987578 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:35.230315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f2f96db2-633b-4bd5-8da3-40df55987578 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:35.298175 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f96db2-633b-4bd5-8da3-40df55987578 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:35.302642 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321c1aa-8752-4d01-8fa7-77a7df69a08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:35.303264 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321c1aa-8752-4d01-8fa7-77a7df69a08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:35.303545 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321c1aa-8752-4d01-8fa7-77a7df69a08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:35.303816 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321c1aa-8752-4d01-8fa7-77a7df69a08e admin admin] PATH_INFO: `/v3/users/698df7a562e54c32bd072693acf59617` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:35.304970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321c1aa-8752-4d01-8fa7-77a7df69a08e admin admin] RBAC: Authorizing `identity:delete_user(user_id=698df7a562e54c32bd072693acf59617)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:35.306876 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321c1aa-8752-4d01-8fa7-77a7df69a08e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:35.353688 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1321c1aa-8752-4d01-8fa7-77a7df69a08e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '698df7a562e54c32bd072693acf59617'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:35.354373 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1321c1aa-8752-4d01-8fa7-77a7df69a08e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '698df7a562e54c32bd072693acf59617'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:35.362886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1321c1aa-8752-4d01-8fa7-77a7df69a08e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '698df7a562e54c32bd072693acf59617'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:35.363586 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1321c1aa-8752-4d01-8fa7-77a7df69a08e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '698df7a562e54c32bd072693acf59617'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:35.371194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1321c1aa-8752-4d01-8fa7-77a7df69a08e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '698df7a562e54c32bd072693acf59617'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:35.389005 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1225/2481] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:35 2022] DELETE /identity/v3/users/698df7a562e54c32bd072693acf59617 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:35.395126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a22c1a-e8be-43e4-a8a3-964963a3e8bf None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:35.395126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a22c1a-e8be-43e4-a8a3-964963a3e8bf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:35.395126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a22c1a-e8be-43e4-a8a3-964963a3e8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:35.414486 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-77a22c1a-e8be-43e4-a8a3-964963a3e8bf None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:35.415800 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-77a22c1a-e8be-43e4-a8a3-964963a3e8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:35.476829 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1257/2482] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:35.488127 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321c1aa-8752-4d01-8fa7-77a7df69a08e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:35.489574 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1321c1aa-8752-4d01-8fa7-77a7df69a08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:35.554800 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321c1aa-8752-4d01-8fa7-77a7df69a08e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:35.559192 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a845cee-c684-4525-b265-eec47681dd6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:35.559807 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a845cee-c684-4525-b265-eec47681dd6a service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:35.560158 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a845cee-c684-4525-b265-eec47681dd6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:35.560473 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a845cee-c684-4525-b265-eec47681dd6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:35.571657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a845cee-c684-4525-b265-eec47681dd6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:35.573131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a845cee-c684-4525-b265-eec47681dd6a service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:35.582879 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1226/2483] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:35.909419 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a22c1a-e8be-43e4-a8a3-964963a3e8bf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:35.910834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-77a22c1a-e8be-43e4-a8a3-964963a3e8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:35.929368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a22c1a-e8be-43e4-a8a3-964963a3e8bf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:35.934391 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:35.935262 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:35.935995 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:35.937470 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0 admin admin] PATH_INFO: `/v3/projects/98541353e33a40dc9297538314899e36` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:35.939114 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98541353e33a40dc9297538314899e36)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:35.941257 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:35.994170 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98541353e33a40dc9297538314899e36', 'request_id': 'req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:36.005200 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98541353e33a40dc9297538314899e36', 'request_id': 'req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:36.012583 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98541353e33a40dc9297538314899e36', 'request_id': 'req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:36.023446 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0 admin admin] The token cache is being invalidate because project 98541353e33a40dc9297538314899e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:36.023732 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:36.024407 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:36.025933 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1258/2484] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:35 2022] DELETE /identity/v3/projects/98541353e33a40dc9297538314899e36 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:36.030815 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a845cee-c684-4525-b265-eec47681dd6a service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:36.040540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a845cee-c684-4525-b265-eec47681dd6a service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:36.056477 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:36.105220 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b84ac-a64d-46c3-ab1e-0e9ff188bc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:36.105859 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b84ac-a64d-46c3-ab1e-0e9ff188bc09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:36.106140 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b84ac-a64d-46c3-ab1e-0e9ff188bc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:36.106420 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b84ac-a64d-46c3-ab1e-0e9ff188bc09 admin admin] PATH_INFO: `/v3/users/9d4cc7ac2b1449b88d65a9337e853b2e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:36.107536 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b84ac-a64d-46c3-ab1e-0e9ff188bc09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4cc7ac2b1449b88d65a9337e853b2e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:36.109556 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b84ac-a64d-46c3-ab1e-0e9ff188bc09 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:36.157743 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-870b84ac-a64d-46c3-ab1e-0e9ff188bc09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4cc7ac2b1449b88d65a9337e853b2e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:36.158314 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-870b84ac-a64d-46c3-ab1e-0e9ff188bc09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4cc7ac2b1449b88d65a9337e853b2e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:36.165106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-870b84ac-a64d-46c3-ab1e-0e9ff188bc09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4cc7ac2b1449b88d65a9337e853b2e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:36.165816 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-870b84ac-a64d-46c3-ab1e-0e9ff188bc09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4cc7ac2b1449b88d65a9337e853b2e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:36.172989 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-870b84ac-a64d-46c3-ab1e-0e9ff188bc09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4cc7ac2b1449b88d65a9337e853b2e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:36.194019 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1227/2485] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:36 2022] DELETE /identity/v3/users/9d4cc7ac2b1449b88d65a9337e853b2e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:36.477347 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:36.479525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:36.492959 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89c4aa-4f88-4f8c-8de0-53ed7204b3a0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:36.518439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:36.551692 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553b824-42e8-4ce5-81a6-42e69790db28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:36.552369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553b824-42e8-4ce5-81a6-42e69790db28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:36.552649 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553b824-42e8-4ce5-81a6-42e69790db28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:36.552949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553b824-42e8-4ce5-81a6-42e69790db28 admin admin] PATH_INFO: `/v3/projects/b53f5e91a15346459b3b4cccdd91a0af` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:36.554179 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553b824-42e8-4ce5-81a6-42e69790db28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b53f5e91a15346459b3b4cccdd91a0af)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:36.556044 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553b824-42e8-4ce5-81a6-42e69790db28 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:36.603469 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d553b824-42e8-4ce5-81a6-42e69790db28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b53f5e91a15346459b3b4cccdd91a0af', 'request_id': 'req-d553b824-42e8-4ce5-81a6-42e69790db28'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:36.611123 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d553b824-42e8-4ce5-81a6-42e69790db28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b53f5e91a15346459b3b4cccdd91a0af', 'request_id': 'req-d553b824-42e8-4ce5-81a6-42e69790db28'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:36.617655 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d553b824-42e8-4ce5-81a6-42e69790db28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b53f5e91a15346459b3b4cccdd91a0af', 'request_id': 'req-d553b824-42e8-4ce5-81a6-42e69790db28'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:36.628017 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d553b824-42e8-4ce5-81a6-42e69790db28 admin admin] The token cache is being invalidate because project b53f5e91a15346459b3b4cccdd91a0af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:36.628305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d553b824-42e8-4ce5-81a6-42e69790db28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:36.628937 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d553b824-42e8-4ce5-81a6-42e69790db28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:36.630684 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1259/2486] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:36 2022] DELETE /identity/v3/projects/b53f5e91a15346459b3b4cccdd91a0af => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:36.635645 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f6798-3a75-42ba-8a73-e96793d7eaf7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:36.636163 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f6798-3a75-42ba-8a73-e96793d7eaf7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:36.636262 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f6798-3a75-42ba-8a73-e96793d7eaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:36.657622 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-736f6798-3a75-42ba-8a73-e96793d7eaf7 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:36.658853 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-736f6798-3a75-42ba-8a73-e96793d7eaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:36.719393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1228/2487] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:36.728417 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3686882-3890-4855-b121-bfd30863a33f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:36.728708 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3686882-3890-4855-b121-bfd30863a33f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:36.728983 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3686882-3890-4855-b121-bfd30863a33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:36.749319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b3686882-3890-4855-b121-bfd30863a33f None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:36.750516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b3686882-3890-4855-b121-bfd30863a33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:36.758871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1260/2488] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:36.763308 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f6798-3a75-42ba-8a73-e96793d7eaf7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:36.773703 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f6798-3a75-42ba-8a73-e96793d7eaf7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:36.778381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc97c1-75d5-4359-99eb-1ab7bde95ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:36.778997 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc97c1-75d5-4359-99eb-1ab7bde95ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:36.779277 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc97c1-75d5-4359-99eb-1ab7bde95ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:36.779545 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc97c1-75d5-4359-99eb-1ab7bde95ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:36.780334 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc97c1-75d5-4359-99eb-1ab7bde95ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:34:36.780638 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc97c1-75d5-4359-99eb-1ab7bde95ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:36.782248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc97c1-75d5-4359-99eb-1ab7bde95ecc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:36.794507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1229/2489] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:34:36.798670 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3686882-3890-4855-b121-bfd30863a33f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:36.807789 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3686882-3890-4855-b121-bfd30863a33f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:36.812975 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8689a39-dba4-4c73-83f6-e6440e4b9263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:36.813677 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8689a39-dba4-4c73-83f6-e6440e4b9263 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:36.813946 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8689a39-dba4-4c73-83f6-e6440e4b9263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:36.814082 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8689a39-dba4-4c73-83f6-e6440e4b9263 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:36.814704 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8689a39-dba4-4c73-83f6-e6440e4b9263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:36.819128 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8689a39-dba4-4c73-83f6-e6440e4b9263 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:36.858760 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1261/2490] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:36 2022] POST /identity/v3/projects => generated 405 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:36.864914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc97c1-75d5-4359-99eb-1ab7bde95ecc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:36.875471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc97c1-75d5-4359-99eb-1ab7bde95ecc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:36.904415 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:36.948800 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83e270-6761-4bdc-adf8-e47463119cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:36.949409 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83e270-6761-4bdc-adf8-e47463119cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:36.949692 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83e270-6761-4bdc-adf8-e47463119cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:36.950006 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83e270-6761-4bdc-adf8-e47463119cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:36.950769 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83e270-6761-4bdc-adf8-e47463119cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:36.953652 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83e270-6761-4bdc-adf8-e47463119cc0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:36.979905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1230/2491] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:36 2022] POST /identity/v3/users => generated 303 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:36.984483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8689a39-dba4-4c73-83f6-e6440e4b9263 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:36.994964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8689a39-dba4-4c73-83f6-e6440e4b9263 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:37.000196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1caed8-649a-4b4c-8674-f53606cc7798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:37.000787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1caed8-649a-4b4c-8674-f53606cc7798 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:37.001065 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1caed8-649a-4b4c-8674-f53606cc7798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:37.001335 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1caed8-649a-4b4c-8674-f53606cc7798 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:37.001967 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1caed8-649a-4b4c-8674-f53606cc7798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:37.003572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1caed8-649a-4b4c-8674-f53606cc7798 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:37.014324 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1262/2492] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:37.021011 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83e270-6761-4bdc-adf8-e47463119cc0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:37.032282 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83e270-6761-4bdc-adf8-e47463119cc0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:37.036951 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28359f60-2732-49a7-a6d2-222a779ed470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:37.037541 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28359f60-2732-49a7-a6d2-222a779ed470 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:37.037817 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28359f60-2732-49a7-a6d2-222a779ed470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:37.038088 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28359f60-2732-49a7-a6d2-222a779ed470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:37.038724 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28359f60-2732-49a7-a6d2-222a779ed470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:37.040346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28359f60-2732-49a7-a6d2-222a779ed470 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:37.050911 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1231/2493] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:37.055299 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1caed8-649a-4b4c-8674-f53606cc7798 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:37.073752 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1caed8-649a-4b4c-8674-f53606cc7798 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:37.079554 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1172f19-20ef-4123-9719-8f2d1f2196c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:37.080243 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1172f19-20ef-4123-9719-8f2d1f2196c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:37.080675 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1172f19-20ef-4123-9719-8f2d1f2196c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:37.080944 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1172f19-20ef-4123-9719-8f2d1f2196c0 admin admin] PATH_INFO: `/v3/projects/5346e7dcdd74424c85b9d80f603d1374/users/1f1e6050639a4369beadbb54213b21b5/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:37.096408 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1172f19-20ef-4123-9719-8f2d1f2196c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5346e7dcdd74424c85b9d80f603d1374, user_id=1f1e6050639a4369beadbb54213b21b5, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:37.099143 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1172f19-20ef-4123-9719-8f2d1f2196c0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:37.117827 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1263/2494] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:37 2022] PUT /identity/v3/projects/5346e7dcdd74424c85b9d80f603d1374/users/1f1e6050639a4369beadbb54213b21b5/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:37.121002 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28359f60-2732-49a7-a6d2-222a779ed470 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:37.130548 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-28359f60-2732-49a7-a6d2-222a779ed470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:37.131068 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29fa2e-32d7-4e5e-a305-2d63c865471c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:37.131352 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29fa2e-32d7-4e5e-a305-2d63c865471c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:37.131621 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29fa2e-32d7-4e5e-a305-2d63c865471c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:37.166196 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4e29fa2e-32d7-4e5e-a305-2d63c865471c None None] MFA Rules not processed for user `1f1e6050639a4369beadbb54213b21b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:37.167413 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4e29fa2e-32d7-4e5e-a305-2d63c865471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:37.198841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28359f60-2732-49a7-a6d2-222a779ed470 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:37.200662 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:37.237268 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1264/2495] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:37 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:37.241397 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29fa2e-32d7-4e5e-a305-2d63c865471c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:37.252493 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a91a43-e9bc-4d3d-9147-0e000f355265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:37.253116 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a91a43-e9bc-4d3d-9147-0e000f355265 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:37.253396 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a91a43-e9bc-4d3d-9147-0e000f355265 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:37.253665 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a91a43-e9bc-4d3d-9147-0e000f355265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:37.255884 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-01a91a43-e9bc-4d3d-9147-0e000f355265 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:37.305292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29fa2e-32d7-4e5e-a305-2d63c865471c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:37.310240 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86380a39-7365-4138-8a68-243247ef8388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:37.310850 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86380a39-7365-4138-8a68-243247ef8388 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:37.311133 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86380a39-7365-4138-8a68-243247ef8388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:37.316031 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86380a39-7365-4138-8a68-243247ef8388 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:37.316031 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86380a39-7365-4138-8a68-243247ef8388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:37.316031 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86380a39-7365-4138-8a68-243247ef8388 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:37.334864 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a91a43-e9bc-4d3d-9147-0e000f355265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:37.336495 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a91a43-e9bc-4d3d-9147-0e000f355265 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:37.345146 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1265/2496] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:37 2022] POST /identity/v3/projects => generated 409 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:34:37.345361 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:37.346367 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86380a39-7365-4138-8a68-243247ef8388 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:37.348639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1232/2497] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:37.419333 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86380a39-7365-4138-8a68-243247ef8388 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:37.424996 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce186447-bd79-4eff-8a44-6822304aff1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:37.425728 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce186447-bd79-4eff-8a44-6822304aff1b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:37.426110 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce186447-bd79-4eff-8a44-6822304aff1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:37.426506 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce186447-bd79-4eff-8a44-6822304aff1b admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:37.427264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce186447-bd79-4eff-8a44-6822304aff1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:37.429332 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce186447-bd79-4eff-8a44-6822304aff1b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:37.455622 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1266/2498] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:37 2022] POST /identity/v3/users => generated 311 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:34:37.457011 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a91a43-e9bc-4d3d-9147-0e000f355265 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:37.476490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a91a43-e9bc-4d3d-9147-0e000f355265 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:37.476490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d7a86-2d28-4f97-953f-b797bf730647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:37.476490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d7a86-2d28-4f97-953f-b797bf730647 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:37.476490 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d7a86-2d28-4f97-953f-b797bf730647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:37.476886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d7a86-2d28-4f97-953f-b797bf730647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:37.476886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d7a86-2d28-4f97-953f-b797bf730647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:37.476886 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d7a86-2d28-4f97-953f-b797bf730647 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:37.488963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1233/2499] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:37.492843 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce186447-bd79-4eff-8a44-6822304aff1b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:37.503499 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce186447-bd79-4eff-8a44-6822304aff1b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:37.508435 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf62f9-77da-4a94-8ad3-8ccbcbbd9695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:37.509079 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf62f9-77da-4a94-8ad3-8ccbcbbd9695 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:37.509358 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf62f9-77da-4a94-8ad3-8ccbcbbd9695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:37.509630 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf62f9-77da-4a94-8ad3-8ccbcbbd9695 admin admin] PATH_INFO: `/v3/projects/2efcb1bd20f24495b7e9323d4980d605/users/14d2270b1f784b2f8c7936750451cfb6/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:37.525158 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf62f9-77da-4a94-8ad3-8ccbcbbd9695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2efcb1bd20f24495b7e9323d4980d605, user_id=14d2270b1f784b2f8c7936750451cfb6, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:37.527808 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf62f9-77da-4a94-8ad3-8ccbcbbd9695 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:37.541016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1267/2500] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:37 2022] PUT /identity/v3/projects/2efcb1bd20f24495b7e9323d4980d605/users/14d2270b1f784b2f8c7936750451cfb6/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:37.545147 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d7a86-2d28-4f97-953f-b797bf730647 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:37.555663 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d7a86-2d28-4f97-953f-b797bf730647 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:37.612938 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcec0c4-aca0-4124-833b-f4ed3c2815ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:37.613545 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcec0c4-aca0-4124-833b-f4ed3c2815ca admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:37.613824 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcec0c4-aca0-4124-833b-f4ed3c2815ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:37.614098 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcec0c4-aca0-4124-833b-f4ed3c2815ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:37.614742 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcec0c4-aca0-4124-833b-f4ed3c2815ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:37.616383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcec0c4-aca0-4124-833b-f4ed3c2815ca admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:37.625998 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1234/2501] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:37.630684 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf62f9-77da-4a94-8ad3-8ccbcbbd9695 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:37.641518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf62f9-77da-4a94-8ad3-8ccbcbbd9695 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:37.646160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fae03-e0ed-4ba1-883c-8a88f43c220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:37.646804 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fae03-e0ed-4ba1-883c-8a88f43c220a admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:37.647080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fae03-e0ed-4ba1-883c-8a88f43c220a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:37.647352 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fae03-e0ed-4ba1-883c-8a88f43c220a admin admin] PATH_INFO: `/v3/projects/2efcb1bd20f24495b7e9323d4980d605/users/14d2270b1f784b2f8c7936750451cfb6/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:37.649284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fae03-e0ed-4ba1-883c-8a88f43c220a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2efcb1bd20f24495b7e9323d4980d605, user_id=14d2270b1f784b2f8c7936750451cfb6, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:37.651942 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fae03-e0ed-4ba1-883c-8a88f43c220a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:37.662414 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1268/2502] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:37 2022] PUT /identity/v3/projects/2efcb1bd20f24495b7e9323d4980d605/users/14d2270b1f784b2f8c7936750451cfb6/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:37.674203 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b76b0c-3d65-4762-ab90-0ea18988feae None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:37.674769 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b76b0c-3d65-4762-ab90-0ea18988feae None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:37.674769 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b76b0c-3d65-4762-ab90-0ea18988feae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:37.702007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-67b76b0c-3d65-4762-ab90-0ea18988feae None None] MFA Rules not processed for user `14d2270b1f784b2f8c7936750451cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:37.703245 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-67b76b0c-3d65-4762-ab90-0ea18988feae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:37.777213 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1235/2503] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:37 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:37.790228 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fae03-e0ed-4ba1-883c-8a88f43c220a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:37.791986 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8a2fae03-e0ed-4ba1-883c-8a88f43c220a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:37.807962 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:37.854640 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fae03-e0ed-4ba1-883c-8a88f43c220a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:37.859160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe60397-8009-474a-b383-a5bc85ed054d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:37.859795 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe60397-8009-474a-b383-a5bc85ed054d service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:37.860181 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe60397-8009-474a-b383-a5bc85ed054d service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:37.860455 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe60397-8009-474a-b383-a5bc85ed054d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:37.869853 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe60397-8009-474a-b383-a5bc85ed054d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:37.871400 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe60397-8009-474a-b383-a5bc85ed054d service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:37.882577 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1269/2504] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:37 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:38.000922 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b76b0c-3d65-4762-ab90-0ea18988feae None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:38.006387 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-67b76b0c-3d65-4762-ab90-0ea18988feae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:38.038793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe60397-8009-474a-b383-a5bc85ed054d service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:38.048523 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe60397-8009-474a-b383-a5bc85ed054d service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:38.052403 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dda4c3-5814-48ab-8388-05839963745d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:38.053003 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dda4c3-5814-48ab-8388-05839963745d service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:38.053279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dda4c3-5814-48ab-8388-05839963745d service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:38.053611 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dda4c3-5814-48ab-8388-05839963745d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:38.085046 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b76b0c-3d65-4762-ab90-0ea18988feae None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:38.089680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70010-3029-4a27-9f3f-9b506a25b2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:38.090412 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70010-3029-4a27-9f3f-9b506a25b2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:38.090829 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70010-3029-4a27-9f3f-9b506a25b2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:38.091653 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70010-3029-4a27-9f3f-9b506a25b2b0 admin admin] PATH_INFO: `/v3/users/f7cb18580f5a420daac972dbe8258e5a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:38.092689 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b70010-3029-4a27-9f3f-9b506a25b2b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7cb18580f5a420daac972dbe8258e5a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:38.095132 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b70010-3029-4a27-9f3f-9b506a25b2b0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:38.108730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:38.127663 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dda4c3-5814-48ab-8388-05839963745d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:38.129152 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dda4c3-5814-48ab-8388-05839963745d service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:38.138885 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1270/2505] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:38 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:34:38.145187 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-52b70010-3029-4a27-9f3f-9b506a25b2b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7cb18580f5a420daac972dbe8258e5a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:38.145838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-52b70010-3029-4a27-9f3f-9b506a25b2b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7cb18580f5a420daac972dbe8258e5a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:38.153331 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-52b70010-3029-4a27-9f3f-9b506a25b2b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7cb18580f5a420daac972dbe8258e5a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:38.157110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-52b70010-3029-4a27-9f3f-9b506a25b2b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7cb18580f5a420daac972dbe8258e5a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:38.164844 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-52b70010-3029-4a27-9f3f-9b506a25b2b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7cb18580f5a420daac972dbe8258e5a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:38.183165 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1236/2506] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:37 2022] DELETE /identity/v3/users/f7cb18580f5a420daac972dbe8258e5a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:38.188205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bc54-b47c-4691-9bd3-9f8ca5aa98a4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:38.188571 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bc54-b47c-4691-9bd3-9f8ca5aa98a4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:38.189064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bc54-b47c-4691-9bd3-9f8ca5aa98a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:38.209984 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6249bc54-b47c-4691-9bd3-9f8ca5aa98a4 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:38.211288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6249bc54-b47c-4691-9bd3-9f8ca5aa98a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:38.277366 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1271/2507] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:38.288120 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70010-3029-4a27-9f3f-9b506a25b2b0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:38.289549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-52b70010-3029-4a27-9f3f-9b506a25b2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:38.354344 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70010-3029-4a27-9f3f-9b506a25b2b0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:38.359337 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a9117-cd38-4eb9-b3f6-715c6fb58988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:38.360519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a9117-cd38-4eb9-b3f6-715c6fb58988 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:38.360519 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a9117-cd38-4eb9-b3f6-715c6fb58988 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:38.360954 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a9117-cd38-4eb9-b3f6-715c6fb58988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:38.371451 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a9117-cd38-4eb9-b3f6-715c6fb58988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:38.373485 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a9117-cd38-4eb9-b3f6-715c6fb58988 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:38.385455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1237/2508] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:34:38.681488 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249bc54-b47c-4691-9bd3-9f8ca5aa98a4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:38.682943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6249bc54-b47c-4691-9bd3-9f8ca5aa98a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:38.695401 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249bc54-b47c-4691-9bd3-9f8ca5aa98a4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:38.700360 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36b437-7351-4b3f-ad18-53875ce334a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:38.700999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36b437-7351-4b3f-ad18-53875ce334a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:38.701278 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36b437-7351-4b3f-ad18-53875ce334a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:38.701559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36b437-7351-4b3f-ad18-53875ce334a5 admin admin] PATH_INFO: `/v3/projects/b6996e3820de4963824244cf652c273a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:38.703364 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36b437-7351-4b3f-ad18-53875ce334a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6996e3820de4963824244cf652c273a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:38.705289 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36b437-7351-4b3f-ad18-53875ce334a5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:38.752474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:38.754127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4c36b437-7351-4b3f-ad18-53875ce334a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6996e3820de4963824244cf652c273a', 'request_id': 'req-4c36b437-7351-4b3f-ad18-53875ce334a5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:38.763321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4c36b437-7351-4b3f-ad18-53875ce334a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6996e3820de4963824244cf652c273a', 'request_id': 'req-4c36b437-7351-4b3f-ad18-53875ce334a5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:38.770586 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4c36b437-7351-4b3f-ad18-53875ce334a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6996e3820de4963824244cf652c273a', 'request_id': 'req-4c36b437-7351-4b3f-ad18-53875ce334a5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:38.781451 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4c36b437-7351-4b3f-ad18-53875ce334a5 admin admin] The token cache is being invalidate because project b6996e3820de4963824244cf652c273a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:38.781737 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4c36b437-7351-4b3f-ad18-53875ce334a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:38.782376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4c36b437-7351-4b3f-ad18-53875ce334a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:38.783866 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1272/2509] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:38 2022] DELETE /identity/v3/projects/b6996e3820de4963824244cf652c273a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:43.521470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a9117-cd38-4eb9-b3f6-715c6fb58988 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:43.522881 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-959a9117-cd38-4eb9-b3f6-715c6fb58988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:43.536618 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a9117-cd38-4eb9-b3f6-715c6fb58988 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:43.612167 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424b20a-386b-4268-b21d-d97427336011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:43.612712 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424b20a-386b-4268-b21d-d97427336011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:43.612989 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424b20a-386b-4268-b21d-d97427336011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:43.613260 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424b20a-386b-4268-b21d-d97427336011 admin admin] PATH_INFO: `/v3/users/1f1e6050639a4369beadbb54213b21b5` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:43.614364 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424b20a-386b-4268-b21d-d97427336011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f1e6050639a4369beadbb54213b21b5)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:43.616333 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424b20a-386b-4268-b21d-d97427336011 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:43.656874 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:43.669437 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8424b20a-386b-4268-b21d-d97427336011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f1e6050639a4369beadbb54213b21b5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:43.670198 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8424b20a-386b-4268-b21d-d97427336011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f1e6050639a4369beadbb54213b21b5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:43.679589 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8424b20a-386b-4268-b21d-d97427336011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f1e6050639a4369beadbb54213b21b5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:43.680240 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8424b20a-386b-4268-b21d-d97427336011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f1e6050639a4369beadbb54213b21b5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:43.690740 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-8424b20a-386b-4268-b21d-d97427336011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f1e6050639a4369beadbb54213b21b5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:43.708332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1238/2510] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:43 2022] DELETE /identity/v3/users/1f1e6050639a4369beadbb54213b21b5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:43.713209 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a3f3c-6539-4e27-899b-54b083744274 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:43.713706 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a3f3c-6539-4e27-899b-54b083744274 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:43.713806 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a3f3c-6539-4e27-899b-54b083744274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:43.733796 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-654a3f3c-6539-4e27-899b-54b083744274 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:43.735006 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-654a3f3c-6539-4e27-899b-54b083744274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:43.792546 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1273/2511] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:43.802740 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424b20a-386b-4268-b21d-d97427336011 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:43.804156 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8424b20a-386b-4268-b21d-d97427336011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:43.863392 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424b20a-386b-4268-b21d-d97427336011 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:43.866905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22f560-442b-43ed-ae21-717fe501a5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:43.867501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22f560-442b-43ed-ae21-717fe501a5ba service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:43.867776 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22f560-442b-43ed-ae21-717fe501a5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:43.868090 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22f560-442b-43ed-ae21-717fe501a5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:43.876979 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22f560-442b-43ed-ae21-717fe501a5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:43.878409 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22f560-442b-43ed-ae21-717fe501a5ba service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:43.887879 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1239/2512] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:34:44.163765 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a3f3c-6539-4e27-899b-54b083744274 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:44.165260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-654a3f3c-6539-4e27-899b-54b083744274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:44.179601 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a3f3c-6539-4e27-899b-54b083744274 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:44.184915 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:44.185569 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:44.185853 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:44.186145 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd admin admin] PATH_INFO: `/v3/projects/5346e7dcdd74424c85b9d80f603d1374` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:44.187260 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5346e7dcdd74424c85b9d80f603d1374)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:44.189220 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:44.236521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5346e7dcdd74424c85b9d80f603d1374', 'request_id': 'req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:44.244733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5346e7dcdd74424c85b9d80f603d1374', 'request_id': 'req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:44.252307 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5346e7dcdd74424c85b9d80f603d1374', 'request_id': 'req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:44.263607 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd admin admin] The token cache is being invalidate because project 5346e7dcdd74424c85b9d80f603d1374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:44.263889 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:44.264711 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:44.266241 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1274/2513] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:44 2022] DELETE /identity/v3/projects/5346e7dcdd74424c85b9d80f603d1374 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:44.270368 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22f560-442b-43ed-ae21-717fe501a5ba service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:44.279955 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22f560-442b-43ed-ae21-717fe501a5ba service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:44.338992 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f03a10-8076-4593-846c-9da699e422ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:44.339730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f03a10-8076-4593-846c-9da699e422ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:44.340041 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f03a10-8076-4593-846c-9da699e422ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:44.340315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f03a10-8076-4593-846c-9da699e422ea admin admin] PATH_INFO: `/v3/users/14d2270b1f784b2f8c7936750451cfb6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:44.341470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f03a10-8076-4593-846c-9da699e422ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=14d2270b1f784b2f8c7936750451cfb6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:44.343957 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f03a10-8076-4593-846c-9da699e422ea admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:44.392644 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-46f03a10-8076-4593-846c-9da699e422ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14d2270b1f784b2f8c7936750451cfb6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:44.393295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-46f03a10-8076-4593-846c-9da699e422ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14d2270b1f784b2f8c7936750451cfb6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:44.400390 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-46f03a10-8076-4593-846c-9da699e422ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14d2270b1f784b2f8c7936750451cfb6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:44.401062 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-46f03a10-8076-4593-846c-9da699e422ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14d2270b1f784b2f8c7936750451cfb6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:44.402751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:44.409496 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-46f03a10-8076-4593-846c-9da699e422ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14d2270b1f784b2f8c7936750451cfb6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:44.428102 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1240/2514] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:44 2022] DELETE /identity/v3/users/14d2270b1f784b2f8c7936750451cfb6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:44.712349 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:44.713912 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:44.727840 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc25747-c2b9-4d08-b419-00c7b62bc7cd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:44.789734 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b9c85-3f7f-4b46-8c97-0ec3d418cc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:44.790502 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b9c85-3f7f-4b46-8c97-0ec3d418cc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:44.790788 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b9c85-3f7f-4b46-8c97-0ec3d418cc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:44.791064 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b9c85-3f7f-4b46-8c97-0ec3d418cc47 admin admin] PATH_INFO: `/v3/projects/2efcb1bd20f24495b7e9323d4980d605` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:44.792227 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b9c85-3f7f-4b46-8c97-0ec3d418cc47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2efcb1bd20f24495b7e9323d4980d605)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:44.794142 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b9c85-3f7f-4b46-8c97-0ec3d418cc47 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:44.795603 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:44.845028 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6c7b9c85-3f7f-4b46-8c97-0ec3d418cc47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2efcb1bd20f24495b7e9323d4980d605', 'request_id': 'req-6c7b9c85-3f7f-4b46-8c97-0ec3d418cc47'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:44.853618 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6c7b9c85-3f7f-4b46-8c97-0ec3d418cc47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2efcb1bd20f24495b7e9323d4980d605', 'request_id': 'req-6c7b9c85-3f7f-4b46-8c97-0ec3d418cc47'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:44.861100 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6c7b9c85-3f7f-4b46-8c97-0ec3d418cc47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2efcb1bd20f24495b7e9323d4980d605', 'request_id': 'req-6c7b9c85-3f7f-4b46-8c97-0ec3d418cc47'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:44.874105 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6c7b9c85-3f7f-4b46-8c97-0ec3d418cc47 admin admin] The token cache is being invalidate because project 2efcb1bd20f24495b7e9323d4980d605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:44.874394 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6c7b9c85-3f7f-4b46-8c97-0ec3d418cc47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:44.875060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6c7b9c85-3f7f-4b46-8c97-0ec3d418cc47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:44.876614 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1275/2515] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:44 2022] DELETE /identity/v3/projects/2efcb1bd20f24495b7e9323d4980d605 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:44.881916 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2d872-3821-48ca-a431-106fdafc4247 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:44.882393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2d872-3821-48ca-a431-106fdafc4247 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:44.882494 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2d872-3821-48ca-a431-106fdafc4247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:44.903069 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a9c2d872-3821-48ca-a431-106fdafc4247 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:44.904322 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a9c2d872-3821-48ca-a431-106fdafc4247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:44.985401 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1241/2516] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:44.989597 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1aff2a-a909-405c-8d02-67297766f9db None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:44.990060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1aff2a-a909-405c-8d02-67297766f9db None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:44.990337 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1aff2a-a909-405c-8d02-67297766f9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:45.012147 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2f1aff2a-a909-405c-8d02-67297766f9db None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:45.013536 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2f1aff2a-a909-405c-8d02-67297766f9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:45.022305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1276/2517] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:45.028766 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2d872-3821-48ca-a431-106fdafc4247 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:45.037545 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2d872-3821-48ca-a431-106fdafc4247 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:45.042278 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a4a4f-b521-4108-8ee0-e3e2a5392d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:45.042877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a4a4f-b521-4108-8ee0-e3e2a5392d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:45.043155 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a4a4f-b521-4108-8ee0-e3e2a5392d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:45.043427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a4a4f-b521-4108-8ee0-e3e2a5392d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:45.044121 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a4a4f-b521-4108-8ee0-e3e2a5392d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:34:45.044431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a4a4f-b521-4108-8ee0-e3e2a5392d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:45.046049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a4a4f-b521-4108-8ee0-e3e2a5392d5e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:45.057717 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1242/2518] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:34:45.062683 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1aff2a-a909-405c-8d02-67297766f9db None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:45.072718 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1aff2a-a909-405c-8d02-67297766f9db None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:45.078371 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a5275-6de8-4ba0-ac11-5f01eb485232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:45.078979 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a5275-6de8-4ba0-ac11-5f01eb485232 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:45.079259 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a5275-6de8-4ba0-ac11-5f01eb485232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:45.079531 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a5275-6de8-4ba0-ac11-5f01eb485232 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:45.080210 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a5275-6de8-4ba0-ac11-5f01eb485232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:45.082160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a5275-6de8-4ba0-ac11-5f01eb485232 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:45.112433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1277/2519] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:45 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:45.116654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a4a4f-b521-4108-8ee0-e3e2a5392d5e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:45.126994 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a4a4f-b521-4108-8ee0-e3e2a5392d5e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:45.184024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c1f74-6e39-48c9-8977-ad115d0650a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:45.184602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c1f74-6e39-48c9-8977-ad115d0650a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:45.184880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c1f74-6e39-48c9-8977-ad115d0650a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:45.185152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c1f74-6e39-48c9-8977-ad115d0650a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:45.185819 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c1f74-6e39-48c9-8977-ad115d0650a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:45.188346 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c1f74-6e39-48c9-8977-ad115d0650a8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:45.209211 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1243/2520] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:45 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:45.213290 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a5275-6de8-4ba0-ac11-5f01eb485232 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:45.224126 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a5275-6de8-4ba0-ac11-5f01eb485232 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:45.228815 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870b8fc-c47f-4c7a-89fd-91064ae7644f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:45.229411 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870b8fc-c47f-4c7a-89fd-91064ae7644f admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:45.229690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870b8fc-c47f-4c7a-89fd-91064ae7644f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:45.229990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870b8fc-c47f-4c7a-89fd-91064ae7644f admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:45.230633 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870b8fc-c47f-4c7a-89fd-91064ae7644f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:45.232283 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870b8fc-c47f-4c7a-89fd-91064ae7644f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:45.242706 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1278/2521] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:45.246525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c1f74-6e39-48c9-8977-ad115d0650a8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:45.256768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c1f74-6e39-48c9-8977-ad115d0650a8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:45.261406 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bd24e-f837-4b76-b98b-f919ab06de80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:45.262001 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bd24e-f837-4b76-b98b-f919ab06de80 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:45.262279 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bd24e-f837-4b76-b98b-f919ab06de80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:45.262549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bd24e-f837-4b76-b98b-f919ab06de80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:45.263188 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bd24e-f837-4b76-b98b-f919ab06de80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:45.264873 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bd24e-f837-4b76-b98b-f919ab06de80 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:45.275599 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1244/2522] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:45.279434 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870b8fc-c47f-4c7a-89fd-91064ae7644f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:45.290292 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870b8fc-c47f-4c7a-89fd-91064ae7644f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:45.294973 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3846cd-5dfc-48d1-96f1-b2d866242d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:45.295618 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3846cd-5dfc-48d1-96f1-b2d866242d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:45.296471 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3846cd-5dfc-48d1-96f1-b2d866242d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:45.296787 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3846cd-5dfc-48d1-96f1-b2d866242d05 admin admin] PATH_INFO: `/v3/projects/8b202807f15f478c96e3a66c62b64830/users/c9bb6dd19f3345419cf01169ac18fbf2/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:45.311955 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3846cd-5dfc-48d1-96f1-b2d866242d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b202807f15f478c96e3a66c62b64830, user_id=c9bb6dd19f3345419cf01169ac18fbf2, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:45.314676 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3846cd-5dfc-48d1-96f1-b2d866242d05 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:45.328090 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1279/2523] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:45 2022] PUT /identity/v3/projects/8b202807f15f478c96e3a66c62b64830/users/c9bb6dd19f3345419cf01169ac18fbf2/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:45.338230 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c755b-698d-46ff-87e3-149ad9404e46 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:45.338515 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c755b-698d-46ff-87e3-149ad9404e46 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:45.338784 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c755b-698d-46ff-87e3-149ad9404e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:45.366567 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-692c755b-698d-46ff-87e3-149ad9404e46 None None] MFA Rules not processed for user `c9bb6dd19f3345419cf01169ac18fbf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:45.367776 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-692c755b-698d-46ff-87e3-149ad9404e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:45.397218 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:45.433903 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1245/2524] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:45.438524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3846cd-5dfc-48d1-96f1-b2d866242d05 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:45.506614 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3846cd-5dfc-48d1-96f1-b2d866242d05 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:45.512053 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584312a0-a70a-4b61-99ae-cea9d467e728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:45.513648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584312a0-a70a-4b61-99ae-cea9d467e728 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:45.514193 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584312a0-a70a-4b61-99ae-cea9d467e728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:45.515195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584312a0-a70a-4b61-99ae-cea9d467e728 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:45.516725 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584312a0-a70a-4b61-99ae-cea9d467e728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:45.520948 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584312a0-a70a-4b61-99ae-cea9d467e728 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:45.548007 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1280/2525] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:45 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:45.552509 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c755b-698d-46ff-87e3-149ad9404e46 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:45.563654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c755b-698d-46ff-87e3-149ad9404e46 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:45.619468 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946d2d2-d11f-4bcc-bfde-2505548fec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:45.620110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946d2d2-d11f-4bcc-bfde-2505548fec6b admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:45.620393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946d2d2-d11f-4bcc-bfde-2505548fec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:45.620666 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946d2d2-d11f-4bcc-bfde-2505548fec6b admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:45.621315 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946d2d2-d11f-4bcc-bfde-2505548fec6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:45.623219 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946d2d2-d11f-4bcc-bfde-2505548fec6b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:45.647973 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1246/2526] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:45 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:34:45.649131 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584312a0-a70a-4b61-99ae-cea9d467e728 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:45.659204 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584312a0-a70a-4b61-99ae-cea9d467e728 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:45.663820 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df0218-1627-4f49-a1c7-7506cf21e01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:45.664452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df0218-1627-4f49-a1c7-7506cf21e01e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:45.664729 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df0218-1627-4f49-a1c7-7506cf21e01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:45.665000 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df0218-1627-4f49-a1c7-7506cf21e01e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:45.665647 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df0218-1627-4f49-a1c7-7506cf21e01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:45.667267 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df0218-1627-4f49-a1c7-7506cf21e01e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:45.673021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:45.682679 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1281/2527] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 10:34:45.683641 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946d2d2-d11f-4bcc-bfde-2505548fec6b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:45.694253 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946d2d2-d11f-4bcc-bfde-2505548fec6b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:45.699446 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276162a5-5a9c-4a37-b0cc-b7e127585601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:45.700295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276162a5-5a9c-4a37-b0cc-b7e127585601 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:45.700596 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276162a5-5a9c-4a37-b0cc-b7e127585601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:45.700872 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276162a5-5a9c-4a37-b0cc-b7e127585601 admin admin] PATH_INFO: `/v3/projects/f63ced9897ba47799eca42aab1fa28b8/users/b469c44705884dcbb92e42c55f340cb1/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:45.716382 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276162a5-5a9c-4a37-b0cc-b7e127585601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63ced9897ba47799eca42aab1fa28b8, user_id=b469c44705884dcbb92e42c55f340cb1, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:45.719167 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276162a5-5a9c-4a37-b0cc-b7e127585601 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:45.732152 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1247/2528] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:45 2022] PUT /identity/v3/projects/f63ced9897ba47799eca42aab1fa28b8/users/b469c44705884dcbb92e42c55f340cb1/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:45.736621 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df0218-1627-4f49-a1c7-7506cf21e01e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:45.746548 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df0218-1627-4f49-a1c7-7506cf21e01e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:45.801244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593aa26-6323-432c-b276-af2d127bc91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:45.801847 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593aa26-6323-432c-b276-af2d127bc91f admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:45.802124 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593aa26-6323-432c-b276-af2d127bc91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:45.802391 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593aa26-6323-432c-b276-af2d127bc91f admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:45.803020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593aa26-6323-432c-b276-af2d127bc91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:45.804641 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593aa26-6323-432c-b276-af2d127bc91f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:45.814067 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1282/2529] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:45.818268 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276162a5-5a9c-4a37-b0cc-b7e127585601 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:45.828637 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276162a5-5a9c-4a37-b0cc-b7e127585601 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:45.834904 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d54d8-420e-41d3-9209-b53f403b2ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:45.835552 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d54d8-420e-41d3-9209-b53f403b2ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:45.835829 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d54d8-420e-41d3-9209-b53f403b2ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:45.836137 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d54d8-420e-41d3-9209-b53f403b2ae0 admin admin] PATH_INFO: `/v3/projects/f63ced9897ba47799eca42aab1fa28b8/users/b469c44705884dcbb92e42c55f340cb1/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:45.838061 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d54d8-420e-41d3-9209-b53f403b2ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63ced9897ba47799eca42aab1fa28b8, user_id=b469c44705884dcbb92e42c55f340cb1, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:45.840781 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d54d8-420e-41d3-9209-b53f403b2ae0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:45.851702 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1248/2530] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:45 2022] PUT /identity/v3/projects/f63ced9897ba47799eca42aab1fa28b8/users/b469c44705884dcbb92e42c55f340cb1/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:45.863286 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f60209-9976-4f9b-a6be-7aa5b3791a91 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:45.863568 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f60209-9976-4f9b-a6be-7aa5b3791a91 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:45.863858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f60209-9976-4f9b-a6be-7aa5b3791a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:45.891803 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-04f60209-9976-4f9b-a6be-7aa5b3791a91 None None] MFA Rules not processed for user `b469c44705884dcbb92e42c55f340cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:45.893564 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-04f60209-9976-4f9b-a6be-7aa5b3791a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:45.961251 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1283/2531] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:45.972841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d54d8-420e-41d3-9209-b53f403b2ae0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:45.974553 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1b5d54d8-420e-41d3-9209-b53f403b2ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:46.036529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d54d8-420e-41d3-9209-b53f403b2ae0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:46.040496 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570aa08-4c1d-48b2-8532-b82051473cd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:46.041100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570aa08-4c1d-48b2-8532-b82051473cd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:46.041377 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570aa08-4c1d-48b2-8532-b82051473cd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:46.041653 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570aa08-4c1d-48b2-8532-b82051473cd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:46.051409 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570aa08-4c1d-48b2-8532-b82051473cd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:46.052927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570aa08-4c1d-48b2-8532-b82051473cd7 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:46.063479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1249/2532] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:46.146301 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f60209-9976-4f9b-a6be-7aa5b3791a91 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:46.156497 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f60209-9976-4f9b-a6be-7aa5b3791a91 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:46.160117 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae1a4b-54dc-4b36-b658-309e9cda6301 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:46.160712 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae1a4b-54dc-4b36-b658-309e9cda6301 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:46.160991 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae1a4b-54dc-4b36-b658-309e9cda6301 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:46.161263 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae1a4b-54dc-4b36-b658-309e9cda6301 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:46.215962 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae1a4b-54dc-4b36-b658-309e9cda6301 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:46.217342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae1a4b-54dc-4b36-b658-309e9cda6301 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:46.226945 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1284/2533] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:51.201025 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570aa08-4c1d-48b2-8532-b82051473cd7 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:51.229290 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:51.266653 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570aa08-4c1d-48b2-8532-b82051473cd7 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:51.272173 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e975d-5482-4cca-82bd-ac9d6260616d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:51.272803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e975d-5482-4cca-82bd-ac9d6260616d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:51.273083 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e975d-5482-4cca-82bd-ac9d6260616d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:51.273384 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e975d-5482-4cca-82bd-ac9d6260616d admin admin] PATH_INFO: `/v3/users/c9bb6dd19f3345419cf01169ac18fbf2` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:51.274653 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e975d-5482-4cca-82bd-ac9d6260616d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9bb6dd19f3345419cf01169ac18fbf2)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:51.276815 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e975d-5482-4cca-82bd-ac9d6260616d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:51.328628 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c31e975d-5482-4cca-82bd-ac9d6260616d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9bb6dd19f3345419cf01169ac18fbf2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:51.329419 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c31e975d-5482-4cca-82bd-ac9d6260616d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9bb6dd19f3345419cf01169ac18fbf2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:51.341562 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c31e975d-5482-4cca-82bd-ac9d6260616d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9bb6dd19f3345419cf01169ac18fbf2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:51.341562 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c31e975d-5482-4cca-82bd-ac9d6260616d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9bb6dd19f3345419cf01169ac18fbf2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:51.350902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c31e975d-5482-4cca-82bd-ac9d6260616d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9bb6dd19f3345419cf01169ac18fbf2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:51.371196 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1250/2534] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:51 2022] DELETE /identity/v3/users/c9bb6dd19f3345419cf01169ac18fbf2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:51.376572 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47bacf-3a59-4cb5-a8de-15eb909e3cc4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:51.377392 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47bacf-3a59-4cb5-a8de-15eb909e3cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:51.377674 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47bacf-3a59-4cb5-a8de-15eb909e3cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:51.404392 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5d47bacf-3a59-4cb5-a8de-15eb909e3cc4 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:51.406118 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5d47bacf-3a59-4cb5-a8de-15eb909e3cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:51.418166 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:51.463481 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1285/2535] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:51.474843 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e975d-5482-4cca-82bd-ac9d6260616d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:51.476326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c31e975d-5482-4cca-82bd-ac9d6260616d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:51.535751 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e975d-5482-4cca-82bd-ac9d6260616d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:51.539443 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ff65a-de81-4a3d-a76b-fee9a99e7ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:51.540110 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ff65a-de81-4a3d-a76b-fee9a99e7ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:51.540388 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ff65a-de81-4a3d-a76b-fee9a99e7ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:51.540658 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ff65a-de81-4a3d-a76b-fee9a99e7ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:51.549759 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ff65a-de81-4a3d-a76b-fee9a99e7ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:51.551180 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ff65a-de81-4a3d-a76b-fee9a99e7ed7 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:51.560623 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1251/2536] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:51.828252 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47bacf-3a59-4cb5-a8de-15eb909e3cc4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:51.830103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5d47bacf-3a59-4cb5-a8de-15eb909e3cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:51.846305 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47bacf-3a59-4cb5-a8de-15eb909e3cc4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:51.851521 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcb6a5-2d60-47ca-beb4-0554d567f301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:51.852830 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcb6a5-2d60-47ca-beb4-0554d567f301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:51.853279 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcb6a5-2d60-47ca-beb4-0554d567f301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:51.853559 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcb6a5-2d60-47ca-beb4-0554d567f301 admin admin] PATH_INFO: `/v3/projects/8b202807f15f478c96e3a66c62b64830` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:51.855664 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcb6a5-2d60-47ca-beb4-0554d567f301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b202807f15f478c96e3a66c62b64830)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:51.857688 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcb6a5-2d60-47ca-beb4-0554d567f301 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:51.906221 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f9fcb6a5-2d60-47ca-beb4-0554d567f301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b202807f15f478c96e3a66c62b64830', 'request_id': 'req-f9fcb6a5-2d60-47ca-beb4-0554d567f301'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:51.913769 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f9fcb6a5-2d60-47ca-beb4-0554d567f301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b202807f15f478c96e3a66c62b64830', 'request_id': 'req-f9fcb6a5-2d60-47ca-beb4-0554d567f301'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:51.920417 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f9fcb6a5-2d60-47ca-beb4-0554d567f301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b202807f15f478c96e3a66c62b64830', 'request_id': 'req-f9fcb6a5-2d60-47ca-beb4-0554d567f301'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:51.930762 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f9fcb6a5-2d60-47ca-beb4-0554d567f301 admin admin] The token cache is being invalidate because project 8b202807f15f478c96e3a66c62b64830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:51.931052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f9fcb6a5-2d60-47ca-beb4-0554d567f301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:51.931690 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f9fcb6a5-2d60-47ca-beb4-0554d567f301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:51.933212 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1286/2537] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:51 2022] DELETE /identity/v3/projects/8b202807f15f478c96e3a66c62b64830 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:51.937852 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ff65a-de81-4a3d-a76b-fee9a99e7ed7 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:51.947288 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ff65a-de81-4a3d-a76b-fee9a99e7ed7 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:51.992602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:52.008250 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a5f59-65d4-43df-b2a5-6565e98bdff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:52.008879 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a5f59-65d4-43df-b2a5-6565e98bdff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:52.009155 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a5f59-65d4-43df-b2a5-6565e98bdff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:52.009430 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a5f59-65d4-43df-b2a5-6565e98bdff3 admin admin] PATH_INFO: `/v3/users/b469c44705884dcbb92e42c55f340cb1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:52.010680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a5f59-65d4-43df-b2a5-6565e98bdff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b469c44705884dcbb92e42c55f340cb1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:52.012598 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a5f59-65d4-43df-b2a5-6565e98bdff3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:52.067536 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-291a5f59-65d4-43df-b2a5-6565e98bdff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b469c44705884dcbb92e42c55f340cb1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:52.068838 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-291a5f59-65d4-43df-b2a5-6565e98bdff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b469c44705884dcbb92e42c55f340cb1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:52.078905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-291a5f59-65d4-43df-b2a5-6565e98bdff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b469c44705884dcbb92e42c55f340cb1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:52.079790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-291a5f59-65d4-43df-b2a5-6565e98bdff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b469c44705884dcbb92e42c55f340cb1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:52.087872 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-291a5f59-65d4-43df-b2a5-6565e98bdff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b469c44705884dcbb92e42c55f340cb1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:52.107923 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1252/2538] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:51 2022] DELETE /identity/v3/users/b469c44705884dcbb92e42c55f340cb1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:52.410777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcb6a5-2d60-47ca-beb4-0554d567f301 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:52.412244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f9fcb6a5-2d60-47ca-beb4-0554d567f301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:52.437329 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcb6a5-2d60-47ca-beb4-0554d567f301 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:52.507445 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d82389-714f-4ce4-80c8-c8bfaef6a4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:52.508122 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d82389-714f-4ce4-80c8-c8bfaef6a4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:52.508429 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d82389-714f-4ce4-80c8-c8bfaef6a4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:52.508705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d82389-714f-4ce4-80c8-c8bfaef6a4a1 admin admin] PATH_INFO: `/v3/projects/f63ced9897ba47799eca42aab1fa28b8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:52.509841 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d82389-714f-4ce4-80c8-c8bfaef6a4a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63ced9897ba47799eca42aab1fa28b8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:52.511809 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d82389-714f-4ce4-80c8-c8bfaef6a4a1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:52.557223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:52.560885 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c2d82389-714f-4ce4-80c8-c8bfaef6a4a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63ced9897ba47799eca42aab1fa28b8', 'request_id': 'req-c2d82389-714f-4ce4-80c8-c8bfaef6a4a1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:52.570014 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c2d82389-714f-4ce4-80c8-c8bfaef6a4a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63ced9897ba47799eca42aab1fa28b8', 'request_id': 'req-c2d82389-714f-4ce4-80c8-c8bfaef6a4a1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:52.576529 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c2d82389-714f-4ce4-80c8-c8bfaef6a4a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63ced9897ba47799eca42aab1fa28b8', 'request_id': 'req-c2d82389-714f-4ce4-80c8-c8bfaef6a4a1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:52.587308 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c2d82389-714f-4ce4-80c8-c8bfaef6a4a1 admin admin] The token cache is being invalidate because project f63ced9897ba47799eca42aab1fa28b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:52.587588 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c2d82389-714f-4ce4-80c8-c8bfaef6a4a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:52.588244 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c2d82389-714f-4ce4-80c8-c8bfaef6a4a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:52.589719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1287/2539] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:52 2022] DELETE /identity/v3/projects/f63ced9897ba47799eca42aab1fa28b8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:52.594734 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c45a2-fe8f-4698-a4f3-afafc08cf13e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:52.595211 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c45a2-fe8f-4698-a4f3-afafc08cf13e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:52.595353 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c45a2-fe8f-4698-a4f3-afafc08cf13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:52.615029 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5b9c45a2-fe8f-4698-a4f3-afafc08cf13e None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:52.616201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5b9c45a2-fe8f-4698-a4f3-afafc08cf13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:52.679148 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1253/2540] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:52.687652 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1d174-b53c-4582-b7ee-50d515245103 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:52.687955 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1d174-b53c-4582-b7ee-50d515245103 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:52.688236 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1d174-b53c-4582-b7ee-50d515245103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:52.710073 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-34f1d174-b53c-4582-b7ee-50d515245103 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:52.711976 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-34f1d174-b53c-4582-b7ee-50d515245103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:52.720366 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1288/2541] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:52.724653 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c45a2-fe8f-4698-a4f3-afafc08cf13e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:52.735096 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c45a2-fe8f-4698-a4f3-afafc08cf13e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:52.740257 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed8438-cbfa-403f-a2b9-05c3c5d0c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:52.740991 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed8438-cbfa-403f-a2b9-05c3c5d0c06b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:52.741376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed8438-cbfa-403f-a2b9-05c3c5d0c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:52.741676 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed8438-cbfa-403f-a2b9-05c3c5d0c06b admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:52.743593 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed8438-cbfa-403f-a2b9-05c3c5d0c06b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:34:52.743593 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed8438-cbfa-403f-a2b9-05c3c5d0c06b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:52.744855 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed8438-cbfa-403f-a2b9-05c3c5d0c06b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:52.757734 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1254/2542] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:34:52.762157 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1d174-b53c-4582-b7ee-50d515245103 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:52.772346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1d174-b53c-4582-b7ee-50d515245103 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:52.777103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdee1a-aa7e-4ea3-86b5-dfc99e825ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:52.777700 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdee1a-aa7e-4ea3-86b5-dfc99e825ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:52.777976 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdee1a-aa7e-4ea3-86b5-dfc99e825ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:52.778245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdee1a-aa7e-4ea3-86b5-dfc99e825ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:52.778871 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdee1a-aa7e-4ea3-86b5-dfc99e825ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:52.780858 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdee1a-aa7e-4ea3-86b5-dfc99e825ce8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:52.809313 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1289/2543] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:52 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:52.814143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed8438-cbfa-403f-a2b9-05c3c5d0c06b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:52.824011 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed8438-cbfa-403f-a2b9-05c3c5d0c06b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:52.874768 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:52.886177 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c081e78-b80f-42d4-92ed-d741198beb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:52.886788 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c081e78-b80f-42d4-92ed-d741198beb03 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:52.887076 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c081e78-b80f-42d4-92ed-d741198beb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:52.887355 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c081e78-b80f-42d4-92ed-d741198beb03 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:52.888087 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c081e78-b80f-42d4-92ed-d741198beb03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:52.890082 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c081e78-b80f-42d4-92ed-d741198beb03 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:52.910415 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1255/2544] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:52 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:52.915401 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdee1a-aa7e-4ea3-86b5-dfc99e825ce8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:52.926134 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdee1a-aa7e-4ea3-86b5-dfc99e825ce8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:52.930754 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aac04-537d-4b43-aab6-eca81e5a2659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:52.931342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aac04-537d-4b43-aab6-eca81e5a2659 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:52.931616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aac04-537d-4b43-aab6-eca81e5a2659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:52.931885 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aac04-537d-4b43-aab6-eca81e5a2659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:52.932552 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640aac04-537d-4b43-aab6-eca81e5a2659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:52.934119 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640aac04-537d-4b43-aab6-eca81e5a2659 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:52.944249 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1290/2545] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:52.947905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c081e78-b80f-42d4-92ed-d741198beb03 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:52.957927 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c081e78-b80f-42d4-92ed-d741198beb03 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:52.962677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14efa99-6368-43ab-8525-df6a80883f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:52.963267 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14efa99-6368-43ab-8525-df6a80883f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:52.963548 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14efa99-6368-43ab-8525-df6a80883f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:52.963823 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14efa99-6368-43ab-8525-df6a80883f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:52.964499 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14efa99-6368-43ab-8525-df6a80883f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:52.966102 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14efa99-6368-43ab-8525-df6a80883f84 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:52.976603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1256/2546] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:52.981284 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aac04-537d-4b43-aab6-eca81e5a2659 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:52.991661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aac04-537d-4b43-aab6-eca81e5a2659 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:52.996557 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66845c3b-9340-4c2f-80a6-a35228be7fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:52.997311 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845c3b-9340-4c2f-80a6-a35228be7fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:52.997586 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845c3b-9340-4c2f-80a6-a35228be7fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:52.997857 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845c3b-9340-4c2f-80a6-a35228be7fa2 admin admin] PATH_INFO: `/v3/projects/83cd8ea5590e4a8b98be87c3adebf4c9/users/b0ca1aa88b8645ebb74fa7a42bc7a391/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:53.013976 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66845c3b-9340-4c2f-80a6-a35228be7fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cd8ea5590e4a8b98be87c3adebf4c9, user_id=b0ca1aa88b8645ebb74fa7a42bc7a391, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:53.017189 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66845c3b-9340-4c2f-80a6-a35228be7fa2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:53.029497 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1291/2547] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:52 2022] PUT /identity/v3/projects/83cd8ea5590e4a8b98be87c3adebf4c9/users/b0ca1aa88b8645ebb74fa7a42bc7a391/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:53.040427 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88061b3d-5734-4d0f-a991-790e3ba64e19 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:53.040729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88061b3d-5734-4d0f-a991-790e3ba64e19 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:53.041035 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88061b3d-5734-4d0f-a991-790e3ba64e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:53.069654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-88061b3d-5734-4d0f-a991-790e3ba64e19 None None] MFA Rules not processed for user `b0ca1aa88b8645ebb74fa7a42bc7a391`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:53.070884 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-88061b3d-5734-4d0f-a991-790e3ba64e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:53.139076 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1257/2548] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:53.143984 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66845c3b-9340-4c2f-80a6-a35228be7fa2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:53.207658 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66845c3b-9340-4c2f-80a6-a35228be7fa2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:53.212491 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84c41c-b57b-4d55-b240-692a795f809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:53.213101 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84c41c-b57b-4d55-b240-692a795f809b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:53.213377 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84c41c-b57b-4d55-b240-692a795f809b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:53.213648 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84c41c-b57b-4d55-b240-692a795f809b admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:53.214323 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84c41c-b57b-4d55-b240-692a795f809b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:53.216261 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84c41c-b57b-4d55-b240-692a795f809b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:53.244775 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1292/2549] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:53 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:53.249699 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88061b3d-5734-4d0f-a991-790e3ba64e19 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:53.260703 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88061b3d-5734-4d0f-a991-790e3ba64e19 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:53.320790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd2972-8771-4ccb-ac38-c6ccb8c07c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:53.321426 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd2972-8771-4ccb-ac38-c6ccb8c07c1d admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:53.321705 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd2972-8771-4ccb-ac38-c6ccb8c07c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:53.321967 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd2972-8771-4ccb-ac38-c6ccb8c07c1d admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:53.322605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd2972-8771-4ccb-ac38-c6ccb8c07c1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:53.324559 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd2972-8771-4ccb-ac38-c6ccb8c07c1d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:53.347413 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1258/2550] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:53 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:53.351720 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84c41c-b57b-4d55-b240-692a795f809b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:53.364024 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84c41c-b57b-4d55-b240-692a795f809b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:53.368808 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a36e5-f342-4028-a866-4cf8d3e77e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:53.369414 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a36e5-f342-4028-a866-4cf8d3e77e51 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:53.369695 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a36e5-f342-4028-a866-4cf8d3e77e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:53.369968 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a36e5-f342-4028-a866-4cf8d3e77e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:53.370617 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a36e5-f342-4028-a866-4cf8d3e77e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:53.372224 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a36e5-f342-4028-a866-4cf8d3e77e51 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:53.384278 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1293/2551] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:53.388905 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd2972-8771-4ccb-ac38-c6ccb8c07c1d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:53.401476 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd2972-8771-4ccb-ac38-c6ccb8c07c1d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:53.406258 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2dc26-0935-4294-add1-e327ef1f9819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:53.406926 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2dc26-0935-4294-add1-e327ef1f9819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:53.407201 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2dc26-0935-4294-add1-e327ef1f9819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:53.407469 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2dc26-0935-4294-add1-e327ef1f9819 admin admin] PATH_INFO: `/v3/projects/9e12cc5b25d54e3ea819d3d1be2b784d/users/89561283d3254621815e94303c98c3a3/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:53.423320 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2dc26-0935-4294-add1-e327ef1f9819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e12cc5b25d54e3ea819d3d1be2b784d, user_id=89561283d3254621815e94303c98c3a3, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:53.426104 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2dc26-0935-4294-add1-e327ef1f9819 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:53.440741 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1259/2552] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:53 2022] PUT /identity/v3/projects/9e12cc5b25d54e3ea819d3d1be2b784d/users/89561283d3254621815e94303c98c3a3/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:53.449253 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a36e5-f342-4028-a866-4cf8d3e77e51 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:53.459223 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a36e5-f342-4028-a866-4cf8d3e77e51 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:53.501755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:53.518882 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622c014-e9c1-4f7f-a914-aed8203617ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:53.519511 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c014-e9c1-4f7f-a914-aed8203617ec admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:53.519792 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c014-e9c1-4f7f-a914-aed8203617ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:53.520096 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c014-e9c1-4f7f-a914-aed8203617ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:53.520733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622c014-e9c1-4f7f-a914-aed8203617ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:53.522336 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622c014-e9c1-4f7f-a914-aed8203617ec admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:53.533065 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1294/2553] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:53.537489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2dc26-0935-4294-add1-e327ef1f9819 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:53.548788 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2dc26-0935-4294-add1-e327ef1f9819 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:53.553646 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d42b6e-2106-4073-ab63-62e4d92ba363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:53.554327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42b6e-2106-4073-ab63-62e4d92ba363 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:53.554603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42b6e-2106-4073-ab63-62e4d92ba363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:53.554875 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42b6e-2106-4073-ab63-62e4d92ba363 admin admin] PATH_INFO: `/v3/projects/9e12cc5b25d54e3ea819d3d1be2b784d/users/89561283d3254621815e94303c98c3a3/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:53.556984 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d42b6e-2106-4073-ab63-62e4d92ba363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e12cc5b25d54e3ea819d3d1be2b784d, user_id=89561283d3254621815e94303c98c3a3, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:53.560350 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d42b6e-2106-4073-ab63-62e4d92ba363 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:53.571809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1260/2554] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:53 2022] PUT /identity/v3/projects/9e12cc5b25d54e3ea819d3d1be2b784d/users/89561283d3254621815e94303c98c3a3/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:53.641984 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2db40-d95e-433c-9955-91d408f52413 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:53.642291 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2db40-d95e-433c-9955-91d408f52413 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:53.642533 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2db40-d95e-433c-9955-91d408f52413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:53.674220 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d8c2db40-d95e-433c-9955-91d408f52413 None None] MFA Rules not processed for user `89561283d3254621815e94303c98c3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:53.675477 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d8c2db40-d95e-433c-9955-91d408f52413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:53.744431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1295/2555] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:53.756243 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d42b6e-2106-4073-ab63-62e4d92ba363 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:53.757919 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c0d42b6e-2106-4073-ab63-62e4d92ba363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:53.772657 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:53.818328 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d42b6e-2106-4073-ab63-62e4d92ba363 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:53.822356 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137939d-14cf-4766-8bc4-1a417ca8c153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:53.822964 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137939d-14cf-4766-8bc4-1a417ca8c153 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:53.823295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137939d-14cf-4766-8bc4-1a417ca8c153 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:53.823563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137939d-14cf-4766-8bc4-1a417ca8c153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:53.833119 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137939d-14cf-4766-8bc4-1a417ca8c153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:53.834539 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137939d-14cf-4766-8bc4-1a417ca8c153 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:53.844299 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1261/2556] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:54.216493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2db40-d95e-433c-9955-91d408f52413 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:54.276903 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2db40-d95e-433c-9955-91d408f52413 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:54.282266 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d0d29-8758-42bf-b52d-27f1982caf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:54.282913 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d0d29-8758-42bf-b52d-27f1982caf38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:54.283217 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d0d29-8758-42bf-b52d-27f1982caf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:54.283489 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d0d29-8758-42bf-b52d-27f1982caf38 admin admin] PATH_INFO: `/v3/users/b0ca1aa88b8645ebb74fa7a42bc7a391` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:54.284623 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d0d29-8758-42bf-b52d-27f1982caf38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ca1aa88b8645ebb74fa7a42bc7a391)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:54.286544 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d0d29-8758-42bf-b52d-27f1982caf38 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:54.330423 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cb7d0d29-8758-42bf-b52d-27f1982caf38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ca1aa88b8645ebb74fa7a42bc7a391'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:54.331068 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cb7d0d29-8758-42bf-b52d-27f1982caf38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ca1aa88b8645ebb74fa7a42bc7a391'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:54.337881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cb7d0d29-8758-42bf-b52d-27f1982caf38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ca1aa88b8645ebb74fa7a42bc7a391'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:54.338502 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cb7d0d29-8758-42bf-b52d-27f1982caf38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ca1aa88b8645ebb74fa7a42bc7a391'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:54.346013 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cb7d0d29-8758-42bf-b52d-27f1982caf38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ca1aa88b8645ebb74fa7a42bc7a391'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:54.350550 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:54.366791 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1296/2557] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:54 2022] DELETE /identity/v3/users/b0ca1aa88b8645ebb74fa7a42bc7a391 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:54.371347 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e2c2d-4ccb-49fa-846c-d36b64f06c54 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:54.371633 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e2c2d-4ccb-49fa-846c-d36b64f06c54 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:54.372310 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e2c2d-4ccb-49fa-846c-d36b64f06c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:54.391143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-301e2c2d-4ccb-49fa-846c-d36b64f06c54 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:54.392376 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-301e2c2d-4ccb-49fa-846c-d36b64f06c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:54.450059 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1262/2558] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:54.460172 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d0d29-8758-42bf-b52d-27f1982caf38 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:54.461693 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cb7d0d29-8758-42bf-b52d-27f1982caf38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:54.523795 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d0d29-8758-42bf-b52d-27f1982caf38 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:54.527486 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ce3a5-24c9-4843-94c7-2830ca4792ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:54.528165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ce3a5-24c9-4843-94c7-2830ca4792ad service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:54.528447 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ce3a5-24c9-4843-94c7-2830ca4792ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:54.528720 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ce3a5-24c9-4843-94c7-2830ca4792ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:54.538036 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ce3a5-24c9-4843-94c7-2830ca4792ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:54.539464 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ce3a5-24c9-4843-94c7-2830ca4792ad service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:54.549550 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1297/2559] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:54.718522 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e2c2d-4ccb-49fa-846c-d36b64f06c54 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:54.720024 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-301e2c2d-4ccb-49fa-846c-d36b64f06c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:54.732157 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e2c2d-4ccb-49fa-846c-d36b64f06c54 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:54.737505 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb30bb1-0317-44ae-ad58-eeed7edc138e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:54.738143 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb30bb1-0317-44ae-ad58-eeed7edc138e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:54.738422 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb30bb1-0317-44ae-ad58-eeed7edc138e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:54.738743 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb30bb1-0317-44ae-ad58-eeed7edc138e admin admin] PATH_INFO: `/v3/users/1f8cfa7b547148299f9bbfc49f11c791` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:54.739871 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb30bb1-0317-44ae-ad58-eeed7edc138e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8cfa7b547148299f9bbfc49f11c791)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:54.741891 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb30bb1-0317-44ae-ad58-eeed7edc138e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:54.790901 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5eb30bb1-0317-44ae-ad58-eeed7edc138e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8cfa7b547148299f9bbfc49f11c791'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:54.791981 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5eb30bb1-0317-44ae-ad58-eeed7edc138e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8cfa7b547148299f9bbfc49f11c791'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:54.801890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5eb30bb1-0317-44ae-ad58-eeed7edc138e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8cfa7b547148299f9bbfc49f11c791'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:54.802679 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5eb30bb1-0317-44ae-ad58-eeed7edc138e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8cfa7b547148299f9bbfc49f11c791'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:54.810471 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5eb30bb1-0317-44ae-ad58-eeed7edc138e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8cfa7b547148299f9bbfc49f11c791'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:54.816710 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ce3a5-24c9-4843-94c7-2830ca4792ad service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:54.818813 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d89ce3a5-24c9-4843-94c7-2830ca4792ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:54.833603 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1263/2560] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:54 2022] DELETE /identity/v3/users/1f8cfa7b547148299f9bbfc49f11c791 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:54.835062 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ce3a5-24c9-4843-94c7-2830ca4792ad service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:54.839008 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199b5d6-4341-45a4-b4ab-9f16923b8294 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:54.839324 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199b5d6-4341-45a4-b4ab-9f16923b8294 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:54.839947 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199b5d6-4341-45a4-b4ab-9f16923b8294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:54.860809 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9199b5d6-4341-45a4-b4ab-9f16923b8294 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:54.862007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9199b5d6-4341-45a4-b4ab-9f16923b8294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:54.886025 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:54.900247 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee916-0c43-438f-a330-d5fdc39622e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:54.900990 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee916-0c43-438f-a330-d5fdc39622e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:54.901274 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee916-0c43-438f-a330-d5fdc39622e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:54.901682 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee916-0c43-438f-a330-d5fdc39622e4 admin admin] PATH_INFO: `/v3/projects/83cd8ea5590e4a8b98be87c3adebf4c9` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:54.902839 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbee916-0c43-438f-a330-d5fdc39622e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cd8ea5590e4a8b98be87c3adebf4c9)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:54.904943 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbee916-0c43-438f-a330-d5fdc39622e4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:54.926255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1264/2561] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:54.938103 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199b5d6-4341-45a4-b4ab-9f16923b8294 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:54.940101 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9199b5d6-4341-45a4-b4ab-9f16923b8294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:54.955444 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bfbee916-0c43-438f-a330-d5fdc39622e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cd8ea5590e4a8b98be87c3adebf4c9', 'request_id': 'req-bfbee916-0c43-438f-a330-d5fdc39622e4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:54.963460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bfbee916-0c43-438f-a330-d5fdc39622e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cd8ea5590e4a8b98be87c3adebf4c9', 'request_id': 'req-bfbee916-0c43-438f-a330-d5fdc39622e4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:54.970134 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bfbee916-0c43-438f-a330-d5fdc39622e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cd8ea5590e4a8b98be87c3adebf4c9', 'request_id': 'req-bfbee916-0c43-438f-a330-d5fdc39622e4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:54.982215 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bfbee916-0c43-438f-a330-d5fdc39622e4 admin admin] The token cache is being invalidate because project 83cd8ea5590e4a8b98be87c3adebf4c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:54.982507 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bfbee916-0c43-438f-a330-d5fdc39622e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:54.983368 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bfbee916-0c43-438f-a330-d5fdc39622e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:54.985142 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1298/2562] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:54 2022] DELETE /identity/v3/projects/83cd8ea5590e4a8b98be87c3adebf4c9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:54.989306 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee916-0c43-438f-a330-d5fdc39622e4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:54.990730 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bfbee916-0c43-438f-a330-d5fdc39622e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:55.003988 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199b5d6-4341-45a4-b4ab-9f16923b8294 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:55.013427 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:55.054591 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bd15d-b221-4f9a-b902-7612fbf85284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:55.055194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bd15d-b221-4f9a-b902-7612fbf85284 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:55.055637 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bd15d-b221-4f9a-b902-7612fbf85284 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:55.055914 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bd15d-b221-4f9a-b902-7612fbf85284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:55.060462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee916-0c43-438f-a330-d5fdc39622e4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:55.062037 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-199bd15d-b221-4f9a-b902-7612fbf85284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:55.069275 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aad765-6b0d-4842-becd-ce89f0cc877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:55.069912 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aad765-6b0d-4842-becd-ce89f0cc877b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:55.070190 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aad765-6b0d-4842-becd-ce89f0cc877b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:55.070462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aad765-6b0d-4842-becd-ce89f0cc877b admin admin] PATH_INFO: `/v3/users/89561283d3254621815e94303c98c3a3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:55.071638 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aad765-6b0d-4842-becd-ce89f0cc877b admin admin] RBAC: Authorizing `identity:delete_user(user_id=89561283d3254621815e94303c98c3a3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:55.073610 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aad765-6b0d-4842-becd-ce89f0cc877b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:55.076340 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bd15d-b221-4f9a-b902-7612fbf85284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:55.078543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bd15d-b221-4f9a-b902-7612fbf85284 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:55.088426 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1265/2563] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 10:34:55.122952 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-81aad765-6b0d-4842-becd-ce89f0cc877b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89561283d3254621815e94303c98c3a3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:55.123628 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-81aad765-6b0d-4842-becd-ce89f0cc877b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89561283d3254621815e94303c98c3a3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:55.131684 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-81aad765-6b0d-4842-becd-ce89f0cc877b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89561283d3254621815e94303c98c3a3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:55.132380 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-81aad765-6b0d-4842-becd-ce89f0cc877b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89561283d3254621815e94303c98c3a3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:55.141142 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-81aad765-6b0d-4842-becd-ce89f0cc877b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89561283d3254621815e94303c98c3a3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:55.159809 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1299/2564] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:34:54 2022] DELETE /identity/v3/users/89561283d3254621815e94303c98c3a3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:34:55.424231 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bd15d-b221-4f9a-b902-7612fbf85284 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:55.425672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-199bd15d-b221-4f9a-b902-7612fbf85284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:55.438803 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bd15d-b221-4f9a-b902-7612fbf85284 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:55.473217 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aad765-6b0d-4842-becd-ce89f0cc877b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:55.475271 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-81aad765-6b0d-4842-becd-ce89f0cc877b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:55.514801 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2be3d-7be0-45bf-b1ff-3eb49d7985e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:55.515549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2be3d-7be0-45bf-b1ff-3eb49d7985e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:55.515970 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2be3d-7be0-45bf-b1ff-3eb49d7985e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:55.516125 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2be3d-7be0-45bf-b1ff-3eb49d7985e2 admin admin] PATH_INFO: `/v3/projects/b981090c54734257871a415708f0527c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:55.517263 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2be3d-7be0-45bf-b1ff-3eb49d7985e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b981090c54734257871a415708f0527c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:55.519175 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2be3d-7be0-45bf-b1ff-3eb49d7985e2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:55.546363 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aad765-6b0d-4842-becd-ce89f0cc877b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:55.551833 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436d862-983c-4b77-a389-d2aa6e095fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:55.552496 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d862-983c-4b77-a389-d2aa6e095fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:55.552777 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d862-983c-4b77-a389-d2aa6e095fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:55.553049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436d862-983c-4b77-a389-d2aa6e095fbc admin admin] PATH_INFO: `/v3/projects/9e12cc5b25d54e3ea819d3d1be2b784d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:55.553780 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:55.554561 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436d862-983c-4b77-a389-d2aa6e095fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e12cc5b25d54e3ea819d3d1be2b784d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:55.556575 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436d862-983c-4b77-a389-d2aa6e095fbc admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:55.568672 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-00e2be3d-7be0-45bf-b1ff-3eb49d7985e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b981090c54734257871a415708f0527c', 'request_id': 'req-00e2be3d-7be0-45bf-b1ff-3eb49d7985e2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:55.576322 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-00e2be3d-7be0-45bf-b1ff-3eb49d7985e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b981090c54734257871a415708f0527c', 'request_id': 'req-00e2be3d-7be0-45bf-b1ff-3eb49d7985e2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:55.583799 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-00e2be3d-7be0-45bf-b1ff-3eb49d7985e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b981090c54734257871a415708f0527c', 'request_id': 'req-00e2be3d-7be0-45bf-b1ff-3eb49d7985e2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:55.596255 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-00e2be3d-7be0-45bf-b1ff-3eb49d7985e2 admin admin] The token cache is being invalidate because project b981090c54734257871a415708f0527c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:55.596624 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-00e2be3d-7be0-45bf-b1ff-3eb49d7985e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:55.597347 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-00e2be3d-7be0-45bf-b1ff-3eb49d7985e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:55.599261 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:55.599396 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1266/2565] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:55 2022] DELETE /identity/v3/projects/b981090c54734257871a415708f0527c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:55.609001 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8436d862-983c-4b77-a389-d2aa6e095fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e12cc5b25d54e3ea819d3d1be2b784d', 'request_id': 'req-8436d862-983c-4b77-a389-d2aa6e095fbc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:55.621795 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8436d862-983c-4b77-a389-d2aa6e095fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e12cc5b25d54e3ea819d3d1be2b784d', 'request_id': 'req-8436d862-983c-4b77-a389-d2aa6e095fbc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:55.631078 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8436d862-983c-4b77-a389-d2aa6e095fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e12cc5b25d54e3ea819d3d1be2b784d', 'request_id': 'req-8436d862-983c-4b77-a389-d2aa6e095fbc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:55.645503 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8436d862-983c-4b77-a389-d2aa6e095fbc admin admin] The token cache is being invalidate because project 9e12cc5b25d54e3ea819d3d1be2b784d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:34:55.646015 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8436d862-983c-4b77-a389-d2aa6e095fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:55.647290 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8436d862-983c-4b77-a389-d2aa6e095fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:34:55.649143 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1300/2566] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:34:55 2022] DELETE /identity/v3/projects/9e12cc5b25d54e3ea819d3d1be2b784d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:55.655841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353970e-fea0-43f2-ba40-2680c7c72b19 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:55.656430 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353970e-fea0-43f2-ba40-2680c7c72b19 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:55.656830 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353970e-fea0-43f2-ba40-2680c7c72b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:55.687099 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7353970e-fea0-43f2-ba40-2680c7c72b19 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:55.688926 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7353970e-fea0-43f2-ba40-2680c7c72b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:55.774325 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1267/2567] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:55.783180 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77a3c1-e5f6-4f7b-a4d0-97fcc92149c7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:55.783460 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77a3c1-e5f6-4f7b-a4d0-97fcc92149c7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:55.783730 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77a3c1-e5f6-4f7b-a4d0-97fcc92149c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:55.805720 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-db77a3c1-e5f6-4f7b-a4d0-97fcc92149c7 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:55.806984 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-db77a3c1-e5f6-4f7b-a4d0-97fcc92149c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:55.816294 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1301/2568] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:34:55.820590 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353970e-fea0-43f2-ba40-2680c7c72b19 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:55.831138 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353970e-fea0-43f2-ba40-2680c7c72b19 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:55.836938 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca538d3-d6c1-4134-853c-8a46b16d00b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:55.837549 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca538d3-d6c1-4134-853c-8a46b16d00b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:55.837973 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca538d3-d6c1-4134-853c-8a46b16d00b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:55.838194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca538d3-d6c1-4134-853c-8a46b16d00b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:55.838826 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca538d3-d6c1-4134-853c-8a46b16d00b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:34:55.839131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca538d3-d6c1-4134-853c-8a46b16d00b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:55.840872 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca538d3-d6c1-4134-853c-8a46b16d00b1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:55.857989 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1268/2569] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:34:55.860060 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77a3c1-e5f6-4f7b-a4d0-97fcc92149c7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:55.871121 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77a3c1-e5f6-4f7b-a4d0-97fcc92149c7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:55.877054 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b922d0e-7345-40b2-b855-28e15da70580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:55.877726 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b922d0e-7345-40b2-b855-28e15da70580 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:55.878081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b922d0e-7345-40b2-b855-28e15da70580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:55.878490 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b922d0e-7345-40b2-b855-28e15da70580 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:55.879192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b922d0e-7345-40b2-b855-28e15da70580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:55.881844 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b922d0e-7345-40b2-b855-28e15da70580 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:55.910151 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1302/2570] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:34:55 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 10:34:55.914431 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca538d3-d6c1-4134-853c-8a46b16d00b1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:55.924482 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca538d3-d6c1-4134-853c-8a46b16d00b1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:55.982680 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6950b6-758d-41c3-bacf-30747c77ca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:55.983548 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6950b6-758d-41c3-bacf-30747c77ca2f admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:55.983829 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6950b6-758d-41c3-bacf-30747c77ca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:55.984132 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6950b6-758d-41c3-bacf-30747c77ca2f admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:55.984769 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6950b6-758d-41c3-bacf-30747c77ca2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:55.986676 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6950b6-758d-41c3-bacf-30747c77ca2f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:56.007521 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1269/2571] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:34:55 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:34:56.011643 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b922d0e-7345-40b2-b855-28e15da70580 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:56.022423 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b922d0e-7345-40b2-b855-28e15da70580 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:56.027333 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885318e2-8528-4667-a700-b7f112d0d182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:56.027917 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885318e2-8528-4667-a700-b7f112d0d182 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:56.028245 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885318e2-8528-4667-a700-b7f112d0d182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:56.028518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885318e2-8528-4667-a700-b7f112d0d182 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:56.029154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885318e2-8528-4667-a700-b7f112d0d182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:56.030919 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885318e2-8528-4667-a700-b7f112d0d182 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:56.040856 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1303/2572] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:56.044790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6950b6-758d-41c3-bacf-30747c77ca2f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:56.055013 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6950b6-758d-41c3-bacf-30747c77ca2f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:56.059827 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7083c-f2eb-4004-bce9-dcba5e6b61ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:56.060472 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7083c-f2eb-4004-bce9-dcba5e6b61ad admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:56.060752 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7083c-f2eb-4004-bce9-dcba5e6b61ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:56.061023 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7083c-f2eb-4004-bce9-dcba5e6b61ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:56.062217 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7083c-f2eb-4004-bce9-dcba5e6b61ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:56.063858 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7083c-f2eb-4004-bce9-dcba5e6b61ad admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:56.076350 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1270/2573] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:34:56.080420 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885318e2-8528-4667-a700-b7f112d0d182 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:56.090448 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885318e2-8528-4667-a700-b7f112d0d182 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:56.095462 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d122d-8f8d-4047-96b8-e72d72c9f30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:56.096139 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d122d-8f8d-4047-96b8-e72d72c9f30b admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:56.096438 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d122d-8f8d-4047-96b8-e72d72c9f30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:56.096691 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d122d-8f8d-4047-96b8-e72d72c9f30b admin admin] PATH_INFO: `/v3/projects/75f030b44bd14a829dd3f5ce3badc08d/users/8fccdf198ead484187466052e8f22876/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:56.111543 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d122d-8f8d-4047-96b8-e72d72c9f30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=75f030b44bd14a829dd3f5ce3badc08d, user_id=8fccdf198ead484187466052e8f22876, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:56.114217 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d122d-8f8d-4047-96b8-e72d72c9f30b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:56.127026 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1304/2574] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:34:56 2022] PUT /identity/v3/projects/75f030b44bd14a829dd3f5ce3badc08d/users/8fccdf198ead484187466052e8f22876/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:34:56.138605 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c650575-70af-42a7-9b19-385f78680153 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:56.138893 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c650575-70af-42a7-9b19-385f78680153 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:56.139171 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c650575-70af-42a7-9b19-385f78680153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:56.166560 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6c650575-70af-42a7-9b19-385f78680153 None None] MFA Rules not processed for user `8fccdf198ead484187466052e8f22876`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:56.167790 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6c650575-70af-42a7-9b19-385f78680153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:56.179720 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:56.232339 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1271/2575] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:34:56.243427 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d122d-8f8d-4047-96b8-e72d72c9f30b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:34:56.245165 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5e8d122d-8f8d-4047-96b8-e72d72c9f30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:56.301287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d122d-8f8d-4047-96b8-e72d72c9f30b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:34:56.304968 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f9974-5b9e-49c1-b250-7b1f8dcb387f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6099c38837b44101a17470322916c82e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:34:56.305566 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f9974-5b9e-49c1-b250-7b1f8dcb387f service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:56.305848 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f9974-5b9e-49c1-b250-7b1f8dcb387f service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:56.306121 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f9974-5b9e-49c1-b250-7b1f8dcb387f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:56.314576 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f9974-5b9e-49c1-b250-7b1f8dcb387f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:34:56.316019 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f9974-5b9e-49c1-b250-7b1f8dcb387f service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:34:56.324581 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1305/2576] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:34:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:34:57.676184 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d56f1-1294-4ea2-a1c2-445ed186bc8b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:34:57.676693 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d56f1-1294-4ea2-a1c2-445ed186bc8b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:34:57.676810 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d56f1-1294-4ea2-a1c2-445ed186bc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:34:57.695366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-801d56f1-1294-4ea2-a1c2-445ed186bc8b None None] MFA Rules not processed for user `8fccdf198ead484187466052e8f22876`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:34:57.696584 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-801d56f1-1294-4ea2-a1c2-445ed186bc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:34:57.703849 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1272/2577] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:34:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:35:01.972239 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f9974-5b9e-49c1-b250-7b1f8dcb387f service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:01.974205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0f8f9974-5b9e-49c1-b250-7b1f8dcb387f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:02.040021 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f9974-5b9e-49c1-b250-7b1f8dcb387f service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:02.044631 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671db0c-16d1-4192-9c3c-437b8260edc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:02.045261 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671db0c-16d1-4192-9c3c-437b8260edc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:02.045544 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671db0c-16d1-4192-9c3c-437b8260edc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:02.046321 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671db0c-16d1-4192-9c3c-437b8260edc9 admin admin] PATH_INFO: `/v3/users/70a604c53c5947f1ba4bff590a18eb59` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:02.047463 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671db0c-16d1-4192-9c3c-437b8260edc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70a604c53c5947f1ba4bff590a18eb59)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:02.049418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671db0c-16d1-4192-9c3c-437b8260edc9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:02.054727 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:02.097312 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8671db0c-16d1-4192-9c3c-437b8260edc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70a604c53c5947f1ba4bff590a18eb59'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:02.097970 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8671db0c-16d1-4192-9c3c-437b8260edc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70a604c53c5947f1ba4bff590a18eb59'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:02.104898 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8671db0c-16d1-4192-9c3c-437b8260edc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70a604c53c5947f1ba4bff590a18eb59'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:02.105563 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8671db0c-16d1-4192-9c3c-437b8260edc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70a604c53c5947f1ba4bff590a18eb59'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:02.113264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8671db0c-16d1-4192-9c3c-437b8260edc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70a604c53c5947f1ba4bff590a18eb59'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:02.130421 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1306/2578] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:35:01 2022] DELETE /identity/v3/users/70a604c53c5947f1ba4bff590a18eb59 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:35:02.297730 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d56f1-1294-4ea2-a1c2-445ed186bc8b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:02.309127 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d56f1-1294-4ea2-a1c2-445ed186bc8b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:02.367256 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:02.368009 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:02.368300 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:02.368578 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833 admin admin] PATH_INFO: `/v3/projects/08946559590c413f992b8f3e2558d2f4` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:02.369691 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08946559590c413f992b8f3e2558d2f4)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:02.371607 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:02.417106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08946559590c413f992b8f3e2558d2f4', 'request_id': 'req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:02.424653 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08946559590c413f992b8f3e2558d2f4', 'request_id': 'req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:02.430963 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08946559590c413f992b8f3e2558d2f4', 'request_id': 'req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:02.441212 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833 admin admin] The token cache is being invalidate because project 08946559590c413f992b8f3e2558d2f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:35:02.441525 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:02.442158 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:02.443639 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1273/2579] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:35:02 2022] DELETE /identity/v3/projects/08946559590c413f992b8f3e2558d2f4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:35:12.126808 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:12.438223 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:12.659199 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f55f3-286b-4743-8a9c-d0fd5df23355 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:12.659493 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f55f3-286b-4743-8a9c-d0fd5df23355 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:12.659770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f55f3-286b-4743-8a9c-d0fd5df23355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:12.709963 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-059f55f3-286b-4743-8a9c-d0fd5df23355 None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:35:12.711110 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-059f55f3-286b-4743-8a9c-d0fd5df23355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:12.774616 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1307/2580] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 17 10:35:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:35:12.823202 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:12.824684 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:12.915412 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac3cf4-a5a2-4bd8-a28a-197a5f1de833 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:12.920743 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed635c8-4d12-457a-a098-db6111d3b7d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:12.921445 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed635c8-4d12-457a-a098-db6111d3b7d0 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:12.921752 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed635c8-4d12-457a-a098-db6111d3b7d0 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:12.922079 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed635c8-4d12-457a-a098-db6111d3b7d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:12.930157 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed635c8-4d12-457a-a098-db6111d3b7d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:12.931735 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed635c8-4d12-457a-a098-db6111d3b7d0 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:12.940248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1274/2581] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:35:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 10:35:13.439381 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160e42e-0dad-4de7-80da-839931de37b8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:13.439862 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160e42e-0dad-4de7-80da-839931de37b8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:13.439981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160e42e-0dad-4de7-80da-839931de37b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:13.459235 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b160e42e-0dad-4de7-80da-839931de37b8 None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:35:13.460466 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b160e42e-0dad-4de7-80da-839931de37b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:13.467736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1308/2582] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 17 10:35:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:35:13.480361 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed635c8-4d12-457a-a098-db6111d3b7d0 service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:13.490795 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed635c8-4d12-457a-a098-db6111d3b7d0 service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:13.495731 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767c310-4dbd-4e7b-afba-04fb627fb428 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:13.496341 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767c310-4dbd-4e7b-afba-04fb627fb428 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:13.496618 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767c310-4dbd-4e7b-afba-04fb627fb428 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:13.496885 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767c310-4dbd-4e7b-afba-04fb627fb428 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:13.505243 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767c310-4dbd-4e7b-afba-04fb627fb428 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:13.507040 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767c310-4dbd-4e7b-afba-04fb627fb428 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:13.515355 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1275/2583] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:35:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 10:35:13.737516 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d853e7f-a271-4492-a99b-7f51ac006d65 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:13.737803 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d853e7f-a271-4492-a99b-7f51ac006d65 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:13.738103 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d853e7f-a271-4492-a99b-7f51ac006d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:13.757056 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9d853e7f-a271-4492-a99b-7f51ac006d65 None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:35:13.758238 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9d853e7f-a271-4492-a99b-7f51ac006d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:13.765340 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1309/2584] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 17 10:35:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:35:13.777460 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767c310-4dbd-4e7b-afba-04fb627fb428 service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:13.788906 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767c310-4dbd-4e7b-afba-04fb627fb428 service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:13.798050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0a7ba-fa78-477e-a879-07f55d5bf88b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:13.798050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0a7ba-fa78-477e-a879-07f55d5bf88b service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:13.798050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0a7ba-fa78-477e-a879-07f55d5bf88b service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:13.798050 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0a7ba-fa78-477e-a879-07f55d5bf88b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:13.803940 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0a7ba-fa78-477e-a879-07f55d5bf88b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:13.805531 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0a7ba-fa78-477e-a879-07f55d5bf88b service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:13.814433 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1276/2585] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:35:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 10:35:14.129717 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102c2c3-9e27-4ed7-b1ce-ce9e8d6165fb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:14.130003 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102c2c3-9e27-4ed7-b1ce-ce9e8d6165fb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:14.130302 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102c2c3-9e27-4ed7-b1ce-ce9e8d6165fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:14.149985 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d102c2c3-9e27-4ed7-b1ce-ce9e8d6165fb None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:35:14.151199 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d102c2c3-9e27-4ed7-b1ce-ce9e8d6165fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:14.158280 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1310/2586] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 17 10:35:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:35:14.170168 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0a7ba-fa78-477e-a879-07f55d5bf88b service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:14.181540 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0a7ba-fa78-477e-a879-07f55d5bf88b service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:14.187131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f80afa-3a38-4cc2-b746-44144010cf24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:14.187715 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80afa-3a38-4cc2-b746-44144010cf24 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:14.188029 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80afa-3a38-4cc2-b746-44144010cf24 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:14.188302 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80afa-3a38-4cc2-b746-44144010cf24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:14.196366 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f80afa-3a38-4cc2-b746-44144010cf24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:14.197932 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f80afa-3a38-4cc2-b746-44144010cf24 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:14.205906 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1277/2587] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:35:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 10:35:16.277583 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102c2c3-9e27-4ed7-b1ce-ce9e8d6165fb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:16.278999 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d102c2c3-9e27-4ed7-b1ce-ce9e8d6165fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:16.342417 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102c2c3-9e27-4ed7-b1ce-ce9e8d6165fb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:16.347535 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5fdfa-8bfd-4b42-9b09-c8461e433086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:16.348188 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5fdfa-8bfd-4b42-9b09-c8461e433086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:16.348472 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5fdfa-8bfd-4b42-9b09-c8461e433086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:16.348750 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5fdfa-8bfd-4b42-9b09-c8461e433086 admin admin] PATH_INFO: `/v3/users/8fccdf198ead484187466052e8f22876` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:16.349881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5fdfa-8bfd-4b42-9b09-c8461e433086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fccdf198ead484187466052e8f22876)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:16.351794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5fdfa-8bfd-4b42-9b09-c8461e433086 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:16.396597 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-24c5fdfa-8bfd-4b42-9b09-c8461e433086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fccdf198ead484187466052e8f22876'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:16.397230 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-24c5fdfa-8bfd-4b42-9b09-c8461e433086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fccdf198ead484187466052e8f22876'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:16.402482 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:16.404661 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-24c5fdfa-8bfd-4b42-9b09-c8461e433086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fccdf198ead484187466052e8f22876'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:16.405989 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-24c5fdfa-8bfd-4b42-9b09-c8461e433086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fccdf198ead484187466052e8f22876'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:16.413524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-24c5fdfa-8bfd-4b42-9b09-c8461e433086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fccdf198ead484187466052e8f22876'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:16.430071 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1311/2588] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:35:16 2022] DELETE /identity/v3/users/8fccdf198ead484187466052e8f22876 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:35:16.434489 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd76e7-b225-4e72-81ab-2f305363a3b7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:16.434971 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd76e7-b225-4e72-81ab-2f305363a3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:16.435094 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd76e7-b225-4e72-81ab-2f305363a3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:16.453950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8edd76e7-b225-4e72-81ab-2f305363a3b7 None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:35:16.455135 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8edd76e7-b225-4e72-81ab-2f305363a3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:16.513204 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1278/2589] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:35:16.523145 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5fdfa-8bfd-4b42-9b09-c8461e433086 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:16.524562 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-24c5fdfa-8bfd-4b42-9b09-c8461e433086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:16.581340 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5fdfa-8bfd-4b42-9b09-c8461e433086 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:16.585357 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f15b29-02ad-4668-ba71-789937d16af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:16.585967 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f15b29-02ad-4668-ba71-789937d16af8 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:16.586252 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f15b29-02ad-4668-ba71-789937d16af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:16.586522 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f15b29-02ad-4668-ba71-789937d16af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:16.595794 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f15b29-02ad-4668-ba71-789937d16af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:16.597195 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f15b29-02ad-4668-ba71-789937d16af8 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:16.606418 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1312/2590] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:35:16.771295 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd76e7-b225-4e72-81ab-2f305363a3b7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:16.772832 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8edd76e7-b225-4e72-81ab-2f305363a3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:16.786714 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd76e7-b225-4e72-81ab-2f305363a3b7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:16.791444 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cd11c-015d-4530-8ba2-c1f9996e39a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:16.792106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cd11c-015d-4530-8ba2-c1f9996e39a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:16.792383 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cd11c-015d-4530-8ba2-c1f9996e39a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:16.792654 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cd11c-015d-4530-8ba2-c1f9996e39a9 admin admin] PATH_INFO: `/v3/projects/75f030b44bd14a829dd3f5ce3badc08d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:16.793763 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cd11c-015d-4530-8ba2-c1f9996e39a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75f030b44bd14a829dd3f5ce3badc08d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:16.795659 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cd11c-015d-4530-8ba2-c1f9996e39a9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:16.826993 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:16.845157 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-200cd11c-015d-4530-8ba2-c1f9996e39a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75f030b44bd14a829dd3f5ce3badc08d', 'request_id': 'req-200cd11c-015d-4530-8ba2-c1f9996e39a9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:16.852337 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-200cd11c-015d-4530-8ba2-c1f9996e39a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75f030b44bd14a829dd3f5ce3badc08d', 'request_id': 'req-200cd11c-015d-4530-8ba2-c1f9996e39a9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:16.859225 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-200cd11c-015d-4530-8ba2-c1f9996e39a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75f030b44bd14a829dd3f5ce3badc08d', 'request_id': 'req-200cd11c-015d-4530-8ba2-c1f9996e39a9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:16.869231 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-200cd11c-015d-4530-8ba2-c1f9996e39a9 admin admin] The token cache is being invalidate because project 75f030b44bd14a829dd3f5ce3badc08d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:35:16.869512 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-200cd11c-015d-4530-8ba2-c1f9996e39a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:16.870127 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-200cd11c-015d-4530-8ba2-c1f9996e39a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:35:16.871575 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1279/2591] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:35:16 2022] DELETE /identity/v3/projects/75f030b44bd14a829dd3f5ce3badc08d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:35:16.876500 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00354828-009a-4c09-9189-67cb8fdb0c5c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:16.876793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00354828-009a-4c09-9189-67cb8fdb0c5c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:16.877079 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00354828-009a-4c09-9189-67cb8fdb0c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:16.896803 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-00354828-009a-4c09-9189-67cb8fdb0c5c None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:35:16.898003 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-00354828-009a-4c09-9189-67cb8fdb0c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:16.955016 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1313/2592] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:35:16.963736 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9b8c0-65da-4638-85da-547a92a358db None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:16.964049 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9b8c0-65da-4638-85da-547a92a358db None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:16.964326 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9b8c0-65da-4638-85da-547a92a358db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:16.984384 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d5b9b8c0-65da-4638-85da-547a92a358db None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:35:16.985587 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d5b9b8c0-65da-4638-85da-547a92a358db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:16.993421 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1280/2593] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:35:16.997850 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00354828-009a-4c09-9189-67cb8fdb0c5c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:17.008080 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00354828-009a-4c09-9189-67cb8fdb0c5c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:17.013081 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd3512-31bc-4712-98ed-4d3da160461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:17.013862 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd3512-31bc-4712-98ed-4d3da160461a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:17.014020 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd3512-31bc-4712-98ed-4d3da160461a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:17.014320 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd3512-31bc-4712-98ed-4d3da160461a admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:17.015483 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd3512-31bc-4712-98ed-4d3da160461a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 10:35:17.015813 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd3512-31bc-4712-98ed-4d3da160461a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:17.017431 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd3512-31bc-4712-98ed-4d3da160461a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:17.029326 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1314/2594] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 17 10:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 10:35:17.034372 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9b8c0-65da-4638-85da-547a92a358db None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:17.043635 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9b8c0-65da-4638-85da-547a92a358db None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:17.048313 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592518f1-83dc-45a5-be30-54573f0f3b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:17.048902 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592518f1-83dc-45a5-be30-54573f0f3b7f admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:17.049180 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592518f1-83dc-45a5-be30-54573f0f3b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:17.049452 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592518f1-83dc-45a5-be30-54573f0f3b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:17.050080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592518f1-83dc-45a5-be30-54573f0f3b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:17.051987 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592518f1-83dc-45a5-be30-54573f0f3b7f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:17.079749 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1281/2595] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:35:17 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:35:17.083834 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd3512-31bc-4712-98ed-4d3da160461a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:17.094192 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd3512-31bc-4712-98ed-4d3da160461a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:17.148378 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c52d-a956-4481-b92b-95a91c172ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:17.148972 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c52d-a956-4481-b92b-95a91c172ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:17.149254 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c52d-a956-4481-b92b-95a91c172ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:17.149520 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c52d-a956-4481-b92b-95a91c172ef0 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:17.150134 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052c52d-a956-4481-b92b-95a91c172ef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:17.152051 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052c52d-a956-4481-b92b-95a91c172ef0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:17.161694 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:17.180951 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1315/2596] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:35:17 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:35:17.182360 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592518f1-83dc-45a5-be30-54573f0f3b7f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:17.192677 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592518f1-83dc-45a5-be30-54573f0f3b7f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:17.197486 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f63d0-1728-47f3-a45d-cf42453623f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:17.198074 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f63d0-1728-47f3-a45d-cf42453623f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:17.198354 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f63d0-1728-47f3-a45d-cf42453623f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:17.198626 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f63d0-1728-47f3-a45d-cf42453623f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:17.199261 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f63d0-1728-47f3-a45d-cf42453623f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:17.200982 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f63d0-1728-47f3-a45d-cf42453623f7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:17.211949 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1282/2597] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:35:17.215725 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c52d-a956-4481-b92b-95a91c172ef0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:17.226256 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c52d-a956-4481-b92b-95a91c172ef0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:17.231168 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09696b-a0b2-4796-b088-349742fe293b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:17.231767 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09696b-a0b2-4796-b088-349742fe293b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:17.232107 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09696b-a0b2-4796-b088-349742fe293b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:17.232387 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09696b-a0b2-4796-b088-349742fe293b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:17.233037 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09696b-a0b2-4796-b088-349742fe293b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:17.234695 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09696b-a0b2-4796-b088-349742fe293b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:17.246208 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1316/2598] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:35:17.250683 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f63d0-1728-47f3-a45d-cf42453623f7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:17.260802 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f63d0-1728-47f3-a45d-cf42453623f7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:17.266072 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a08f03-7a36-4beb-8ea3-1ba78ff8064d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:17.266710 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a08f03-7a36-4beb-8ea3-1ba78ff8064d admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:17.266987 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a08f03-7a36-4beb-8ea3-1ba78ff8064d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:17.267260 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a08f03-7a36-4beb-8ea3-1ba78ff8064d admin admin] PATH_INFO: `/v3/projects/1462fa5400a94c158abcee25eaf2c4f1/users/ed08388c5ac74971b715c5e4dd8ba20f/roles/5d2fc6de54204986a2c3aedc42288813` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:17.281775 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a08f03-7a36-4beb-8ea3-1ba78ff8064d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1462fa5400a94c158abcee25eaf2c4f1, user_id=ed08388c5ac74971b715c5e4dd8ba20f, role_id=5d2fc6de54204986a2c3aedc42288813)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:17.284455 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a08f03-7a36-4beb-8ea3-1ba78ff8064d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:17.297073 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1283/2599] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:35:17 2022] PUT /identity/v3/projects/1462fa5400a94c158abcee25eaf2c4f1/users/ed08388c5ac74971b715c5e4dd8ba20f/roles/5d2fc6de54204986a2c3aedc42288813 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:35:17.302682 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3080c-f38a-4678-a080-246569a961aa None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:17.303188 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3080c-f38a-4678-a080-246569a961aa None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:17.303288 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3080c-f38a-4678-a080-246569a961aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:17.322689 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-33e3080c-f38a-4678-a080-246569a961aa None None] MFA Rules not processed for user `b74fb7e0184d4dd9bc4b1b1fd5ed0d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:35:17.323881 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-33e3080c-f38a-4678-a080-246569a961aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:17.381996 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1317/2600] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:35:17.392335 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a08f03-7a36-4beb-8ea3-1ba78ff8064d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:17.394007 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-07a08f03-7a36-4beb-8ea3-1ba78ff8064d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:17.449950 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a08f03-7a36-4beb-8ea3-1ba78ff8064d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:17.454199 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a03708-0953-4e1c-96a7-8538610e1c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:17.454793 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a03708-0953-4e1c-96a7-8538610e1c94 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:17.455072 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a03708-0953-4e1c-96a7-8538610e1c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:17.455343 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a03708-0953-4e1c-96a7-8538610e1c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:17.464229 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a03708-0953-4e1c-96a7-8538610e1c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:17.465647 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a03708-0953-4e1c-96a7-8538610e1c94 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:17.474913 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1284/2601] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:35:21.414965 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bef856-ddd7-4066-acb2-0858717b138a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:21.415453 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bef856-ddd7-4066-acb2-0858717b138a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:21.415453 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bef856-ddd7-4066-acb2-0858717b138a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:21.445946 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-39bef856-ddd7-4066-acb2-0858717b138a None None] MFA Rules not processed for user `ed08388c5ac74971b715c5e4dd8ba20f`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:35:21.447250 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-39bef856-ddd7-4066-acb2-0858717b138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:21.519683 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1318/2602] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:35:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:35:21.524327 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a03708-0953-4e1c-96a7-8538610e1c94 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:21.534450 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a03708-0953-4e1c-96a7-8538610e1c94 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:21.539292 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f9f90-5a29-4dd8-ab6c-03182960c9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:21.539899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f9f90-5a29-4dd8-ab6c-03182960c9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:21.540218 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f9f90-5a29-4dd8-ab6c-03182960c9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:21.540492 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f9f90-5a29-4dd8-ab6c-03182960c9d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:21.541131 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f9f90-5a29-4dd8-ab6c-03182960c9d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:21.543038 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f9f90-5a29-4dd8-ab6c-03182960c9d2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:21.572332 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1285/2603] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 17 10:35:21 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:35:21.576154 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bef856-ddd7-4066-acb2-0858717b138a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:21.587600 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bef856-ddd7-4066-acb2-0858717b138a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:21.647433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4c7ae-f13c-4981-8beb-f2773a021715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:21.648163 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4c7ae-f13c-4981-8beb-f2773a021715 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:21.648443 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4c7ae-f13c-4981-8beb-f2773a021715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:21.648719 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4c7ae-f13c-4981-8beb-f2773a021715 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:21.649376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4c7ae-f13c-4981-8beb-f2773a021715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:21.651358 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4c7ae-f13c-4981-8beb-f2773a021715 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:21.670028 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:21.677010 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1319/2604] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 17 10:35:21 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 10:35:21.680602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f9f90-5a29-4dd8-ab6c-03182960c9d2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:21.691151 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f9f90-5a29-4dd8-ab6c-03182960c9d2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:21.696018 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65707e-d47d-4af5-807e-6e75586855ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:21.696701 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65707e-d47d-4af5-807e-6e75586855ca admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:21.697069 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65707e-d47d-4af5-807e-6e75586855ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:21.697408 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65707e-d47d-4af5-807e-6e75586855ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:21.698150 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65707e-d47d-4af5-807e-6e75586855ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:21.699813 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65707e-d47d-4af5-807e-6e75586855ca admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:21.715080 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1286/2605] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:35:21.716175 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4c7ae-f13c-4981-8beb-f2773a021715 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:21.727410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4c7ae-f13c-4981-8beb-f2773a021715 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:21.732376 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e2564-9f6b-4302-abe8-bfdfec2dde9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:21.732981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e2564-9f6b-4302-abe8-bfdfec2dde9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:21.733319 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e2564-9f6b-4302-abe8-bfdfec2dde9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:21.733601 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e2564-9f6b-4302-abe8-bfdfec2dde9f admin admin] PATH_INFO: `/v3/projects/16b23c8786f545d894faeebe7c9c0c65/users/9ddb344e502240daac97aaf3e2fc24d2/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:21.750221 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e2564-9f6b-4302-abe8-bfdfec2dde9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=16b23c8786f545d894faeebe7c9c0c65, user_id=9ddb344e502240daac97aaf3e2fc24d2, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:21.752940 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e2564-9f6b-4302-abe8-bfdfec2dde9f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:21.768960 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1320/2606] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:35:21 2022] PUT /identity/v3/projects/16b23c8786f545d894faeebe7c9c0c65/users/9ddb344e502240daac97aaf3e2fc24d2/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:35:21.772868 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65707e-d47d-4af5-807e-6e75586855ca admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:21.783831 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65707e-d47d-4af5-807e-6e75586855ca admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:21.801405 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:21.846450 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f683c0-16dc-443f-a3f9-74b5ebff28cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:21.847167 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f683c0-16dc-443f-a3f9-74b5ebff28cb admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:21.847336 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f683c0-16dc-443f-a3f9-74b5ebff28cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:21.847613 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f683c0-16dc-443f-a3f9-74b5ebff28cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:21.848291 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f683c0-16dc-443f-a3f9-74b5ebff28cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:21.849931 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f683c0-16dc-443f-a3f9-74b5ebff28cb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:21.860482 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1287/2607] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 17 10:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 10:35:21.864755 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e2564-9f6b-4302-abe8-bfdfec2dde9f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:21.875502 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e2564-9f6b-4302-abe8-bfdfec2dde9f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:21.880160 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5955a69-fbb4-4b61-a217-e40b23f38b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:21.880803 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5955a69-fbb4-4b61-a217-e40b23f38b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:21.881082 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5955a69-fbb4-4b61-a217-e40b23f38b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:21.881615 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5955a69-fbb4-4b61-a217-e40b23f38b0e admin admin] PATH_INFO: `/v3/projects/16b23c8786f545d894faeebe7c9c0c65/users/9ddb344e502240daac97aaf3e2fc24d2/roles/5e3dfffec8aa470fab9232cc439aec74` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:21.883520 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5955a69-fbb4-4b61-a217-e40b23f38b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=16b23c8786f545d894faeebe7c9c0c65, user_id=9ddb344e502240daac97aaf3e2fc24d2, role_id=5e3dfffec8aa470fab9232cc439aec74)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:21.886185 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5955a69-fbb4-4b61-a217-e40b23f38b0e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:21.896793 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1321/2608] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 17 10:35:21 2022] PUT /identity/v3/projects/16b23c8786f545d894faeebe7c9c0c65/users/9ddb344e502240daac97aaf3e2fc24d2/roles/5e3dfffec8aa470fab9232cc439aec74 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:35:26.232890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db5cf1-5478-4127-841a-58262b389a40 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:26.233503 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db5cf1-5478-4127-841a-58262b389a40 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:26.233503 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db5cf1-5478-4127-841a-58262b389a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:26.266563 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-73db5cf1-5478-4127-841a-58262b389a40 None None] MFA Rules not processed for user `9ddb344e502240daac97aaf3e2fc24d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:35:26.268031 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-73db5cf1-5478-4127-841a-58262b389a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:26.357277 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1288/2609] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:35:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:35:26.372452 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5955a69-fbb4-4b61-a217-e40b23f38b0e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:26.375549 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e5955a69-fbb4-4b61-a217-e40b23f38b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:26.446406 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5955a69-fbb4-4b61-a217-e40b23f38b0e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:26.450644 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbfe89-3dc2-40eb-a76d-727462fbb527 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd5d41f6a16403f990a4cd5922a2644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:26.451473 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbfe89-3dc2-40eb-a76d-727462fbb527 service glance] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:26.451949 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbfe89-3dc2-40eb-a76d-727462fbb527 service glance] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:26.453174 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbfe89-3dc2-40eb-a76d-727462fbb527 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:26.520369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbfe89-3dc2-40eb-a76d-727462fbb527 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:26.521916 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbfe89-3dc2-40eb-a76d-727462fbb527 service glance] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:26.532776 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1322/2610] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:35:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:35:26.688722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf74e31-746a-4bd4-a4d2-55c0e67953af None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:26.688722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf74e31-746a-4bd4-a4d2-55c0e67953af None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:26.688722 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf74e31-746a-4bd4-a4d2-55c0e67953af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:26.710129 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dcf74e31-746a-4bd4-a4d2-55c0e67953af None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:35:26.711344 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dcf74e31-746a-4bd4-a4d2-55c0e67953af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:26.776436 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1289/2611] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 17 10:35:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:35:26.790444 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbfe89-3dc2-40eb-a76d-727462fbb527 service glance] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:26.792583 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-78bbfe89-3dc2-40eb-a76d-727462fbb527 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:26.872437 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbfe89-3dc2-40eb-a76d-727462fbb527 service glance] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:26.878499 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe8494-799d-4fb3-90a3-e528c9b71ee4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:26.879121 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe8494-799d-4fb3-90a3-e528c9b71ee4 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:26.879439 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe8494-799d-4fb3-90a3-e528c9b71ee4 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:26.879675 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe8494-799d-4fb3-90a3-e528c9b71ee4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:26.888264 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe8494-799d-4fb3-90a3-e528c9b71ee4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:26.889908 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe8494-799d-4fb3-90a3-e528c9b71ee4 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:26.898055 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1323/2612] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:35:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 10:35:35.492047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9827-f121-4762-94a0-16f9403278b9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:35.492554 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9827-f121-4762-94a0-16f9403278b9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:35.492648 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9827-f121-4762-94a0-16f9403278b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:35.512912 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4b7d9827-f121-4762-94a0-16f9403278b9 None None] MFA Rules not processed for user `ed08388c5ac74971b715c5e4dd8ba20f`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:35:35.514100 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4b7d9827-f121-4762-94a0-16f9403278b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:35.521432 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1290/2613] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 17 10:35:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:35:36.087660 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe8494-799d-4fb3-90a3-e528c9b71ee4 service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:36.089202 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f7fe8494-799d-4fb3-90a3-e528c9b71ee4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:36.099861 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:36.163835 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe8494-799d-4fb3-90a3-e528c9b71ee4 service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:36.169037 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6528c5-d341-4017-9707-1c8507d26d31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd52eee25ef347e1ae905cc3cba17284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:36.169654 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6528c5-d341-4017-9707-1c8507d26d31 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:36.169932 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6528c5-d341-4017-9707-1c8507d26d31 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:36.170205 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6528c5-d341-4017-9707-1c8507d26d31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:36.172584 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1b6528c5-d341-4017-9707-1c8507d26d31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:36.183918 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6528c5-d341-4017-9707-1c8507d26d31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:36.185525 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6528c5-d341-4017-9707-1c8507d26d31 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:36.195855 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1324/2614] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:35:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:35:37.494377 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96da32-9024-474f-87a8-4cd31e8f3f11 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:37.494839 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96da32-9024-474f-87a8-4cd31e8f3f11 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:37.495001 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96da32-9024-474f-87a8-4cd31e8f3f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:37.516527 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5f96da32-9024-474f-87a8-4cd31e8f3f11 None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:35:37.517728 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5f96da32-9024-474f-87a8-4cd31e8f3f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:37.525248 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1291/2615] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 17 10:35:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 10:35:37.537770 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6528c5-d341-4017-9707-1c8507d26d31 service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:37.549040 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6528c5-d341-4017-9707-1c8507d26d31 service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:37.554287 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913083f-00e0-466e-b1fa-0df9fcd64584 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:37.554924 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913083f-00e0-466e-b1fa-0df9fcd64584 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:37.555201 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913083f-00e0-466e-b1fa-0df9fcd64584 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:37.555508 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913083f-00e0-466e-b1fa-0df9fcd64584 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:37.564340 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913083f-00e0-466e-b1fa-0df9fcd64584 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:37.565937 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913083f-00e0-466e-b1fa-0df9fcd64584 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:37.574027 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1325/2616] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:35:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 10:35:47.511219 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=85 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:47.570701 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=35 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:50.113161 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96da32-9024-474f-87a8-4cd31e8f3f11 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:50.169074 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96da32-9024-474f-87a8-4cd31e8f3f11 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:50.174390 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060eaad-d5fc-45a9-8fa3-bf15b1c4425b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:50.175009 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060eaad-d5fc-45a9-8fa3-bf15b1c4425b service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:50.175298 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060eaad-d5fc-45a9-8fa3-bf15b1c4425b service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:50.175568 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060eaad-d5fc-45a9-8fa3-bf15b1c4425b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:50.177598 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3060eaad-d5fc-45a9-8fa3-bf15b1c4425b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:50.188470 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060eaad-d5fc-45a9-8fa3-bf15b1c4425b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:50.189941 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060eaad-d5fc-45a9-8fa3-bf15b1c4425b service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:50.198237 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1292/2617] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:35:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:35:51.090762 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913083f-00e0-466e-b1fa-0df9fcd64584 service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:51.092327 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2913083f-00e0-466e-b1fa-0df9fcd64584 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:51.174681 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913083f-00e0-466e-b1fa-0df9fcd64584 service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:51.180369 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ceea49-deb4-4945-8699-a96c9b585114 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:51.180981 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceea49-deb4-4945-8699-a96c9b585114 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:51.181314 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceea49-deb4-4945-8699-a96c9b585114 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:51.181596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceea49-deb4-4945-8699-a96c9b585114 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:51.183366 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-95ceea49-deb4-4945-8699-a96c9b585114 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:51.195969 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ceea49-deb4-4945-8699-a96c9b585114 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:51.197548 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ceea49-deb4-4945-8699-a96c9b585114 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:51.208265 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1326/2618] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:35:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:35:57.098841 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060eaad-d5fc-45a9-8fa3-bf15b1c4425b service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:35:57.112890 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060eaad-d5fc-45a9-8fa3-bf15b1c4425b service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:35:57.118479 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c0a59-a310-4285-ba70-93adc20a984f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:35:57.119082 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c0a59-a310-4285-ba70-93adc20a984f service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:35:57.119365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c0a59-a310-4285-ba70-93adc20a984f service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:35:57.119643 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c0a59-a310-4285-ba70-93adc20a984f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:35:57.121365 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-075c0a59-a310-4285-ba70-93adc20a984f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:35:57.134583 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c0a59-a310-4285-ba70-93adc20a984f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:35:57.136355 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c0a59-a310-4285-ba70-93adc20a984f service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:35:57.148529 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1293/2619] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:35:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:36:01.203643 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=34 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:04.564964 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ceea49-deb4-4945-8699-a96c9b585114 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:36:04.574524 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ceea49-deb4-4945-8699-a96c9b585114 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:36:04.578173 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa7f6e-1d48-4382-bed2-b5f6f0777e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98030e60807e44ec928488e904ca24c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:36:04.578874 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7f6e-1d48-4382-bed2-b5f6f0777e25 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:36:04.579733 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7f6e-1d48-4382-bed2-b5f6f0777e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:36:04.580044 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7f6e-1d48-4382-bed2-b5f6f0777e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:36:04.589425 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa7f6e-1d48-4382-bed2-b5f6f0777e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:36:04.590797 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa7f6e-1d48-4382-bed2-b5f6f0777e25 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:36:04.600433 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1327/2620] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:36:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:36:07.144449 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=32 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:14.596140 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:38:24.490375 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c0a59-a310-4285-ba70-93adc20a984f service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:38:24.502321 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c0a59-a310-4285-ba70-93adc20a984f service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:38:24.509752 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfbd7d-c6d6-4f9d-9418-b8d0c1d2cb7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80cc7ec3d2d49f88c81403f918a6900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:38:24.510616 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfbd7d-c6d6-4f9d-9418-b8d0c1d2cb7a service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:38:24.511106 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfbd7d-c6d6-4f9d-9418-b8d0c1d2cb7a service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:38:24.511579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfbd7d-c6d6-4f9d-9418-b8d0c1d2cb7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:38:24.513602 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7ddfbd7d-c6d6-4f9d-9418-b8d0c1d2cb7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:38:24.527194 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfbd7d-c6d6-4f9d-9418-b8d0c1d2cb7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:38:24.529560 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfbd7d-c6d6-4f9d-9418-b8d0c1d2cb7a service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:38:24.544579 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1294/2621] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:38:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:38:30.997759 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa7f6e-1d48-4382-bed2-b5f6f0777e25 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:38:30.999143 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-83fa7f6e-1d48-4382-bed2-b5f6f0777e25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:38:31.014342 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa7f6e-1d48-4382-bed2-b5f6f0777e25 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:38:31.019350 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3e175-ac25-4515-831c-3462ca14a3f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd52eee25ef347e1ae905cc3cba17284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:38:31.019957 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3e175-ac25-4515-831c-3462ca14a3f2 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:38:31.020246 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3e175-ac25-4515-831c-3462ca14a3f2 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:38:31.020518 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3e175-ac25-4515-831c-3462ca14a3f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:38:31.022236 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-28f3e175-ac25-4515-831c-3462ca14a3f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:38:31.033596 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3e175-ac25-4515-831c-3462ca14a3f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:38:31.035111 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3e175-ac25-4515-831c-3462ca14a3f2 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:38:31.045036 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1328/2622] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:38:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:38:31.733566 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2715c7-4a36-4aee-8af0-50d5b8d7795a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:38:31.734066 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2715c7-4a36-4aee-8af0-50d5b8d7795a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:38:31.734172 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2715c7-4a36-4aee-8af0-50d5b8d7795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:38:31.753971 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2b2715c7-4a36-4aee-8af0-50d5b8d7795a None None] MFA Rules not processed for user `fe49f95fd5a446f7a57beb62d854d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 10:38:31.755151 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2b2715c7-4a36-4aee-8af0-50d5b8d7795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:38:31.762899 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1295/2623] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 17 10:38:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 10:38:31.805043 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3e175-ac25-4515-831c-3462ca14a3f2 service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:38:31.816410 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3e175-ac25-4515-831c-3462ca14a3f2 service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:38:31.821528 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8fa6a-3dbd-410b-8650-85b420f2f610 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2969c098a154afcba382c707122598d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:38:31.822138 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8fa6a-3dbd-410b-8650-85b420f2f610 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:38:31.822399 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8fa6a-3dbd-410b-8650-85b420f2f610 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:38:31.822674 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8fa6a-3dbd-410b-8650-85b420f2f610 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:38:31.830736 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8fa6a-3dbd-410b-8650-85b420f2f610 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:38:31.832355 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8fa6a-3dbd-410b-8650-85b420f2f610 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:38:31.840705 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1329/2624] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 17 10:38:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 10:38:35.310689 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2715c7-4a36-4aee-8af0-50d5b8d7795a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:38:35.322729 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2715c7-4a36-4aee-8af0-50d5b8d7795a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:38:35.328086 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4a4bf-dfb8-4927-9314-0eccaefc40c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd52eee25ef347e1ae905cc3cba17284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b2dd5de0274a6896d407b0ff22ff54', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:38:35.328715 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4a4bf-dfb8-4927-9314-0eccaefc40c1 service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:38:35.328988 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4a4bf-dfb8-4927-9314-0eccaefc40c1 service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:38:35.329428 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4a4bf-dfb8-4927-9314-0eccaefc40c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:38:35.331475 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c7e4a4bf-dfb8-4927-9314-0eccaefc40c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:38:35.346404 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4a4bf-dfb8-4927-9314-0eccaefc40c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:38:35.348139 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4a4bf-dfb8-4927-9314-0eccaefc40c1 service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:38:35.364010 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1296/2625] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 17 10:38:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 10:38:38.569884 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8fa6a-3dbd-410b-8650-85b420f2f610 service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:38:38.653396 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8fa6a-3dbd-410b-8650-85b420f2f610 service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:38:38.658118 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e4dfd-4002-405b-8583-284d36ab0674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:38:38.658771 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e4dfd-4002-405b-8583-284d36ab0674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:38:38.659048 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e4dfd-4002-405b-8583-284d36ab0674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:38:38.659317 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e4dfd-4002-405b-8583-284d36ab0674 admin admin] PATH_INFO: `/v3/users/ed08388c5ac74971b715c5e4dd8ba20f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:38:38.660498 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e4dfd-4002-405b-8583-284d36ab0674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed08388c5ac74971b715c5e4dd8ba20f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:38:38.662496 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e4dfd-4002-405b-8583-284d36ab0674 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:38:38.722012 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0f6e4dfd-4002-405b-8583-284d36ab0674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed08388c5ac74971b715c5e4dd8ba20f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:38.722634 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0f6e4dfd-4002-405b-8583-284d36ab0674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed08388c5ac74971b715c5e4dd8ba20f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:38.731346 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0f6e4dfd-4002-405b-8583-284d36ab0674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed08388c5ac74971b715c5e4dd8ba20f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:38.732134 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0f6e4dfd-4002-405b-8583-284d36ab0674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed08388c5ac74971b715c5e4dd8ba20f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:38.740968 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0f6e4dfd-4002-405b-8583-284d36ab0674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed08388c5ac74971b715c5e4dd8ba20f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:38.762127 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1330/2626] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:38:38 2022] DELETE /identity/v3/users/ed08388c5ac74971b715c5e4dd8ba20f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 10:38:38.951578 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4a4bf-dfb8-4927-9314-0eccaefc40c1 service placement] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:38:38.962869 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4a4bf-dfb8-4927-9314-0eccaefc40c1 service placement] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:38:39.021158 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc318a8a-61cd-439b-9484-f82d11ced76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:38:39.021829 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc318a8a-61cd-439b-9484-f82d11ced76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:38:39.022108 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc318a8a-61cd-439b-9484-f82d11ced76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:38:39.022381 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc318a8a-61cd-439b-9484-f82d11ced76f admin admin] PATH_INFO: `/v3/projects/1462fa5400a94c158abcee25eaf2c4f1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:38:39.023507 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc318a8a-61cd-439b-9484-f82d11ced76f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1462fa5400a94c158abcee25eaf2c4f1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:38:39.025449 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc318a8a-61cd-439b-9484-f82d11ced76f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:38:39.073658 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fc318a8a-61cd-439b-9484-f82d11ced76f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1462fa5400a94c158abcee25eaf2c4f1', 'request_id': 'req-fc318a8a-61cd-439b-9484-f82d11ced76f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:39.082057 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fc318a8a-61cd-439b-9484-f82d11ced76f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1462fa5400a94c158abcee25eaf2c4f1', 'request_id': 'req-fc318a8a-61cd-439b-9484-f82d11ced76f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:39.088543 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fc318a8a-61cd-439b-9484-f82d11ced76f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1462fa5400a94c158abcee25eaf2c4f1', 'request_id': 'req-fc318a8a-61cd-439b-9484-f82d11ced76f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:39.098763 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fc318a8a-61cd-439b-9484-f82d11ced76f admin admin] The token cache is being invalidate because project 1462fa5400a94c158abcee25eaf2c4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:38:39.099054 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fc318a8a-61cd-439b-9484-f82d11ced76f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:39.100220 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-fc318a8a-61cd-439b-9484-f82d11ced76f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:39.101833 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1297/2627] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:38:38 2022] DELETE /identity/v3/projects/1462fa5400a94c158abcee25eaf2c4f1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:38:39.105956 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e4dfd-4002-405b-8583-284d36ab0674 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:38:39.107383 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0f6e4dfd-4002-405b-8583-284d36ab0674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:38:39.121052 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e4dfd-4002-405b-8583-284d36ab0674 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:38:39.168721 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:38:39.178543 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6eafcd-a349-4f2a-8acb-0ee912050f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:38:39.179198 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eafcd-a349-4f2a-8acb-0ee912050f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:38:39.179474 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eafcd-a349-4f2a-8acb-0ee912050f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:38:39.179745 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eafcd-a349-4f2a-8acb-0ee912050f83 admin admin] PATH_INFO: `/v3/users/9ddb344e502240daac97aaf3e2fc24d2` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:38:39.180893 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6eafcd-a349-4f2a-8acb-0ee912050f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ddb344e502240daac97aaf3e2fc24d2)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:38:39.182812 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6eafcd-a349-4f2a-8acb-0ee912050f83 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:38:39.228475 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7f6eafcd-a349-4f2a-8acb-0ee912050f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ddb344e502240daac97aaf3e2fc24d2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:39.229049 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7f6eafcd-a349-4f2a-8acb-0ee912050f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ddb344e502240daac97aaf3e2fc24d2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:39.235897 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7f6eafcd-a349-4f2a-8acb-0ee912050f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ddb344e502240daac97aaf3e2fc24d2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:39.236543 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7f6eafcd-a349-4f2a-8acb-0ee912050f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ddb344e502240daac97aaf3e2fc24d2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:39.244129 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7f6eafcd-a349-4f2a-8acb-0ee912050f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ddb344e502240daac97aaf3e2fc24d2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:39.261845 dv-cinder-860209-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1331/2628] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 17 10:38:39 2022] DELETE /identity/v3/users/9ddb344e502240daac97aaf3e2fc24d2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:38:39.424501 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc318a8a-61cd-439b-9484-f82d11ced76f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 10:38:39.426054 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fc318a8a-61cd-439b-9484-f82d11ced76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 10:38:39.439047 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc318a8a-61cd-439b-9484-f82d11ced76f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 10:38:39.489272 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:38:39.496481 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349386b7-3206-4583-944a-7a07cc6f714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74fb7e0184d4dd9bc4b1b1fd5ed0d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb717994bee40c5a122b7bec779dc47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 10:38:39.497191 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349386b7-3206-4583-944a-7a07cc6f714e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 10:38:39.497678 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349386b7-3206-4583-944a-7a07cc6f714e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 10:38:39.498212 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349386b7-3206-4583-944a-7a07cc6f714e admin admin] PATH_INFO: `/v3/projects/16b23c8786f545d894faeebe7c9c0c65` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 10:38:39.499488 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349386b7-3206-4583-944a-7a07cc6f714e admin admin] RBAC: Authorizing `identity:delete_project(project_id=16b23c8786f545d894faeebe7c9c0c65)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 10:38:39.501416 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349386b7-3206-4583-944a-7a07cc6f714e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 10:38:39.546880 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-349386b7-3206-4583-944a-7a07cc6f714e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16b23c8786f545d894faeebe7c9c0c65', 'request_id': 'req-349386b7-3206-4583-944a-7a07cc6f714e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:39.553877 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-349386b7-3206-4583-944a-7a07cc6f714e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16b23c8786f545d894faeebe7c9c0c65', 'request_id': 'req-349386b7-3206-4583-944a-7a07cc6f714e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:39.560386 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-349386b7-3206-4583-944a-7a07cc6f714e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16b23c8786f545d894faeebe7c9c0c65', 'request_id': 'req-349386b7-3206-4583-944a-7a07cc6f714e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:39.570945 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-349386b7-3206-4583-944a-7a07cc6f714e admin admin] The token cache is being invalidate because project 16b23c8786f545d894faeebe7c9c0c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 10:38:39.571231 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-349386b7-3206-4583-944a-7a07cc6f714e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:39.571891 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-349386b7-3206-4583-944a-7a07cc6f714e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 10:38:39.573393 dv-cinder-860209-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1298/2629] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 17 10:38:39 2022] DELETE /identity/v3/projects/16b23c8786f545d894faeebe7c9c0c65 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 10:38:49.258446 dv-cinder-860209-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:38:49.568077 dv-cinder-860209-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}